Camera-based virtual environment interaction on mobile devices

Creative Commons License

Çapın T. K., Haro A., Setlur V., Wilkinson S.

ISCIS 2006: 21th International Symposium on Computer and Information Sciences, İstanbul, Turkey, 1 - 03 November 2006, vol.4263 LNCS, pp.765-773 identifier

  • Publication Type: Conference Paper / Full Text
  • Volume: 4263 LNCS
  • Doi Number: 10.1007/11902140_80
  • City: İstanbul
  • Country: Turkey
  • Page Numbers: pp.765-773
  • Keywords: Camera-based interaction, Computer vision, Mobile device, Virtual environment
  • TED University Affiliated: No


Mobile virtual environments, with real-time 3D and 2D graphics, are now possible on smart phone and other camera-enabled devices. Using computer vision, the camera sensor can be treated as an input modality in applications by analyzing the incoming live video. We present our tracking algorithm and several mobile virtual environment and gaming prototypes including: a 3D first person shooter, a 2D puzzle game and a simple action game. Camera-based interaction provides a user experience that is not possible through traditional means, and maximizes the use of the limited display size. © Springer-Verlag Berlin Heidelberg 2006.