Mobile camera-based user interaction

Creative Commons License

Haro A., Mori K., Çapın T. K., Wilkinson S.

ICCV 2005 Workshop on HCI - Computer Vision in Human-Computer Interaction, Beijing, China, 21 October 2005, vol.3766 LNCS, pp.79-89 identifier

  • Publication Type: Conference Paper / Full Text
  • Volume: 3766 LNCS
  • Doi Number: 10.1007/11573425_8
  • City: Beijing
  • Country: China
  • Page Numbers: pp.79-89
  • TED University Affiliated: No


We present an approach for facilitating user interaction on mobile devices, focusing on camera-enabled mobile phones. A user interacts with an application by moving their device. An on-board camera is used to capture incoming video and the scrolling direction and magnitude are estimated using a feature-based tracking algorithm. The direction is used as the scroll direction in the application, and the magnitude is used to set the zoom level. The camera is treated as a pointing device and zoom level control in applications, Our approach generates mouse events, so any application that is mouse-driven can make use of this technique. © Springer-Verlag Berlin Heidelberg 2005.