Air Mouse

Contactless control of your PC


Introduction

With broad experience acquired in the disciplinary fields of Man-Machine Interaction, the LSI teams’ research is currently working on a promising technology involving a contactless interaction system controlled by forefinger movement. Air Mouse involves the use of a finger placed over the keyboard to interact with an application in bi or tri-dimensional space. Its numerous qualities make it easily adaptable to many different applications.


Benefits

  • Compact: Air Mouse does not need a surface for interaction. It works with simple finger movements.

  • 2D/3D Interaction: The Air Mouse device permits interactions in two or three dimensions without having to change the position of the arm. In fact, the device is sensitive to the type of interaction.

  • Ergonomics: Based on a natural interaction method of checking and manipulation, the concept is easy for users to pick up.

  • Cost: The cost of the device is potentially very low compared to other existing interaction devices, particularly for 3D interactions.

  • Performance: Air Mouse’s current performance makes it a comparable device to existing 2D  devices and perform very well for 3D interactions. Air Mouse also has the advantage of needing less concentration for 3D manipulation than specialised devices.


Service Offering

  • R&D Collaboration
  • Knowledge transfer


Technology

Using 2 cameras, including infra-red camera, placed above the laptop screen, the Air Mouse technology involves the use of a finger placed over the keyboard to interact with an application in bi or tri-dimensional space. The finger is simply equipped with an infra-red reflector, making it possible to determine the orientation and position of the finger. With the aid of two vision reconstruction algorithms, Air Mouse is able to keep up with the position of the reflectors in the 3D interaction area. The processing of captured points is optimised to ensure an intuitive and natural interaction.


Protoype Air Mouse

  • 2D Use: The forefinger is commonly used for designing objects. For 2D use, the forefinger is used to define a virtual range that hits the object designed on the screen. In the set-up shown here, 2 ring reflectors have been positioned respectively on the first and second phalanx of the forefinger, and the two points saved in 3D space define the virtual range. This way, when the user moves their forefinger and points at an object on the screen, the cursor moves onscreen according to the position designated by the virtual range.

  • 3D Use: In the case of 3D use, a single reflector on the fingertip is used. The 3D cursor moves according to the position of the reflector in the 3D space. In order to preserve a direct relationship between the position of the reflector and the 3D checking area, absolutely no rotation has been introduced between the interaction area and the display area. After calibration, the cursor movements directly follow those of the forefinger to the right, to the left, up, down, and inwards. An optimal scale factor is calculated to reduce movement and therefore fatigue for the user, to reduce the strain induced by precise pointing.


Areas of Application

  • 3D Computer Graphics
  • Laptops
  • Computer-Assisted Design
  • Workstation Comfort


Contact Us