From this series of posts I'm going to mention the project background. The techniques and tools that can be used for air-finger-writing process. This post includes the vision sensor devices that can be used for the implementation.
Vision Sensor Devices
Human computer interaction (HCI) can go far beyond typing on the keyboard, moving the mouse, and touching the screen. Recent advances in computer vision technologies can recognize hand gestures and finger movement tracking. Optical tracking is the most competitive among all tracking technologies for use in motion-based user interfaces. For example vision-based optical tracking uses computer vision techniques to recognize the tracking target from the scene, which can be the user’s head, hand, or body. The most successful vision-based optical tracking system, Microsoft Kinect sensor is more popular among the development community. Combining a simple RGB camera and a depth camera, Kinect is able to track human body in 3D. But it is an expensive approach because its main focus is on full body motion[6].
As our requirement is just the tracking of finger movements, ‘Leap Motion Controller’ device is the ideal less expensive solution. It is a small USB peripheral device which is specifically designed to track hand, fingers or stick-like objects such as a pen or chopstick precisely in a desktop environment. The 3D positions of the fingers are precisely captured by this computer vision device at over 100 frames per second (fps) using USB 2.0 port or about 150 fps using a USB 3.0 port. Therefore, it is possible to track the detailed positions of each finger precisely and efficiently. Compared to the Kinect, it is too smaller in size (just 3" long), light weight, not take much space on desk and can carry wherever very easily. Therefore portability is ensured.
 |
| Leap Motion Controller |
To work with Leap Motion sensor device, it needs to plug into a computer via USB and does not need any special adapters. It does not replace the keyboard, mouse or any other input device, so can work with both gesture inputs and other kind of inputs parallel. Leap Motion sensor can send information about hands, fingers and even real cylindrical pencils it sees in its field of view. It then determines the location of fingers within the field of view, the existence and position of any “tool”, such as cylindrical non-transparent pen or pencil [7].
The Leap Motion Controller tracks all 10 fingers up to 1/100th of a millimeter. It is dramatically more sensitive than other motion control technologies. That is a strong benefit for gesture based writing.
References
|
[6]
|
(2015, July)
Microsoft Kinect for Windows. [Online]. https://www.microsoft.com/en-us/kinectforwindows/develop/default.aspx
|
|
[7]
|
(2015, July) Leap
Motion Developer Portal. [Online]. https://developer.leapmotion.com/documentation/java/index.html
|
No comments:
Post a Comment