Device is ready, Proposal is ready and here we goes with the Journal Day 1.
The Problem
Most of the educationists all over the world suggest that, for a kindergartener, the first tool that should be used to teach writing, more specifically the letters in the alphabet, must not be a pencil, pen, marker or a crayon. What they recommend is child should use their fingers first. And that’s why in Sri Lankan culture they had this tool called “valipilla” (වැලිපිල්ල) to teach how to write. It’s an ideal multi sensory approach to teach the alphabet because the muscle movement help children to process what they are writing and make it more likely to stick in their mind. But in this way there need to be always an instructor behind the child to provide the guidance how to write.
The recent technologies in vision based sensors are competent enough to capture the finger positions and movements. So if a computer system could track this finger movement trajectory precisely, we can use this trajectory input, to recognize as an alphabetical character in real time when someone writes with a finger. So with this approach we could easily replace the physical instructor and provide a finger gesture based virtual platform for the child, to improve his writing ability all by his own. In other means it will add a higher value to the child education system by having an automated application to check whether the child has written the letters in the alphabet in correct way and by that provide the guidance to write it correctly.
Objective of Project
The main objective of this project is to research on a way to implement an accurate virtual platform to practice in writing English alphabetical letters using finger gesture and provide a developed tool as the concept of proof. Also it is expected that this proposed tool would be a supportive platform in the child education system to improve their writing ability.
Related Projects
There are lot of approaches to recognize handwritten characters. The challenging part of this is combining those approaches to recognize something written in the air with finger gesture, and also capturing those finger gesture trajectories by accurately identifying the start and end of the letter stroke. Still the related works carried out in the research space are lacking of its accuracy, and the performance depends on the used recognition technique and letter strokes capturing mechanism. Following are some of the related research projects which have used different recognition techniques and capturing mechanisms. But the focus of these projects was to build up an air handwriting recognition tool, and not to make it as a supportive tool for improve children’s writing ability.
- Vikram S., Lei L., Russel S., - Handwriting and gesture in the air, recognition on the fly, - University of California, Berkeley, 2013 [https://www.cs.berkeley.edu/~russell/papers/chi13-3Dhandwriting.pdf]
- Mingyu Chen, - Universal motion-based control and motion recognition: Air handwriting recognition(pp 62-108), - Georgia Institute of Technology, 2013 [https://smartech.gatech.edu/bitstream/handle/1853/50281/CHEN-DISSERTATION-2013.pdf]
The
development scope of the project is bound to the following areas mainly targeting
on implementing an interactive finger gesture based learn to write tool for English
alphabet.
Develop a process to efficiently capture the index finger gesture movements and correctly identify gesture pauses in letter strokes. It is expected to use the Leap Motion Controller device with its API as the main sensor device to capture the finger gesture.
Recognition:
Develop a process to match the finger gesture input trajectory data with the expected trajectory in real time. It is expected to find a suitable character recognition technique from the literature survey.
Writing:
Make an interactive user interface with a drawing area to interact using index finger gesture.
Display Results:
Provide feedback to the child, whether he has written the character correctly or not.
No comments:
Post a Comment