 |
| image by - National Aerospace Laboratory NLR |
FINAL YEAR PROJECT BASED ON COMPUTER INTERACTION METHODOLOGY
OVERVIEW:
As a field of engineering is growing enormously and form day by day advancement and innovations are made. The merging of two fields in one project is quite unique and surprising. During the previous decades it has been observed that the changing in using the mouse movement with the eye movement, hand movement has reemerged out largely. This increasing interest has been in many areas including the most important ones are electronics, medical engineering, software engineering and controls.
Today’s controlling of mouse is done by combination of hand and eye, head and eyes, or simple using the eye it is the combination of your cognitive ability that is capable of performing task in a medical department. Easy input is a head-controlled keyboard and mouse input device for disabled users.
The system user’s accelerometers to detect the user’s head tilt in order to direct mouse movement on the monitor. The clicking of the mouse is activated by the user’s eye blinking through a reflective sensor.
We constructed an interface system that would allow a similarly paralyzed user to interact with a computer with almost full functional capability, that is, the system operates as a mouse initially. But the user has the ability to toggle in and out. As detection of eye monitor proved too challenging, we built an accelerometer based tilt detector to determine head motion, so that, although not as applicable in the particular case, it might be use by a quadriplegic individual.
The tracking eye motion computer vision is based on human and computer interaction methodology, it is the mechanism by which computer mouse will be replaced with the movement of head and blinking of eyes to control cursor on the screen instead of using hands, this is a special purpose technology which would be used by the disabled people.
It is simple to use by our head movement which ultimately moves cursor on the screen and the cursor would be clicked by blinking of eyes, the movement of cursor on the screen is supported by the use of accelerometer sensor, the accelerometer is a small, thin, low power device that detects rotation (voltage) in 3 dimensions and identifies the tilt angle of human head; which is then sent to AVR microcontroller (A Tmega16/32) transmitter.
The data is then transmitted through wireless signals to the
receiver end that is connected to the system through serial port or USB cable
for interfacing the transmitter and receiver end that is module via the image of iris or eye is detected by camera that is
placed in front of our eye in which MATLAB programming is used, To differentiate
between the normal eye blink and blinking of eyes for cursor click, it is made
few milliseconds longer than normal eye blink. The eye tracking mouse is the advancement
in wireless technology which would be the milestone in electronic as we as
computer based technologies that is to be operated easily and accurately by
everyone without using their hands.
FUTURE RECOMMENDATIONS:
FUTURE ENHANCEMENT:
The helmet structure will be compact in size and easy to wear on head so that this mouse replacement can be more reliable and not very expensive for everyone to use it and it will be one of the innovative milestones in the electronic world.
The range of RF module can be increased and more to use it
in wide area and therefore the user will have the more reliable device to use
as it is already has a heavy structure of helmet, there we can also add
keyboard mode. When it is in mouse mode, the X and Y movement are directly
mapped to the movement of mouse, the more your head tilts, the faster the mouse
moves. When the user blinks, the mouse clicks. For this part to work, we want
to distinguish between the unintentional blink and international blink.
For the keyboard mode, you can select the character you want
to enter by tilting your head right or left. The English characters are
arranged by their frequency to speed up the selection. The scrolling of
characters is done by sending a backspace signal before sending the characters.
The characters are scrolling at a rate of 2.5 cps. When you reach the character
you want, you can blink to start a new character selection. When you tilt your
head up, you can change between lower case, upper case, number and punctuation.
When you tilt the head down, a backspace signal is sent to the computer. To switch
between the mouse and keyboard mode, you need to close your eyes for at least 4
seconds.
You can do in future control the entire thing with only eye moment eliminating the helmet structure. Control the thing by a photodiode array and by do image processing control the movement of the eye also ass well clicking of the mouse.
The head unit of our final design is taped to a cap with the photodiode mounted on a google. The whole design performed well and demonstrated all the functionalities: a comprehensive, user- friendly, practical computer input interface for people with disabilities.
Although entering text in the keyboard mode takes some time,
it does provide an attractive alternative for people who cannot use regular
keyboards. In general, the device makes it convenient to browse websites,
listen to music, watch videos and accomplish other common operations on the
computer.
|
| image by - National Aerospace Laboratory NLR |