EYEBALL mouse functionalities. Camera scans the Eye ball

EYEBALL MOVEMENT BASED CURSOR AND
KEYBOARD CONTROL

 

 

 

A.Bharathi

We Will Write a Custom Essay Specifically
For You For Only $13.90/page!


order now

Student, Department of Information Technology

Sri Sairam Engineering College

West Tambaram,Chennai-44

[email protected]

A.Priyanka

Student, Department of Information Technology

Sri Sairam Engineering College

West Tambaram,Chennai-44

[email protected]

 

 

 

K.Suvathy

Student, Department of Information Technology

Sri Sairam Engineering College

West Tambaram,Chennai-44

[email protected]

 

T.P.Rani

Associate Professor, Department of Information Technology
,Sri Sairam Engineering College

West Tambaram,Chennai-44

[email protected]

Abstract

 

An Individual
Human Computer Interface system using eye movement is  introduced. Traditionally, human computer interface uses mouse or keyboard
as  an 
input  device. The proposed system
presents hands free interface between computer and user .The main objective is
to control the Mouse & Keypad using Eye ball. It also verify the user’s
authentication using Face Recognition. For Face recognition, Violo Jones
Algorithm is used. Camera is connected with the system & mat lab is used
for User Authentication. After successful authentication, camera is continued
to scan User’s Eye ball movement. During this state of action, Our Physical
Keypad & Mouse are freezed in order to stop user’s Key inputs. On-screen
Keyboard & Mouse control is initiated so as to control those through Eye
Ball movements. Mat lab software plays a vital role in controlling the on-screen
Keyboard & Mouse. We will be using Java for freezing the physical keypad
& mouse functionalities. Camera scans the Eye ball of the authenticated
user and control of the mouse is achieved through the Eye ball movement.
Alphabets are selected by Eye ball clicking for effective communication. The
Physical keyboard control is released by Control, Alt & Delete keys.  Mat lab is used for Face recognition &
Eye ball control. On-screen Keyboard & Mouse are initiated & freezing
of Physical Mouse & Keypad is achieved by Java software.

 

Keywords—On-screen keyboard, Face recognition and Eye detection,
Web Camera, MAT lab, Computer, Viola Jones Algorithm,

 

 

1.      Introduction

 

In today’s world
technology gets upgraded to the newest level, majority computers rely on mouse
and keyboard as the major input devices which could not be used by handicapped
people. The proposed system describes a new method for the handicapped people
to communicate using computers with the help of eyes only. Most of the devices
such as computers and laptop prefer touch screen technology, but still the
preferred technology is not cheap enough to be used on desktop systems. The
main aim is to develop an interactive virtual human computer interface.

In our system,
we prefer the usage of Matlab to detect the web camera which is used for taking
images continuously to focus the eye pupil. With the help of various image processing
techniques, face recognition and eye tracking are done. For Face recognition,
Violo Jones Algorithm is used.

 

2.     
Existing
System

 

Now a days, people use computer by their
hands and  touch pad. Traditionally,
human computer  interface uses mouse
and  keyboard as an input device. An  idea to control computer  mouse cursor movement with human eyes is
introduced1. Blink actions are introduced  to replace the mouse clicks2. Generally for
opening a file, one must click on the file by using physical mouse or touch
pad. Instead a new system is introduced to replace the physical mouse. One can
open a file using the eye movement and blink actions. Both  the left and right click is done by blinking
the left eye and right eye.

 

 

 

 

 

 

3.     
Proposed
System

 

The main
objective is to control the Mouse & Keyboard using Eye ball for handicapped
people. On-screen keyboard is displayed on the desktop to replace the physical
keyboard. Camera is mounted on the top of the desktop and the user  image infront of  the computer is captured. The image is
compared and verified with the database  for
user’s authentication.    After    successful 
authentication,

On-screen
keyboard is displayed on the desktop automatically. Once the On-screen keyboard
is displayed, the physical keyboard and mouse is freezed. The Physical keyboard
and mouse freeze is released by pressing Control, Alt & Delete keys. Camera
is continued to scan for face recognition using Violo Jones Algorithm. Then the
eye is detected successfully to control the mouse and on-screen keyboard. Based
on the blink action, the letter is typed and displayed for
effective communication.

 

Human
eye structure

 

A human eye is
an organ that senses light. An image of eye anatomy is shown in Figure. Several
important parts of human eye related to eye tracking are described here. The
cornea is a transparent coat in front of eyeball. The iris is the muscle that
controls the size of pupil, which is like the aperture in a camera to let light
goes inside. The iris has color and is different from person to person, thus
can be used in biometrics. The sclera is the tough outer surface of the eyeball
and appears white in the eye image. The limbus is the boundary between the
sclera and the iris. An image of eye captured by digital camera is shown in
Figure below.

 

 

 

 

 

 

 

 

 

4.     
Block
Diagram

 

 

 

5.     
Working

 

The
user has to sits in front of the screen of personal computer or laptop, a
specialized video camera mounted above the screen to observe the user’s eyes.
The computer continually analyzes the video image of the eye and determines
where the user is looking on the screen. Nothing is attached to the user’s head
or body. To “select” any key, the user looks at the key for a specified period
of time and to “press” any key, the user just blink the eye. In this system,
calibration procedure is not required. For this system input is only eye. No
external hardware is attached or required.                       

6.     
On-screen
keyboard display

 

 

 

 

7.     
Proposed Algorithm

 

The detailed processing steps
is presented below:

 

1.      
Logitech C170 camera is fixed on the top of the
desktop.

2.      
The camera takes the image of the user who sits
infront of the computer.

3.      
The image is compared and verified with the
database for user’s authentication.

4.      
After successful user’s authentication,
on-screen keyboard is displayed automatically on the desktop.

5.      
Once on-screen keyboard is displayed, the
physical keyboard and mouse are freezed by using java code.

6.      
Freezing can be released by pressing control,
alt and delete keys on same time.

7.      
Once on-screen keyboard is displayed, Camera
starts scanning the user eye by taking video.

8.      
After receiving these streaming videos from the
camera, it then breaks into frames.

9.       After receiving frames, it will check for lighting
conditions because cameras require sufficient lights from external sources
otherwise error message will display on the screen.

10.    The captured frames that are already in RGB mode are
converted into Black ‘n’ White inorder find the edge movement.

11.    Images (frames) from the input source focusing the eye
are analyzed for Iris detection (center of eye) using Violo Jones Algorithm.

12.    After that, a mid point is calculated by taking the
mean of left and right eye centre point.

13.    Finally the mouse will move from one position to
another on the screen and user will perform clicking by blinking their eyes.

14.   
Based on the blink action, the letter
is typed and displayed for effective communication.

 

 

References:

 

1Shrunkhala Satish Wankhede,
Mrs.S.A.Chhabria,Dr.R.V.Dharaska ” Controlling Mouse Cursor Using Eye
Movement”, Special Issue for National Conference On Recent Advances in
Technology and Management for Integrated Growth 2013 (RATMIG 2013)

 

2Bacivarov, Ionita M., Corcoran,P. ,
“Statistical models of appearance for eye tracking and eye-blink detection and
measurement”, IEEE Transactions, August 2010

 

 

3Akhil
Gupta, Akash Rathi, Dr. Y. Radhika, “HANDS- FREE PC CONTROL” CONTROLLING OF
MOUSE CURSOR USING EYE MOVEMENT, International Journal of Scientific and
Research Publications, Volume 2, Issue 4, April 2012

 

4 Jixu Chen, Yan Tong ,Wayne
Grayy ,Qiang Jiz “A Robust 3D Eye Gaze Tracking System”,IEEE ,2011