“EyeMouse”: An interaction device
for severely motor-disabled people
Carlo Colombo, Massimiliano Corsini
Media Integration and Communication Center
University of Florence
EyeMouse
•
Human-machine
interaction system
replacing the mouse
with eye movements
•
Designed to exploit
the residual mobility of
severely motor-disabled
people (e.g. multiple
sclerosis)
Interaction
• User eye movements
are captured through
computer vision…
• …and then
transformed into
commands for the onscreen PC interface
CV
Interpreter
Interface
commands
Live camera
images
action
User
Screen
feedback
Eye capture
•
External eye and iris are captured by elastic
template matching (snakes)
Snake template
Iris (circle)
external eye
(ellipse)
Eye remapping
Image plane
•
The iris position
in the image is
remapped onto
the screen plane
•
The image-toscreen map is
calibrated at startup
Screen plane
Mouse functionalities
•
Navigation: eye movements
•
Selection: eye persistence, eye blinks
•
Interface feedback compensates for
slight remapping errors
“X” movement
“O” movement
Current work
• Accommodation
of head motion
• Automatic recovery
of tracking errors
for prolongated
interaction
Contacts
Prof. Carlo Colombo
Dipartimento Sistemi e Informatica
Via S. Marta 3 – Firenze
Centro di Eccellenza MIUR per la Comunicazione
e Integrazione dei Media
Sede RAI, Largo A. de Gasperi 1 - Firenze
www.dsi.unifi.it/users/colombo
[email protected]