Development of an eye-gaze controlled interface for surgical manipulators using eye-tracking glasses

Hiu Man Yip; David Navarro Alarcon; Yun Hui Liu

doi:10.1109/ROBIO.2016.7866606

Development of an eye-gaze controlled interface for surgical manipulators using eye-tracking glasses

Hiu Man Yip, David Navarro Alarcon, Yun Hui Liu

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

18 Citations (Scopus)

Abstract

Introducing robots into the operating theatre has become more popular in recent decades. Surgical manipulators have been developed to assist in surgeries like a human assistant to facilitate the surgical procedures. In this paper, we present an eye-controlled interface for the surgeon to control this kind of robot based on eye-tracking glasses. In our approach, we use the monitor for providing the endoscopic/laparoscopic feedback as the landmark for controlling the robot. The surgeon is allowed to control the robot by looking at different features of the monitor. We present the algorithm for extracting the monitor from the user's view and the method on how to differentiate the control commands with the detected monitor and the user's gaze-point. Experiments were conducted to verify the feasibility of our eye-controlled interface.

Original language	English
Title of host publication	2016 IEEE International Conference on Robotics and Biomimetics, ROBIO 2016
Publisher	IEEE
Pages	1900-1905
Number of pages	6
ISBN (Electronic)	9781509043644
DOIs	https://doi.org/10.1109/ROBIO.2016.7866606
Publication status	Published - 1 Jan 2016
Externally published	Yes
Event	2016 IEEE International Conference on Robotics and Biomimetics, ROBIO 2016 - Qingdao, China Duration: 3 Dec 2016 → 7 Dec 2016

Conference

Conference	2016 IEEE International Conference on Robotics and Biomimetics, ROBIO 2016
Country/Territory	China
City	Qingdao
Period	3/12/16 → 7/12/16

ASJC Scopus subject areas

Hardware and Architecture
Artificial Intelligence
Control and Systems Engineering

More information

10.1109/ROBIO.2016.7866606

Cite this

@inproceedings{3a741f367d3045eca25e3c70f8efe660,

title = "Development of an eye-gaze controlled interface for surgical manipulators using eye-tracking glasses",

abstract = "Introducing robots into the operating theatre has become more popular in recent decades. Surgical manipulators have been developed to assist in surgeries like a human assistant to facilitate the surgical procedures. In this paper, we present an eye-controlled interface for the surgeon to control this kind of robot based on eye-tracking glasses. In our approach, we use the monitor for providing the endoscopic/laparoscopic feedback as the landmark for controlling the robot. The surgeon is allowed to control the robot by looking at different features of the monitor. We present the algorithm for extracting the monitor from the user's view and the method on how to differentiate the control commands with the detected monitor and the user's gaze-point. Experiments were conducted to verify the feasibility of our eye-controlled interface.",

author = "Yip, {Hiu Man} and {Navarro Alarcon}, David and Liu, {Yun Hui}",

year = "2016",

month = jan,

day = "1",

doi = "10.1109/ROBIO.2016.7866606",

language = "English",

pages = "1900--1905",

booktitle = "2016 IEEE International Conference on Robotics and Biomimetics, ROBIO 2016",

publisher = "IEEE",

address = "United States",

note = "2016 IEEE International Conference on Robotics and Biomimetics, ROBIO 2016 ; Conference date: 03-12-2016 Through 07-12-2016",

}

Yip, HM, Navarro Alarcon, D & Liu, YH 2016, Development of an eye-gaze controlled interface for surgical manipulators using eye-tracking glasses. in 2016 IEEE International Conference on Robotics and Biomimetics, ROBIO 2016., 7866606, IEEE, pp. 1900-1905, 2016 IEEE International Conference on Robotics and Biomimetics, ROBIO 2016, Qingdao, China, 3/12/16. https://doi.org/10.1109/ROBIO.2016.7866606

Development of an eye-gaze controlled interface for surgical manipulators using eye-tracking glasses. / Yip, Hiu Man; Navarro Alarcon, David; Liu, Yun Hui.
2016 IEEE International Conference on Robotics and Biomimetics, ROBIO 2016. IEEE, 2016. p. 1900-1905 7866606.

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

TY - GEN

T1 - Development of an eye-gaze controlled interface for surgical manipulators using eye-tracking glasses

AU - Yip, Hiu Man

AU - Navarro Alarcon, David

AU - Liu, Yun Hui

PY - 2016/1/1

Y1 - 2016/1/1

N2 - Introducing robots into the operating theatre has become more popular in recent decades. Surgical manipulators have been developed to assist in surgeries like a human assistant to facilitate the surgical procedures. In this paper, we present an eye-controlled interface for the surgeon to control this kind of robot based on eye-tracking glasses. In our approach, we use the monitor for providing the endoscopic/laparoscopic feedback as the landmark for controlling the robot. The surgeon is allowed to control the robot by looking at different features of the monitor. We present the algorithm for extracting the monitor from the user's view and the method on how to differentiate the control commands with the detected monitor and the user's gaze-point. Experiments were conducted to verify the feasibility of our eye-controlled interface.

AB - Introducing robots into the operating theatre has become more popular in recent decades. Surgical manipulators have been developed to assist in surgeries like a human assistant to facilitate the surgical procedures. In this paper, we present an eye-controlled interface for the surgeon to control this kind of robot based on eye-tracking glasses. In our approach, we use the monitor for providing the endoscopic/laparoscopic feedback as the landmark for controlling the robot. The surgeon is allowed to control the robot by looking at different features of the monitor. We present the algorithm for extracting the monitor from the user's view and the method on how to differentiate the control commands with the detected monitor and the user's gaze-point. Experiments were conducted to verify the feasibility of our eye-controlled interface.

UR - http://www.scopus.com/inward/record.url?scp=85016733810&partnerID=8YFLogxK

U2 - 10.1109/ROBIO.2016.7866606

DO - 10.1109/ROBIO.2016.7866606

M3 - Conference article published in proceeding or book

SP - 1900

EP - 1905

BT - 2016 IEEE International Conference on Robotics and Biomimetics, ROBIO 2016

PB - IEEE

T2 - 2016 IEEE International Conference on Robotics and Biomimetics, ROBIO 2016

Y2 - 3 December 2016 through 7 December 2016

ER -

Development of an eye-gaze controlled interface for surgical manipulators using eye-tracking glasses

Abstract

Conference

ASJC Scopus subject areas

More information

Other files and links

Fingerprint

Cite this