Eye Gaze Tracking with a Web Camera in a Desktop Environment

Yiu Ming CHEUNG*, Qinmu Peng

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

103 Citations (Scopus)


This paper addresses the eye gaze tracking problem using a low cost and more convenient web camera in a desktop environment, as opposed to gaze tracking techniques requiring specific hardware, e.g., infrared high-resolution camera and infrared light sources, as well as a cumbersome calibration process. In the proposed method, we first track the human face in a real-time video sequence to extract the eye regions. Then, we combine intensity energy and edge strength to obtain the iris center and utilize the piecewise eye corner detector to detect the eye corner. We adopt a sinusoidal head model to simulate the 3-D head shape, and propose an adaptive weighted facial features embedded in the pose from the orthography and scaling with iterations algorithm, whereby the head pose can be estimated. Finally, the eye gaze tracking is accomplished by integration of the eye vector and the head movement information. Experiments are performed to estimate the eye movement and head pose on the BioID dataset and pose dataset, respectively. In addition, experiments for gaze tracking are performed in real-time video sequences under a desktop environment. The proposed method is not sensitive to the light conditions. Experimental results show that our method achieves an average accuracy of around 1.28° without head movement and 2.27° with minor movement of the head.

Original languageEnglish
Article number7055334
Pages (from-to)419-430
Number of pages12
JournalIEEE Transactions on Human-Machine Systems
Issue number4
Publication statusPublished - 1 Aug 2015

Scopus Subject Areas

  • Human Factors and Ergonomics
  • Control and Systems Engineering
  • Signal Processing
  • Human-Computer Interaction
  • Computer Science Applications
  • Computer Networks and Communications
  • Artificial Intelligence

User-Defined Keywords

  • Desktop environment
  • gaze tracking
  • head pose
  • illumination change
  • web camera


Dive into the research topics of 'Eye Gaze Tracking with a Web Camera in a Desktop Environment'. Together they form a unique fingerprint.

Cite this