Video-based eyetracking methods and algorithms in head-mounted displays

Hong Hua, Prasanna Krishnaswamy, Jannick P. Rolland

Research output: Contribution to journalArticle

39 Citations (Scopus)

Abstract

Head pose is utilized to approximate a user's line-of-sight for real-time image rendering and interaction in most of the 3D visualization applications using head-mounted displays (HMD). The eye often reaches an object of interest before the completion of most head movements. It is highly desirable to integrate eye-tracking capability into HMDs in various applications. While the added complexity of an eyetracked-HMD (ET-HMD) imposes challenges on designing a compact, portable, and robust system, the integration offers opportunities to improve eye tracking accuracy and robustness. In this paper, based on the modeling of an eye imaging and tracking system, we examine the challenges and identify parametric requirements for video-based pupil-glint tracking methods in an ET-HMD design, and predict how these parameters may affect the tracking accuracy, resolution, and robustness. We further present novel methods and associated algorithms that effectively improve eye-tracking accuracy and extend the tracking range.

Original languageEnglish (US)
Pages (from-to)4328-4350
Number of pages23
JournalOptics Express
Volume14
Issue number10
DOIs
StatePublished - 2006

Fingerprint

helmet mounted displays
head movement
glint
pupils
line of sight
requirements
interactions

ASJC Scopus subject areas

  • Atomic and Molecular Physics, and Optics

Cite this

Video-based eyetracking methods and algorithms in head-mounted displays. / Hua, Hong; Krishnaswamy, Prasanna; Rolland, Jannick P.

In: Optics Express, Vol. 14, No. 10, 2006, p. 4328-4350.

Research output: Contribution to journalArticle

Hua, Hong ; Krishnaswamy, Prasanna ; Rolland, Jannick P. / Video-based eyetracking methods and algorithms in head-mounted displays. In: Optics Express. 2006 ; Vol. 14, No. 10. pp. 4328-4350.
@article{4cc53f6c605342f29437904ee27708c4,
title = "Video-based eyetracking methods and algorithms in head-mounted displays",
abstract = "Head pose is utilized to approximate a user's line-of-sight for real-time image rendering and interaction in most of the 3D visualization applications using head-mounted displays (HMD). The eye often reaches an object of interest before the completion of most head movements. It is highly desirable to integrate eye-tracking capability into HMDs in various applications. While the added complexity of an eyetracked-HMD (ET-HMD) imposes challenges on designing a compact, portable, and robust system, the integration offers opportunities to improve eye tracking accuracy and robustness. In this paper, based on the modeling of an eye imaging and tracking system, we examine the challenges and identify parametric requirements for video-based pupil-glint tracking methods in an ET-HMD design, and predict how these parameters may affect the tracking accuracy, resolution, and robustness. We further present novel methods and associated algorithms that effectively improve eye-tracking accuracy and extend the tracking range.",
author = "Hong Hua and Prasanna Krishnaswamy and Rolland, {Jannick P.}",
year = "2006",
doi = "10.1364/OE.14.004328",
language = "English (US)",
volume = "14",
pages = "4328--4350",
journal = "Optics Express",
issn = "1094-4087",
publisher = "The Optical Society",
number = "10",

}

TY - JOUR

T1 - Video-based eyetracking methods and algorithms in head-mounted displays

AU - Hua, Hong

AU - Krishnaswamy, Prasanna

AU - Rolland, Jannick P.

PY - 2006

Y1 - 2006

N2 - Head pose is utilized to approximate a user's line-of-sight for real-time image rendering and interaction in most of the 3D visualization applications using head-mounted displays (HMD). The eye often reaches an object of interest before the completion of most head movements. It is highly desirable to integrate eye-tracking capability into HMDs in various applications. While the added complexity of an eyetracked-HMD (ET-HMD) imposes challenges on designing a compact, portable, and robust system, the integration offers opportunities to improve eye tracking accuracy and robustness. In this paper, based on the modeling of an eye imaging and tracking system, we examine the challenges and identify parametric requirements for video-based pupil-glint tracking methods in an ET-HMD design, and predict how these parameters may affect the tracking accuracy, resolution, and robustness. We further present novel methods and associated algorithms that effectively improve eye-tracking accuracy and extend the tracking range.

AB - Head pose is utilized to approximate a user's line-of-sight for real-time image rendering and interaction in most of the 3D visualization applications using head-mounted displays (HMD). The eye often reaches an object of interest before the completion of most head movements. It is highly desirable to integrate eye-tracking capability into HMDs in various applications. While the added complexity of an eyetracked-HMD (ET-HMD) imposes challenges on designing a compact, portable, and robust system, the integration offers opportunities to improve eye tracking accuracy and robustness. In this paper, based on the modeling of an eye imaging and tracking system, we examine the challenges and identify parametric requirements for video-based pupil-glint tracking methods in an ET-HMD design, and predict how these parameters may affect the tracking accuracy, resolution, and robustness. We further present novel methods and associated algorithms that effectively improve eye-tracking accuracy and extend the tracking range.

UR - http://www.scopus.com/inward/record.url?scp=33646550190&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33646550190&partnerID=8YFLogxK

U2 - 10.1364/OE.14.004328

DO - 10.1364/OE.14.004328

M3 - Article

C2 - 19516585

AN - SCOPUS:33646550190

VL - 14

SP - 4328

EP - 4350

JO - Optics Express

JF - Optics Express

SN - 1094-4087

IS - 10

ER -