A Robust Camera-Based Method for Optical Distortion Calibration of Head-Mounted Displays

Sangyoon Lee, Hong Hua

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

One of the problems in using HMDs is that the virtual images shown through the HMDs are usually warped due to their optical distortions. In order to correctly compensate the optical distortions through a predistortion technique, accurate values of the distortion parameters are required. Although several distortion calibration methods have been developed in prior work, these methods have some limitations. In this paper, we propose a method for accurately estimating the optical distortion parameters of both immersive and (optical) see-through HMDs, without the limitations. The proposed method is based on photogrammetry and considers not only the radial distortion but also the tangential distortion. Its effectiveness, including the effects of different coefficient orders of radial and tangential distortions, are evaluated through an experiment conducted with two different HMDs, an optical see-through head-mounted projection display (HMPD) and a commercially available immersive HMD. According to the experimental results, the proposed method showed significantly lower reprojection and line-fitting errors than a previous method proposed by Owen , and the radial distortion coefficients estimated by the proposed method were significantly more accurate than the nominal values obtained from the HMD optics prescription. In addition, when both the radial and tangential distortions were considered, the proposed method was significantly more effective than when only the radial distortion was considered. We also discuss an OpenCV-based simple implementation of a distortion correction method.

Original languageEnglish (US)
Article number6997996
Pages (from-to)845-853
Number of pages9
JournalIEEE/OSA Journal of Display Technology
Volume11
Issue number10
DOIs
StatePublished - Oct 1 2015

Fingerprint

Cameras
Display devices
cameras
Calibration
Helmet mounted displays
helmet mounted displays
photogrammetry
Photogrammetry
coefficients
Optics
estimating
projection
optics
approximation

Keywords

  • Geometric calibration
  • head-mounted display (HMD)
  • optical distortion
  • photogrammetry

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics

Cite this

A Robust Camera-Based Method for Optical Distortion Calibration of Head-Mounted Displays. / Lee, Sangyoon; Hua, Hong.

In: IEEE/OSA Journal of Display Technology, Vol. 11, No. 10, 6997996, 01.10.2015, p. 845-853.

Research output: Contribution to journalArticle

@article{1d8ed788d5f64b4785676e4535c2f639,
title = "A Robust Camera-Based Method for Optical Distortion Calibration of Head-Mounted Displays",
abstract = "One of the problems in using HMDs is that the virtual images shown through the HMDs are usually warped due to their optical distortions. In order to correctly compensate the optical distortions through a predistortion technique, accurate values of the distortion parameters are required. Although several distortion calibration methods have been developed in prior work, these methods have some limitations. In this paper, we propose a method for accurately estimating the optical distortion parameters of both immersive and (optical) see-through HMDs, without the limitations. The proposed method is based on photogrammetry and considers not only the radial distortion but also the tangential distortion. Its effectiveness, including the effects of different coefficient orders of radial and tangential distortions, are evaluated through an experiment conducted with two different HMDs, an optical see-through head-mounted projection display (HMPD) and a commercially available immersive HMD. According to the experimental results, the proposed method showed significantly lower reprojection and line-fitting errors than a previous method proposed by Owen , and the radial distortion coefficients estimated by the proposed method were significantly more accurate than the nominal values obtained from the HMD optics prescription. In addition, when both the radial and tangential distortions were considered, the proposed method was significantly more effective than when only the radial distortion was considered. We also discuss an OpenCV-based simple implementation of a distortion correction method.",
keywords = "Geometric calibration, head-mounted display (HMD), optical distortion, photogrammetry",
author = "Sangyoon Lee and Hong Hua",
year = "2015",
month = "10",
day = "1",
doi = "10.1109/JDT.2014.2386216",
language = "English (US)",
volume = "11",
pages = "845--853",
journal = "IEEE/OSA Journal of Display Technology",
issn = "1551-319X",
publisher = "IEEE Computer Society",
number = "10",

}

TY - JOUR

T1 - A Robust Camera-Based Method for Optical Distortion Calibration of Head-Mounted Displays

AU - Lee, Sangyoon

AU - Hua, Hong

PY - 2015/10/1

Y1 - 2015/10/1

N2 - One of the problems in using HMDs is that the virtual images shown through the HMDs are usually warped due to their optical distortions. In order to correctly compensate the optical distortions through a predistortion technique, accurate values of the distortion parameters are required. Although several distortion calibration methods have been developed in prior work, these methods have some limitations. In this paper, we propose a method for accurately estimating the optical distortion parameters of both immersive and (optical) see-through HMDs, without the limitations. The proposed method is based on photogrammetry and considers not only the radial distortion but also the tangential distortion. Its effectiveness, including the effects of different coefficient orders of radial and tangential distortions, are evaluated through an experiment conducted with two different HMDs, an optical see-through head-mounted projection display (HMPD) and a commercially available immersive HMD. According to the experimental results, the proposed method showed significantly lower reprojection and line-fitting errors than a previous method proposed by Owen , and the radial distortion coefficients estimated by the proposed method were significantly more accurate than the nominal values obtained from the HMD optics prescription. In addition, when both the radial and tangential distortions were considered, the proposed method was significantly more effective than when only the radial distortion was considered. We also discuss an OpenCV-based simple implementation of a distortion correction method.

AB - One of the problems in using HMDs is that the virtual images shown through the HMDs are usually warped due to their optical distortions. In order to correctly compensate the optical distortions through a predistortion technique, accurate values of the distortion parameters are required. Although several distortion calibration methods have been developed in prior work, these methods have some limitations. In this paper, we propose a method for accurately estimating the optical distortion parameters of both immersive and (optical) see-through HMDs, without the limitations. The proposed method is based on photogrammetry and considers not only the radial distortion but also the tangential distortion. Its effectiveness, including the effects of different coefficient orders of radial and tangential distortions, are evaluated through an experiment conducted with two different HMDs, an optical see-through head-mounted projection display (HMPD) and a commercially available immersive HMD. According to the experimental results, the proposed method showed significantly lower reprojection and line-fitting errors than a previous method proposed by Owen , and the radial distortion coefficients estimated by the proposed method were significantly more accurate than the nominal values obtained from the HMD optics prescription. In addition, when both the radial and tangential distortions were considered, the proposed method was significantly more effective than when only the radial distortion was considered. We also discuss an OpenCV-based simple implementation of a distortion correction method.

KW - Geometric calibration

KW - head-mounted display (HMD)

KW - optical distortion

KW - photogrammetry

UR - http://www.scopus.com/inward/record.url?scp=84944058933&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84944058933&partnerID=8YFLogxK

U2 - 10.1109/JDT.2014.2386216

DO - 10.1109/JDT.2014.2386216

M3 - Article

AN - SCOPUS:84944058933

VL - 11

SP - 845

EP - 853

JO - IEEE/OSA Journal of Display Technology

JF - IEEE/OSA Journal of Display Technology

SN - 1551-319X

IS - 10

M1 - 6997996

ER -