Relating transverse ray error and light fields in plenoptic camera images

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Plenoptic cameras have emerged in recent years as a technology for capturing light field data in a single snapshot. A conventional digital camera can be modified with the addition of a lenslet array to create a plenoptic camera. The camera image is focused onto the lenslet array. The lenslet array is placed over the camera sensor such that each lenslet forms an image of the exit pupil onto the sensor. The resultant image is an array of circular exit pupil images, each corresponding to the overlying lenslet. The position of the lenslet encodes the spatial information of the scene, whereas as the sensor pixels encode the angular information for light incident on the lenslet. The 4D light field is therefore described by the 2D spatial information and 2D angular information captured by the plenoptic camera. In aberration theory, the transverse ray error relates the pupil coordinates of a given ray to its deviation from the ideal image point in the image plane and is consequently a 4D function as well. We demonstrate a technique for modifying the traditional transverse ray error equations to recover the 4D light field of a general scene. In the case of a well corrected optical system, this light field is easily related to the depth of various objects in the scene. Finally, the effects of sampling with both the lenslet array and the camera sensor on the 4D light field data are analyzed to illustrate the limitations of such systems.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
Volume8842
DOIs
StatePublished - 2013
Externally publishedYes
Event16th Conference of Novel Optical Systems Design and Optimization - San Diego, CA, United States
Duration: Aug 26 2013Aug 28 2013

Other

Other16th Conference of Novel Optical Systems Design and Optimization
CountryUnited States
CitySan Diego, CA
Period8/26/138/28/13

Fingerprint

Half line
rays
Transverse
Camera
Cameras
cameras
pupils
Sensor
sensors
Sensors
Spatial Information
digital cameras
Digital Camera
Snapshot
Digital cameras
Aberrations
Aberration
Optical systems
Optical System
aberration

Keywords

  • Aberration theory
  • Light field
  • Plenoptic camera
  • Transverse ray error

ASJC Scopus subject areas

  • Applied Mathematics
  • Computer Science Applications
  • Electrical and Electronic Engineering
  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics

Cite this

Schwiegerling, J. T., & Tyo, J. S. (2013). Relating transverse ray error and light fields in plenoptic camera images. In Proceedings of SPIE - The International Society for Optical Engineering (Vol. 8842). [884203] https://doi.org/10.1117/12.2023080

Relating transverse ray error and light fields in plenoptic camera images. / Schwiegerling, James T; Tyo, J Scott.

Proceedings of SPIE - The International Society for Optical Engineering. Vol. 8842 2013. 884203.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Schwiegerling, JT & Tyo, JS 2013, Relating transverse ray error and light fields in plenoptic camera images. in Proceedings of SPIE - The International Society for Optical Engineering. vol. 8842, 884203, 16th Conference of Novel Optical Systems Design and Optimization, San Diego, CA, United States, 8/26/13. https://doi.org/10.1117/12.2023080
Schwiegerling JT, Tyo JS. Relating transverse ray error and light fields in plenoptic camera images. In Proceedings of SPIE - The International Society for Optical Engineering. Vol. 8842. 2013. 884203 https://doi.org/10.1117/12.2023080
Schwiegerling, James T ; Tyo, J Scott. / Relating transverse ray error and light fields in plenoptic camera images. Proceedings of SPIE - The International Society for Optical Engineering. Vol. 8842 2013.
@inproceedings{d52870302a4b4741b0fa89527d4ddb15,
title = "Relating transverse ray error and light fields in plenoptic camera images",
abstract = "Plenoptic cameras have emerged in recent years as a technology for capturing light field data in a single snapshot. A conventional digital camera can be modified with the addition of a lenslet array to create a plenoptic camera. The camera image is focused onto the lenslet array. The lenslet array is placed over the camera sensor such that each lenslet forms an image of the exit pupil onto the sensor. The resultant image is an array of circular exit pupil images, each corresponding to the overlying lenslet. The position of the lenslet encodes the spatial information of the scene, whereas as the sensor pixels encode the angular information for light incident on the lenslet. The 4D light field is therefore described by the 2D spatial information and 2D angular information captured by the plenoptic camera. In aberration theory, the transverse ray error relates the pupil coordinates of a given ray to its deviation from the ideal image point in the image plane and is consequently a 4D function as well. We demonstrate a technique for modifying the traditional transverse ray error equations to recover the 4D light field of a general scene. In the case of a well corrected optical system, this light field is easily related to the depth of various objects in the scene. Finally, the effects of sampling with both the lenslet array and the camera sensor on the 4D light field data are analyzed to illustrate the limitations of such systems.",
keywords = "Aberration theory, Light field, Plenoptic camera, Transverse ray error",
author = "Schwiegerling, {James T} and Tyo, {J Scott}",
year = "2013",
doi = "10.1117/12.2023080",
language = "English (US)",
isbn = "9780819496928",
volume = "8842",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",

}

TY - GEN

T1 - Relating transverse ray error and light fields in plenoptic camera images

AU - Schwiegerling, James T

AU - Tyo, J Scott

PY - 2013

Y1 - 2013

N2 - Plenoptic cameras have emerged in recent years as a technology for capturing light field data in a single snapshot. A conventional digital camera can be modified with the addition of a lenslet array to create a plenoptic camera. The camera image is focused onto the lenslet array. The lenslet array is placed over the camera sensor such that each lenslet forms an image of the exit pupil onto the sensor. The resultant image is an array of circular exit pupil images, each corresponding to the overlying lenslet. The position of the lenslet encodes the spatial information of the scene, whereas as the sensor pixels encode the angular information for light incident on the lenslet. The 4D light field is therefore described by the 2D spatial information and 2D angular information captured by the plenoptic camera. In aberration theory, the transverse ray error relates the pupil coordinates of a given ray to its deviation from the ideal image point in the image plane and is consequently a 4D function as well. We demonstrate a technique for modifying the traditional transverse ray error equations to recover the 4D light field of a general scene. In the case of a well corrected optical system, this light field is easily related to the depth of various objects in the scene. Finally, the effects of sampling with both the lenslet array and the camera sensor on the 4D light field data are analyzed to illustrate the limitations of such systems.

AB - Plenoptic cameras have emerged in recent years as a technology for capturing light field data in a single snapshot. A conventional digital camera can be modified with the addition of a lenslet array to create a plenoptic camera. The camera image is focused onto the lenslet array. The lenslet array is placed over the camera sensor such that each lenslet forms an image of the exit pupil onto the sensor. The resultant image is an array of circular exit pupil images, each corresponding to the overlying lenslet. The position of the lenslet encodes the spatial information of the scene, whereas as the sensor pixels encode the angular information for light incident on the lenslet. The 4D light field is therefore described by the 2D spatial information and 2D angular information captured by the plenoptic camera. In aberration theory, the transverse ray error relates the pupil coordinates of a given ray to its deviation from the ideal image point in the image plane and is consequently a 4D function as well. We demonstrate a technique for modifying the traditional transverse ray error equations to recover the 4D light field of a general scene. In the case of a well corrected optical system, this light field is easily related to the depth of various objects in the scene. Finally, the effects of sampling with both the lenslet array and the camera sensor on the 4D light field data are analyzed to illustrate the limitations of such systems.

KW - Aberration theory

KW - Light field

KW - Plenoptic camera

KW - Transverse ray error

UR - http://www.scopus.com/inward/record.url?scp=84886658580&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84886658580&partnerID=8YFLogxK

U2 - 10.1117/12.2023080

DO - 10.1117/12.2023080

M3 - Conference contribution

AN - SCOPUS:84886658580

SN - 9780819496928

VL - 8842

BT - Proceedings of SPIE - The International Society for Optical Engineering

ER -