An algebraic restoration method for estimating fixed-pattern noise in infrared imagery from a video sequence

Ünal Sakoǧlu, Russell C. Hardie, Majeed M. Hayat, Bradley M. Ratliff, J Scott Tyo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

15 Citations (Scopus)

Abstract

The inherent nonuniformity in the photoresponse and readout-circuitry of the individual detectors in infrared focal-plane-array imagers result in the notorious fixed-pattern noise (FPN). FPN generally degrades the performance of infrared imagers and it is particularly problematic in the midwavelength and longwavelength infrared regimes. In many applications, employing signal-processing techniques to combat FPN may be preferred over hard calibration (e.g., two-point calibration), as they are less expensive and, more importantly, do not require halting the operation of the camera. In this paper, a new technique that uses knowledge of global motion in a video sequence to restore the true scene in the presence of FPN is introduced. In the proposed setting, the entire video sequence is regarded as an output of a motion-dependent linear transformation, which acts collectively on the true scene and the unknown bias elements (which represent the FPN) in each detector. The true scene is then estimated from the video sequence according to a minimum mean-square-error criterion. Two modes of operation are considered. First, we consider non-radiometric restoration, in which case the true scene is estimated by performing a regularized minimization, since the problem is ill-posed. The other mode of operation is radiometric, in which case we assume that only the perimeter detectors have been calibrated. This latter mode does not require regularization and therefore avoids compromising the radiometric accuracy of the restored scene. The algorithm is demonstrated through preliminary results from simulated and real infrared imagery.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
EditorsA.G. Tescher
Pages69-79
Number of pages11
Volume5558
EditionPART 1
DOIs
StatePublished - 2004
Externally publishedYes
EventApplications of Digital Image Processing XXVII - Denver, CO, United States
Duration: Aug 2 2004Aug 6 2004

Other

OtherApplications of Digital Image Processing XXVII
CountryUnited States
CityDenver, CO
Period8/2/048/6/04

Fingerprint

infrared imagery
restoration
Restoration
estimating
Infrared radiation
Detectors
Image sensors
Calibration
detectors
Linear transformations
Focal plane arrays
linear transformations
combat
Mean square error
focal plane devices
Signal processing
nonuniformity
Cameras
readout
signal processing

Keywords

  • Fixed-pattern noise
  • Focal plane arrays
  • Infrared photodetectors
  • Nonuniformity correction

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Condensed Matter Physics

Cite this

Sakoǧlu, Ü., Hardie, R. C., Hayat, M. M., Ratliff, B. M., & Tyo, J. S. (2004). An algebraic restoration method for estimating fixed-pattern noise in infrared imagery from a video sequence. In A. G. Tescher (Ed.), Proceedings of SPIE - The International Society for Optical Engineering (PART 1 ed., Vol. 5558, pp. 69-79). [12] https://doi.org/10.1117/12.557902

An algebraic restoration method for estimating fixed-pattern noise in infrared imagery from a video sequence. / Sakoǧlu, Ünal; Hardie, Russell C.; Hayat, Majeed M.; Ratliff, Bradley M.; Tyo, J Scott.

Proceedings of SPIE - The International Society for Optical Engineering. ed. / A.G. Tescher. Vol. 5558 PART 1. ed. 2004. p. 69-79 12.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sakoǧlu, Ü, Hardie, RC, Hayat, MM, Ratliff, BM & Tyo, JS 2004, An algebraic restoration method for estimating fixed-pattern noise in infrared imagery from a video sequence. in AG Tescher (ed.), Proceedings of SPIE - The International Society for Optical Engineering. PART 1 edn, vol. 5558, 12, pp. 69-79, Applications of Digital Image Processing XXVII, Denver, CO, United States, 8/2/04. https://doi.org/10.1117/12.557902
Sakoǧlu Ü, Hardie RC, Hayat MM, Ratliff BM, Tyo JS. An algebraic restoration method for estimating fixed-pattern noise in infrared imagery from a video sequence. In Tescher AG, editor, Proceedings of SPIE - The International Society for Optical Engineering. PART 1 ed. Vol. 5558. 2004. p. 69-79. 12 https://doi.org/10.1117/12.557902
Sakoǧlu, Ünal ; Hardie, Russell C. ; Hayat, Majeed M. ; Ratliff, Bradley M. ; Tyo, J Scott. / An algebraic restoration method for estimating fixed-pattern noise in infrared imagery from a video sequence. Proceedings of SPIE - The International Society for Optical Engineering. editor / A.G. Tescher. Vol. 5558 PART 1. ed. 2004. pp. 69-79
@inproceedings{739ca9a295ee41cd8f5acbb18bf3abbe,
title = "An algebraic restoration method for estimating fixed-pattern noise in infrared imagery from a video sequence",
abstract = "The inherent nonuniformity in the photoresponse and readout-circuitry of the individual detectors in infrared focal-plane-array imagers result in the notorious fixed-pattern noise (FPN). FPN generally degrades the performance of infrared imagers and it is particularly problematic in the midwavelength and longwavelength infrared regimes. In many applications, employing signal-processing techniques to combat FPN may be preferred over hard calibration (e.g., two-point calibration), as they are less expensive and, more importantly, do not require halting the operation of the camera. In this paper, a new technique that uses knowledge of global motion in a video sequence to restore the true scene in the presence of FPN is introduced. In the proposed setting, the entire video sequence is regarded as an output of a motion-dependent linear transformation, which acts collectively on the true scene and the unknown bias elements (which represent the FPN) in each detector. The true scene is then estimated from the video sequence according to a minimum mean-square-error criterion. Two modes of operation are considered. First, we consider non-radiometric restoration, in which case the true scene is estimated by performing a regularized minimization, since the problem is ill-posed. The other mode of operation is radiometric, in which case we assume that only the perimeter detectors have been calibrated. This latter mode does not require regularization and therefore avoids compromising the radiometric accuracy of the restored scene. The algorithm is demonstrated through preliminary results from simulated and real infrared imagery.",
keywords = "Fixed-pattern noise, Focal plane arrays, Infrared photodetectors, Nonuniformity correction",
author = "{\"U}nal Sakoǧlu and Hardie, {Russell C.} and Hayat, {Majeed M.} and Ratliff, {Bradley M.} and Tyo, {J Scott}",
year = "2004",
doi = "10.1117/12.557902",
language = "English (US)",
volume = "5558",
pages = "69--79",
editor = "A.G. Tescher",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",
edition = "PART 1",

}

TY - GEN

T1 - An algebraic restoration method for estimating fixed-pattern noise in infrared imagery from a video sequence

AU - Sakoǧlu, Ünal

AU - Hardie, Russell C.

AU - Hayat, Majeed M.

AU - Ratliff, Bradley M.

AU - Tyo, J Scott

PY - 2004

Y1 - 2004

N2 - The inherent nonuniformity in the photoresponse and readout-circuitry of the individual detectors in infrared focal-plane-array imagers result in the notorious fixed-pattern noise (FPN). FPN generally degrades the performance of infrared imagers and it is particularly problematic in the midwavelength and longwavelength infrared regimes. In many applications, employing signal-processing techniques to combat FPN may be preferred over hard calibration (e.g., two-point calibration), as they are less expensive and, more importantly, do not require halting the operation of the camera. In this paper, a new technique that uses knowledge of global motion in a video sequence to restore the true scene in the presence of FPN is introduced. In the proposed setting, the entire video sequence is regarded as an output of a motion-dependent linear transformation, which acts collectively on the true scene and the unknown bias elements (which represent the FPN) in each detector. The true scene is then estimated from the video sequence according to a minimum mean-square-error criterion. Two modes of operation are considered. First, we consider non-radiometric restoration, in which case the true scene is estimated by performing a regularized minimization, since the problem is ill-posed. The other mode of operation is radiometric, in which case we assume that only the perimeter detectors have been calibrated. This latter mode does not require regularization and therefore avoids compromising the radiometric accuracy of the restored scene. The algorithm is demonstrated through preliminary results from simulated and real infrared imagery.

AB - The inherent nonuniformity in the photoresponse and readout-circuitry of the individual detectors in infrared focal-plane-array imagers result in the notorious fixed-pattern noise (FPN). FPN generally degrades the performance of infrared imagers and it is particularly problematic in the midwavelength and longwavelength infrared regimes. In many applications, employing signal-processing techniques to combat FPN may be preferred over hard calibration (e.g., two-point calibration), as they are less expensive and, more importantly, do not require halting the operation of the camera. In this paper, a new technique that uses knowledge of global motion in a video sequence to restore the true scene in the presence of FPN is introduced. In the proposed setting, the entire video sequence is regarded as an output of a motion-dependent linear transformation, which acts collectively on the true scene and the unknown bias elements (which represent the FPN) in each detector. The true scene is then estimated from the video sequence according to a minimum mean-square-error criterion. Two modes of operation are considered. First, we consider non-radiometric restoration, in which case the true scene is estimated by performing a regularized minimization, since the problem is ill-posed. The other mode of operation is radiometric, in which case we assume that only the perimeter detectors have been calibrated. This latter mode does not require regularization and therefore avoids compromising the radiometric accuracy of the restored scene. The algorithm is demonstrated through preliminary results from simulated and real infrared imagery.

KW - Fixed-pattern noise

KW - Focal plane arrays

KW - Infrared photodetectors

KW - Nonuniformity correction

UR - http://www.scopus.com/inward/record.url?scp=14944346735&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=14944346735&partnerID=8YFLogxK

U2 - 10.1117/12.557902

DO - 10.1117/12.557902

M3 - Conference contribution

VL - 5558

SP - 69

EP - 79

BT - Proceedings of SPIE - The International Society for Optical Engineering

A2 - Tescher, A.G.

ER -