Augmented microscopy with near-infrared fluorescence detection

Jeffrey R. Watson, Nikolay Martirosyan, Jesse Skoch, Gerald M Lemole, Rein Anton, Marek Romanowski

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Near-infrared (NIR) fluorescence has become a frequently used intraoperative technique for image-guided surgical interventions. In procedures such as cerebral angiography, surgeons use the optical surgical microscope for the color view of the surgical field, and then switch to an electronic display for the NIR fluorescence images. However, the lack of stereoscopic, real-time, and on-site coregistration adds time and uncertainty to image-guided surgical procedures. To address these limitations, we developed the augmented microscope, whereby the electronically processed NIR fluorescence image is overlaid with the anatomical optical image in real-time within the optical path of the microscope. In vitro, the augmented microscope can detect and display indocyanine green (ICG) concentrations down to 94.5 nM, overlaid with the anatomical color image. We prepared polyacrylamide tissue phantoms with embedded polystyrene beads, yielding scattering properties similar to brain matter. In this model, 194 μM solution of ICG was detectable up to depths of 5 mm. ICG angiography was then performed in anesthetized rats. A dynamic process of ICG distribution in the vascular system overlaid with anatomical color images was observed and recorded. In summary, the augmented microscope demonstrates NIR fluorescence detection with superior real-time coregistration displayed within the ocular of the stereomicroscope. In comparison to other techniques, the augmented microscope retains full stereoscopic vision and optical controls including magnification and focus, camera capture, and multiuser access. Augmented microscopy may find application in surgeries where the use of traditional microscopes can be enhanced by contrast agents and image guided delivery of therapeutics, including oncology, neurosurgery, and ophthalmology.

Original languageEnglish (US)
Title of host publicationProgress in Biomedical Optics and Imaging - Proceedings of SPIE
PublisherSPIE
Volume9311
ISBN (Print)9781628414011
DOIs
StatePublished - 2015
EventMolecular-Guided Surgery: Molecules, Devices, and Applications - San Francisco, United States
Duration: Feb 7 2015Feb 8 2015

Other

OtherMolecular-Guided Surgery: Molecules, Devices, and Applications
CountryUnited States
CitySan Francisco
Period2/7/152/8/15

Fingerprint

Indocyanine Green
Microscopy
Microscopic examination
Microscopes
Fluorescence
microscopy
Infrared radiation
microscopes
fluorescence
Color
Angiography
Depth Perception
Cerebral Angiography
angiography
Polystyrenes
Neurosurgery
Ophthalmology
color
Contrast Media
Uncertainty

Keywords

  • Augmented reality
  • Image guided surgery
  • Indocyanine green
  • Near-infrared fluorescence
  • Real 3D stereoscopic vision
  • Real-time coregistration
  • Videoangiography

ASJC Scopus subject areas

  • Atomic and Molecular Physics, and Optics
  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Radiology Nuclear Medicine and imaging

Cite this

Watson, J. R., Martirosyan, N., Skoch, J., Lemole, G. M., Anton, R., & Romanowski, M. (2015). Augmented microscopy with near-infrared fluorescence detection. In Progress in Biomedical Optics and Imaging - Proceedings of SPIE (Vol. 9311). [93110I] SPIE. https://doi.org/10.1117/12.2077008

Augmented microscopy with near-infrared fluorescence detection. / Watson, Jeffrey R.; Martirosyan, Nikolay; Skoch, Jesse; Lemole, Gerald M; Anton, Rein; Romanowski, Marek.

Progress in Biomedical Optics and Imaging - Proceedings of SPIE. Vol. 9311 SPIE, 2015. 93110I.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Watson, JR, Martirosyan, N, Skoch, J, Lemole, GM, Anton, R & Romanowski, M 2015, Augmented microscopy with near-infrared fluorescence detection. in Progress in Biomedical Optics and Imaging - Proceedings of SPIE. vol. 9311, 93110I, SPIE, Molecular-Guided Surgery: Molecules, Devices, and Applications, San Francisco, United States, 2/7/15. https://doi.org/10.1117/12.2077008
Watson JR, Martirosyan N, Skoch J, Lemole GM, Anton R, Romanowski M. Augmented microscopy with near-infrared fluorescence detection. In Progress in Biomedical Optics and Imaging - Proceedings of SPIE. Vol. 9311. SPIE. 2015. 93110I https://doi.org/10.1117/12.2077008
Watson, Jeffrey R. ; Martirosyan, Nikolay ; Skoch, Jesse ; Lemole, Gerald M ; Anton, Rein ; Romanowski, Marek. / Augmented microscopy with near-infrared fluorescence detection. Progress in Biomedical Optics and Imaging - Proceedings of SPIE. Vol. 9311 SPIE, 2015.
@inproceedings{376689ecc38c4cf79a434c75c5b33b7a,
title = "Augmented microscopy with near-infrared fluorescence detection",
abstract = "Near-infrared (NIR) fluorescence has become a frequently used intraoperative technique for image-guided surgical interventions. In procedures such as cerebral angiography, surgeons use the optical surgical microscope for the color view of the surgical field, and then switch to an electronic display for the NIR fluorescence images. However, the lack of stereoscopic, real-time, and on-site coregistration adds time and uncertainty to image-guided surgical procedures. To address these limitations, we developed the augmented microscope, whereby the electronically processed NIR fluorescence image is overlaid with the anatomical optical image in real-time within the optical path of the microscope. In vitro, the augmented microscope can detect and display indocyanine green (ICG) concentrations down to 94.5 nM, overlaid with the anatomical color image. We prepared polyacrylamide tissue phantoms with embedded polystyrene beads, yielding scattering properties similar to brain matter. In this model, 194 μM solution of ICG was detectable up to depths of 5 mm. ICG angiography was then performed in anesthetized rats. A dynamic process of ICG distribution in the vascular system overlaid with anatomical color images was observed and recorded. In summary, the augmented microscope demonstrates NIR fluorescence detection with superior real-time coregistration displayed within the ocular of the stereomicroscope. In comparison to other techniques, the augmented microscope retains full stereoscopic vision and optical controls including magnification and focus, camera capture, and multiuser access. Augmented microscopy may find application in surgeries where the use of traditional microscopes can be enhanced by contrast agents and image guided delivery of therapeutics, including oncology, neurosurgery, and ophthalmology.",
keywords = "Augmented reality, Image guided surgery, Indocyanine green, Near-infrared fluorescence, Real 3D stereoscopic vision, Real-time coregistration, Videoangiography",
author = "Watson, {Jeffrey R.} and Nikolay Martirosyan and Jesse Skoch and Lemole, {Gerald M} and Rein Anton and Marek Romanowski",
year = "2015",
doi = "10.1117/12.2077008",
language = "English (US)",
isbn = "9781628414011",
volume = "9311",
booktitle = "Progress in Biomedical Optics and Imaging - Proceedings of SPIE",
publisher = "SPIE",

}

TY - GEN

T1 - Augmented microscopy with near-infrared fluorescence detection

AU - Watson, Jeffrey R.

AU - Martirosyan, Nikolay

AU - Skoch, Jesse

AU - Lemole, Gerald M

AU - Anton, Rein

AU - Romanowski, Marek

PY - 2015

Y1 - 2015

N2 - Near-infrared (NIR) fluorescence has become a frequently used intraoperative technique for image-guided surgical interventions. In procedures such as cerebral angiography, surgeons use the optical surgical microscope for the color view of the surgical field, and then switch to an electronic display for the NIR fluorescence images. However, the lack of stereoscopic, real-time, and on-site coregistration adds time and uncertainty to image-guided surgical procedures. To address these limitations, we developed the augmented microscope, whereby the electronically processed NIR fluorescence image is overlaid with the anatomical optical image in real-time within the optical path of the microscope. In vitro, the augmented microscope can detect and display indocyanine green (ICG) concentrations down to 94.5 nM, overlaid with the anatomical color image. We prepared polyacrylamide tissue phantoms with embedded polystyrene beads, yielding scattering properties similar to brain matter. In this model, 194 μM solution of ICG was detectable up to depths of 5 mm. ICG angiography was then performed in anesthetized rats. A dynamic process of ICG distribution in the vascular system overlaid with anatomical color images was observed and recorded. In summary, the augmented microscope demonstrates NIR fluorescence detection with superior real-time coregistration displayed within the ocular of the stereomicroscope. In comparison to other techniques, the augmented microscope retains full stereoscopic vision and optical controls including magnification and focus, camera capture, and multiuser access. Augmented microscopy may find application in surgeries where the use of traditional microscopes can be enhanced by contrast agents and image guided delivery of therapeutics, including oncology, neurosurgery, and ophthalmology.

AB - Near-infrared (NIR) fluorescence has become a frequently used intraoperative technique for image-guided surgical interventions. In procedures such as cerebral angiography, surgeons use the optical surgical microscope for the color view of the surgical field, and then switch to an electronic display for the NIR fluorescence images. However, the lack of stereoscopic, real-time, and on-site coregistration adds time and uncertainty to image-guided surgical procedures. To address these limitations, we developed the augmented microscope, whereby the electronically processed NIR fluorescence image is overlaid with the anatomical optical image in real-time within the optical path of the microscope. In vitro, the augmented microscope can detect and display indocyanine green (ICG) concentrations down to 94.5 nM, overlaid with the anatomical color image. We prepared polyacrylamide tissue phantoms with embedded polystyrene beads, yielding scattering properties similar to brain matter. In this model, 194 μM solution of ICG was detectable up to depths of 5 mm. ICG angiography was then performed in anesthetized rats. A dynamic process of ICG distribution in the vascular system overlaid with anatomical color images was observed and recorded. In summary, the augmented microscope demonstrates NIR fluorescence detection with superior real-time coregistration displayed within the ocular of the stereomicroscope. In comparison to other techniques, the augmented microscope retains full stereoscopic vision and optical controls including magnification and focus, camera capture, and multiuser access. Augmented microscopy may find application in surgeries where the use of traditional microscopes can be enhanced by contrast agents and image guided delivery of therapeutics, including oncology, neurosurgery, and ophthalmology.

KW - Augmented reality

KW - Image guided surgery

KW - Indocyanine green

KW - Near-infrared fluorescence

KW - Real 3D stereoscopic vision

KW - Real-time coregistration

KW - Videoangiography

UR - http://www.scopus.com/inward/record.url?scp=84924944003&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84924944003&partnerID=8YFLogxK

U2 - 10.1117/12.2077008

DO - 10.1117/12.2077008

M3 - Conference contribution

AN - SCOPUS:84924944003

SN - 9781628414011

VL - 9311

BT - Progress in Biomedical Optics and Imaging - Proceedings of SPIE

PB - SPIE

ER -