Robust, globally consistent and fully automatic multi-image registration and montage synthesis for 3-D multi-channel images

C. L. Tsai, J. P. Lister, C. S. Bjornsson, K. Smith, W. Shain, Carol A Barnes, B. Roysam

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

The need to map regions of brain tissue that are much wider than the field of view of the microscope arises frequently. One common approach is to collect a series of overlapping partial views, and align them to synthesize a montage covering the entire region of interest. We present a method that advances this approach in multiple ways. Our method (1) produces a globally consistent joint registration of an unorganized collection of three-dimensional (3-D) multi-channel images with or without stage micrometer data; (2) produces accurate registrations withstanding changes in scale, rotation, translation and shear by using a 3-D affine transformation model; (3) achieves complete automation, and does not require any parameter settings; (4) handles low and variable overlaps (5-15%) between adjacent images, minimizing the number of images required to cover a tissue region; (5) has the self-diagnostic ability to recognize registration failures instead of delivering incorrect results; (6) can handle a broad range of biological images by exploiting generic alignment cues from multiple fluorescence channels without requiring segmentation and (7) is computationally efficient enough to run on desktop computers regardless of the number of images. The algorithm was tested with several tissue samples of at least 50 image tiles, involving over 5000 image pairs. It correctly registered all image pairs with an overlap greater than 7%, correctly recognized all failures, and successfully joint-registered all images for all tissue samples studied. This algorithm is disseminated freely to the community as included with the Fluorescence Association Rules for Multi-Dimensional Insight toolkit for microscopy ().

Original languageEnglish (US)
Pages (from-to)154-171
Number of pages18
JournalJournal of Microscopy
Volume243
Issue number2
DOIs
StatePublished - Aug 2011

Fingerprint

Joints
Fluorescence
Aptitude
Automation
Cues
Microscopy
Brain

Keywords

  • 3-D microscopy
  • Image registration
  • Montage synthesis

ASJC Scopus subject areas

  • Histology
  • Pathology and Forensic Medicine

Cite this

Robust, globally consistent and fully automatic multi-image registration and montage synthesis for 3-D multi-channel images. / Tsai, C. L.; Lister, J. P.; Bjornsson, C. S.; Smith, K.; Shain, W.; Barnes, Carol A; Roysam, B.

In: Journal of Microscopy, Vol. 243, No. 2, 08.2011, p. 154-171.

Research output: Contribution to journalArticle

Tsai, C. L. ; Lister, J. P. ; Bjornsson, C. S. ; Smith, K. ; Shain, W. ; Barnes, Carol A ; Roysam, B. / Robust, globally consistent and fully automatic multi-image registration and montage synthesis for 3-D multi-channel images. In: Journal of Microscopy. 2011 ; Vol. 243, No. 2. pp. 154-171.
@article{5745ded817cb4e8284c9a050fc23ff1f,
title = "Robust, globally consistent and fully automatic multi-image registration and montage synthesis for 3-D multi-channel images",
abstract = "The need to map regions of brain tissue that are much wider than the field of view of the microscope arises frequently. One common approach is to collect a series of overlapping partial views, and align them to synthesize a montage covering the entire region of interest. We present a method that advances this approach in multiple ways. Our method (1) produces a globally consistent joint registration of an unorganized collection of three-dimensional (3-D) multi-channel images with or without stage micrometer data; (2) produces accurate registrations withstanding changes in scale, rotation, translation and shear by using a 3-D affine transformation model; (3) achieves complete automation, and does not require any parameter settings; (4) handles low and variable overlaps (5-15{\%}) between adjacent images, minimizing the number of images required to cover a tissue region; (5) has the self-diagnostic ability to recognize registration failures instead of delivering incorrect results; (6) can handle a broad range of biological images by exploiting generic alignment cues from multiple fluorescence channels without requiring segmentation and (7) is computationally efficient enough to run on desktop computers regardless of the number of images. The algorithm was tested with several tissue samples of at least 50 image tiles, involving over 5000 image pairs. It correctly registered all image pairs with an overlap greater than 7{\%}, correctly recognized all failures, and successfully joint-registered all images for all tissue samples studied. This algorithm is disseminated freely to the community as included with the Fluorescence Association Rules for Multi-Dimensional Insight toolkit for microscopy ().",
keywords = "3-D microscopy, Image registration, Montage synthesis",
author = "Tsai, {C. L.} and Lister, {J. P.} and Bjornsson, {C. S.} and K. Smith and W. Shain and Barnes, {Carol A} and B. Roysam",
year = "2011",
month = "8",
doi = "10.1111/j.1365-2818.2011.03489.x",
language = "English (US)",
volume = "243",
pages = "154--171",
journal = "Journal of Microscopy",
issn = "0022-2720",
publisher = "Wiley-Blackwell",
number = "2",

}

TY - JOUR

T1 - Robust, globally consistent and fully automatic multi-image registration and montage synthesis for 3-D multi-channel images

AU - Tsai, C. L.

AU - Lister, J. P.

AU - Bjornsson, C. S.

AU - Smith, K.

AU - Shain, W.

AU - Barnes, Carol A

AU - Roysam, B.

PY - 2011/8

Y1 - 2011/8

N2 - The need to map regions of brain tissue that are much wider than the field of view of the microscope arises frequently. One common approach is to collect a series of overlapping partial views, and align them to synthesize a montage covering the entire region of interest. We present a method that advances this approach in multiple ways. Our method (1) produces a globally consistent joint registration of an unorganized collection of three-dimensional (3-D) multi-channel images with or without stage micrometer data; (2) produces accurate registrations withstanding changes in scale, rotation, translation and shear by using a 3-D affine transformation model; (3) achieves complete automation, and does not require any parameter settings; (4) handles low and variable overlaps (5-15%) between adjacent images, minimizing the number of images required to cover a tissue region; (5) has the self-diagnostic ability to recognize registration failures instead of delivering incorrect results; (6) can handle a broad range of biological images by exploiting generic alignment cues from multiple fluorescence channels without requiring segmentation and (7) is computationally efficient enough to run on desktop computers regardless of the number of images. The algorithm was tested with several tissue samples of at least 50 image tiles, involving over 5000 image pairs. It correctly registered all image pairs with an overlap greater than 7%, correctly recognized all failures, and successfully joint-registered all images for all tissue samples studied. This algorithm is disseminated freely to the community as included with the Fluorescence Association Rules for Multi-Dimensional Insight toolkit for microscopy ().

AB - The need to map regions of brain tissue that are much wider than the field of view of the microscope arises frequently. One common approach is to collect a series of overlapping partial views, and align them to synthesize a montage covering the entire region of interest. We present a method that advances this approach in multiple ways. Our method (1) produces a globally consistent joint registration of an unorganized collection of three-dimensional (3-D) multi-channel images with or without stage micrometer data; (2) produces accurate registrations withstanding changes in scale, rotation, translation and shear by using a 3-D affine transformation model; (3) achieves complete automation, and does not require any parameter settings; (4) handles low and variable overlaps (5-15%) between adjacent images, minimizing the number of images required to cover a tissue region; (5) has the self-diagnostic ability to recognize registration failures instead of delivering incorrect results; (6) can handle a broad range of biological images by exploiting generic alignment cues from multiple fluorescence channels without requiring segmentation and (7) is computationally efficient enough to run on desktop computers regardless of the number of images. The algorithm was tested with several tissue samples of at least 50 image tiles, involving over 5000 image pairs. It correctly registered all image pairs with an overlap greater than 7%, correctly recognized all failures, and successfully joint-registered all images for all tissue samples studied. This algorithm is disseminated freely to the community as included with the Fluorescence Association Rules for Multi-Dimensional Insight toolkit for microscopy ().

KW - 3-D microscopy

KW - Image registration

KW - Montage synthesis

UR - http://www.scopus.com/inward/record.url?scp=79960413901&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79960413901&partnerID=8YFLogxK

U2 - 10.1111/j.1365-2818.2011.03489.x

DO - 10.1111/j.1365-2818.2011.03489.x

M3 - Article

C2 - 21361958

AN - SCOPUS:79960413901

VL - 243

SP - 154

EP - 171

JO - Journal of Microscopy

JF - Journal of Microscopy

SN - 0022-2720

IS - 2

ER -