Augmented reality three-dimensional object visualization and recognition with axially distributed sensing

Adam Markman, Xin Shen, Hong Hua, Bahram Javidi

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

An augmented reality (AR) smartglass display combines real-world scenes with digital information enabling the rapid growth of AR-based applications. We present an augmented reality-based approach for three-dimensional (3D) optical visualization and object recognition using axially distributed sensing (ADS). For object recognition, the 3D scene is reconstructed, and feature extraction is performed by calculating the histogram of oriented gradients (HOG) of a sliding window. A support vector machine (SVM) is then used for classification. Once an object has been identified, the 3D reconstructed scene with the detected object is optically displayed in the smartglasses allowing the user to see the object, remove partial occlusions of the object, and provide critical information about the object such as 3D coordinates, which are not possible with conventional AR devices. To the best of our knowledge, this is the first report on combining axially distributed sensing with 3D object visualization and recognition for applications to augmented reality. The proposed approach can have benefits for many applications, including medical, military, transportation, and manufacturing.

Original languageEnglish (US)
Pages (from-to)297-300
Number of pages4
JournalOptics Letters
Volume41
Issue number2
DOIs
StatePublished - Jan 15 2016

Fingerprint

occlusion
histograms
pattern recognition
sliding
manufacturing
gradients

ASJC Scopus subject areas

  • Atomic and Molecular Physics, and Optics

Cite this

Augmented reality three-dimensional object visualization and recognition with axially distributed sensing. / Markman, Adam; Shen, Xin; Hua, Hong; Javidi, Bahram.

In: Optics Letters, Vol. 41, No. 2, 15.01.2016, p. 297-300.

Research output: Contribution to journalArticle

Markman, Adam ; Shen, Xin ; Hua, Hong ; Javidi, Bahram. / Augmented reality three-dimensional object visualization and recognition with axially distributed sensing. In: Optics Letters. 2016 ; Vol. 41, No. 2. pp. 297-300.
@article{9d1a9febe3c14916851515645e3831fd,
title = "Augmented reality three-dimensional object visualization and recognition with axially distributed sensing",
abstract = "An augmented reality (AR) smartglass display combines real-world scenes with digital information enabling the rapid growth of AR-based applications. We present an augmented reality-based approach for three-dimensional (3D) optical visualization and object recognition using axially distributed sensing (ADS). For object recognition, the 3D scene is reconstructed, and feature extraction is performed by calculating the histogram of oriented gradients (HOG) of a sliding window. A support vector machine (SVM) is then used for classification. Once an object has been identified, the 3D reconstructed scene with the detected object is optically displayed in the smartglasses allowing the user to see the object, remove partial occlusions of the object, and provide critical information about the object such as 3D coordinates, which are not possible with conventional AR devices. To the best of our knowledge, this is the first report on combining axially distributed sensing with 3D object visualization and recognition for applications to augmented reality. The proposed approach can have benefits for many applications, including medical, military, transportation, and manufacturing.",
author = "Adam Markman and Xin Shen and Hong Hua and Bahram Javidi",
year = "2016",
month = "1",
day = "15",
doi = "10.1364/OL.41.000297",
language = "English (US)",
volume = "41",
pages = "297--300",
journal = "Optics Letters",
issn = "0146-9592",
publisher = "The Optical Society",
number = "2",

}

TY - JOUR

T1 - Augmented reality three-dimensional object visualization and recognition with axially distributed sensing

AU - Markman, Adam

AU - Shen, Xin

AU - Hua, Hong

AU - Javidi, Bahram

PY - 2016/1/15

Y1 - 2016/1/15

N2 - An augmented reality (AR) smartglass display combines real-world scenes with digital information enabling the rapid growth of AR-based applications. We present an augmented reality-based approach for three-dimensional (3D) optical visualization and object recognition using axially distributed sensing (ADS). For object recognition, the 3D scene is reconstructed, and feature extraction is performed by calculating the histogram of oriented gradients (HOG) of a sliding window. A support vector machine (SVM) is then used for classification. Once an object has been identified, the 3D reconstructed scene with the detected object is optically displayed in the smartglasses allowing the user to see the object, remove partial occlusions of the object, and provide critical information about the object such as 3D coordinates, which are not possible with conventional AR devices. To the best of our knowledge, this is the first report on combining axially distributed sensing with 3D object visualization and recognition for applications to augmented reality. The proposed approach can have benefits for many applications, including medical, military, transportation, and manufacturing.

AB - An augmented reality (AR) smartglass display combines real-world scenes with digital information enabling the rapid growth of AR-based applications. We present an augmented reality-based approach for three-dimensional (3D) optical visualization and object recognition using axially distributed sensing (ADS). For object recognition, the 3D scene is reconstructed, and feature extraction is performed by calculating the histogram of oriented gradients (HOG) of a sliding window. A support vector machine (SVM) is then used for classification. Once an object has been identified, the 3D reconstructed scene with the detected object is optically displayed in the smartglasses allowing the user to see the object, remove partial occlusions of the object, and provide critical information about the object such as 3D coordinates, which are not possible with conventional AR devices. To the best of our knowledge, this is the first report on combining axially distributed sensing with 3D object visualization and recognition for applications to augmented reality. The proposed approach can have benefits for many applications, including medical, military, transportation, and manufacturing.

UR - http://www.scopus.com/inward/record.url?scp=84962115489&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84962115489&partnerID=8YFLogxK

U2 - 10.1364/OL.41.000297

DO - 10.1364/OL.41.000297

M3 - Article

C2 - 26766698

AN - SCOPUS:84962115489

VL - 41

SP - 297

EP - 300

JO - Optics Letters

JF - Optics Letters

SN - 0146-9592

IS - 2

ER -