Hmm-based deception recognition from visual cues

Gabriel Tsechpenakis, Dimitris Metaxas, Mark Adkins, John Kruse, Judee K. Burgoon, Matthew L. Jensen, Thomas Meservy, Douglas P. Twitchell, Amit Deokar, Jay F. Nunamaker

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Scopus citations

Abstract

Behavioral indicators of deception and behavioral state are extremely difficult for humans to analyze. This research effort attempts to leverage automated systems to augment humans in detecting deception by analyzing nonverbal behavior on video. By tracking faces and hands of an individual, it is anticipated that objective behavioral indicators of deception can be isolated, extracted and synthesized to create a more accurate means for detecting human deception. Blob analysis, a method for analyzing the movement of the head and hands based on the identification of skin color is presented. A proof-of-concept study is presented that uses blob analysis to extract visual cues and events, throughout the examined videos. The integration of these cues is done using a hierarchical Hidden Markov Model to explore behavioral state identification in the detection of deception, mainly involving the detection of agitated and over-controlled behaviors.

Original languageEnglish (US)
Title of host publicationIEEE International Conference on Multimedia and Expo, ICME 2005
Pages824-827
Number of pages4
DOIs
StatePublished - Dec 1 2005
EventIEEE International Conference on Multimedia and Expo, ICME 2005 - Amsterdam, Netherlands
Duration: Jul 6 2005Jul 8 2005

Publication series

NameIEEE International Conference on Multimedia and Expo, ICME 2005
Volume2005

Other

OtherIEEE International Conference on Multimedia and Expo, ICME 2005
CountryNetherlands
CityAmsterdam
Period7/6/057/8/05

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'Hmm-based deception recognition from visual cues'. Together they form a unique fingerprint.

  • Cite this

    Tsechpenakis, G., Metaxas, D., Adkins, M., Kruse, J., Burgoon, J. K., Jensen, M. L., Meservy, T., Twitchell, D. P., Deokar, A., & Nunamaker, J. F. (2005). Hmm-based deception recognition from visual cues. In IEEE International Conference on Multimedia and Expo, ICME 2005 (pp. 824-827). [1521550] (IEEE International Conference on Multimedia and Expo, ICME 2005; Vol. 2005). https://doi.org/10.1109/ICME.2005.1521550