Motion profiles for deception detection using visual cues

Nicholas Michael, Mark Dilsizian, Dimitris Metaxas, Judee K Burgoon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Citations (Scopus)

Abstract

We propose a data-driven, unobtrusive and covert method for automatic deception detection in interrogation interviews from visual cues only. Using skin blob analysis together with Active Shape Modeling, we continuously track and analyze the motion of the hands and head as a subject is responding to interview questions, as well as their facial micro expressions, thus extracting motion profiles, which we aggregate over each interview response. Our novelty lies in the representation of the motion profile distribution for each response. In particular, we use a kernel density estimator with uniform bins in log feature space. This scheme allows the representation of relatively over-controlled and relatively agitated behaviors of interviewed subjects, thus aiding in the discrimination of truthful and deceptive responses.

Original languageEnglish (US)
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages462-475
Number of pages14
Volume6316 LNCS
EditionPART 6
DOIs
StatePublished - 2010
Event11th European Conference on Computer Vision, ECCV 2010 - Heraklion, Crete, Greece
Duration: Sep 5 2010Sep 11 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 6
Volume6316 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other11th European Conference on Computer Vision, ECCV 2010
CountryGreece
CityHeraklion, Crete
Period9/5/109/11/10

Fingerprint

Deception
Bins
Skin
Motion
Shape Modeling
Kernel Density Estimator
Feature Space
Data-driven
Discrimination
Vision
Profile

Keywords

  • deception
  • face tracking
  • nearest-neighbor
  • skin blob tracking
  • statistical shape models
  • support vector machine

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Michael, N., Dilsizian, M., Metaxas, D., & Burgoon, J. K. (2010). Motion profiles for deception detection using visual cues. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (PART 6 ed., Vol. 6316 LNCS, pp. 462-475). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6316 LNCS, No. PART 6). https://doi.org/10.1007/978-3-642-15567-3_34

Motion profiles for deception detection using visual cues. / Michael, Nicholas; Dilsizian, Mark; Metaxas, Dimitris; Burgoon, Judee K.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 6316 LNCS PART 6. ed. 2010. p. 462-475 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6316 LNCS, No. PART 6).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Michael, N, Dilsizian, M, Metaxas, D & Burgoon, JK 2010, Motion profiles for deception detection using visual cues. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 6 edn, vol. 6316 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 6, vol. 6316 LNCS, pp. 462-475, 11th European Conference on Computer Vision, ECCV 2010, Heraklion, Crete, Greece, 9/5/10. https://doi.org/10.1007/978-3-642-15567-3_34
Michael N, Dilsizian M, Metaxas D, Burgoon JK. Motion profiles for deception detection using visual cues. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 6 ed. Vol. 6316 LNCS. 2010. p. 462-475. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 6). https://doi.org/10.1007/978-3-642-15567-3_34
Michael, Nicholas ; Dilsizian, Mark ; Metaxas, Dimitris ; Burgoon, Judee K. / Motion profiles for deception detection using visual cues. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 6316 LNCS PART 6. ed. 2010. pp. 462-475 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 6).
@inproceedings{871c69de23b74bc99afc5e6258c9690b,
title = "Motion profiles for deception detection using visual cues",
abstract = "We propose a data-driven, unobtrusive and covert method for automatic deception detection in interrogation interviews from visual cues only. Using skin blob analysis together with Active Shape Modeling, we continuously track and analyze the motion of the hands and head as a subject is responding to interview questions, as well as their facial micro expressions, thus extracting motion profiles, which we aggregate over each interview response. Our novelty lies in the representation of the motion profile distribution for each response. In particular, we use a kernel density estimator with uniform bins in log feature space. This scheme allows the representation of relatively over-controlled and relatively agitated behaviors of interviewed subjects, thus aiding in the discrimination of truthful and deceptive responses.",
keywords = "deception, face tracking, nearest-neighbor, skin blob tracking, statistical shape models, support vector machine",
author = "Nicholas Michael and Mark Dilsizian and Dimitris Metaxas and Burgoon, {Judee K}",
year = "2010",
doi = "10.1007/978-3-642-15567-3_34",
language = "English (US)",
isbn = "3642155669",
volume = "6316 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
number = "PART 6",
pages = "462--475",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
edition = "PART 6",

}

TY - GEN

T1 - Motion profiles for deception detection using visual cues

AU - Michael, Nicholas

AU - Dilsizian, Mark

AU - Metaxas, Dimitris

AU - Burgoon, Judee K

PY - 2010

Y1 - 2010

N2 - We propose a data-driven, unobtrusive and covert method for automatic deception detection in interrogation interviews from visual cues only. Using skin blob analysis together with Active Shape Modeling, we continuously track and analyze the motion of the hands and head as a subject is responding to interview questions, as well as their facial micro expressions, thus extracting motion profiles, which we aggregate over each interview response. Our novelty lies in the representation of the motion profile distribution for each response. In particular, we use a kernel density estimator with uniform bins in log feature space. This scheme allows the representation of relatively over-controlled and relatively agitated behaviors of interviewed subjects, thus aiding in the discrimination of truthful and deceptive responses.

AB - We propose a data-driven, unobtrusive and covert method for automatic deception detection in interrogation interviews from visual cues only. Using skin blob analysis together with Active Shape Modeling, we continuously track and analyze the motion of the hands and head as a subject is responding to interview questions, as well as their facial micro expressions, thus extracting motion profiles, which we aggregate over each interview response. Our novelty lies in the representation of the motion profile distribution for each response. In particular, we use a kernel density estimator with uniform bins in log feature space. This scheme allows the representation of relatively over-controlled and relatively agitated behaviors of interviewed subjects, thus aiding in the discrimination of truthful and deceptive responses.

KW - deception

KW - face tracking

KW - nearest-neighbor

KW - skin blob tracking

KW - statistical shape models

KW - support vector machine

UR - http://www.scopus.com/inward/record.url?scp=78149316247&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78149316247&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-15567-3_34

DO - 10.1007/978-3-642-15567-3_34

M3 - Conference contribution

AN - SCOPUS:78149316247

SN - 3642155669

SN - 9783642155666

VL - 6316 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 462

EP - 475

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -