Extracting latent attributes from video scenes using text as background knowledge

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We explore the novel task of identifying latent attributes in video scenes, such as the mental states of actors, using only large text collections as background knowledge and minimal information about the videos, such as activity and actor types. We formalize the task and a measure of merit that accounts for the semantic relatedness of mental state terms. We develop and test several largely unsupervised information extraction models that identify the mental states of human participants in video scenes. We show that these models produce complementary information and their combination significantly outperforms the individual models as well as other baseline methods.

Original languageEnglish (US)
Title of host publicationProceedings of the 3rd Joint Conference on Lexical and Computational Semantics, *SEM 2014
PublisherAssociation for Computational Linguistics (ACL)
Pages121-131
Number of pages11
ISBN (Electronic)9781941643259
StatePublished - Jan 1 2014
Event3rd Joint Conference on Lexical and Computational Semantics, *SEM 2014 - Dublin, Ireland
Duration: Aug 23 2014Aug 24 2014

Other

Other3rd Joint Conference on Lexical and Computational Semantics, *SEM 2014
CountryIreland
CityDublin
Period8/23/148/24/14

Fingerprint

Semantics

ASJC Scopus subject areas

  • Computer Science Applications
  • Information Systems
  • Computer Networks and Communications

Cite this

Tran, A., Surdeanu, M., & Cohen, P. R. (2014). Extracting latent attributes from video scenes using text as background knowledge. In Proceedings of the 3rd Joint Conference on Lexical and Computational Semantics, *SEM 2014 (pp. 121-131). Association for Computational Linguistics (ACL).

Extracting latent attributes from video scenes using text as background knowledge. / Tran, Anh; Surdeanu, Mihai; Cohen, Paul R.

Proceedings of the 3rd Joint Conference on Lexical and Computational Semantics, *SEM 2014. Association for Computational Linguistics (ACL), 2014. p. 121-131.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Tran, A, Surdeanu, M & Cohen, PR 2014, Extracting latent attributes from video scenes using text as background knowledge. in Proceedings of the 3rd Joint Conference on Lexical and Computational Semantics, *SEM 2014. Association for Computational Linguistics (ACL), pp. 121-131, 3rd Joint Conference on Lexical and Computational Semantics, *SEM 2014, Dublin, Ireland, 8/23/14.
Tran A, Surdeanu M, Cohen PR. Extracting latent attributes from video scenes using text as background knowledge. In Proceedings of the 3rd Joint Conference on Lexical and Computational Semantics, *SEM 2014. Association for Computational Linguistics (ACL). 2014. p. 121-131
Tran, Anh ; Surdeanu, Mihai ; Cohen, Paul R. / Extracting latent attributes from video scenes using text as background knowledge. Proceedings of the 3rd Joint Conference on Lexical and Computational Semantics, *SEM 2014. Association for Computational Linguistics (ACL), 2014. pp. 121-131
@inproceedings{3a041bfa304f48b8a6598172cb449b4f,
title = "Extracting latent attributes from video scenes using text as background knowledge",
abstract = "We explore the novel task of identifying latent attributes in video scenes, such as the mental states of actors, using only large text collections as background knowledge and minimal information about the videos, such as activity and actor types. We formalize the task and a measure of merit that accounts for the semantic relatedness of mental state terms. We develop and test several largely unsupervised information extraction models that identify the mental states of human participants in video scenes. We show that these models produce complementary information and their combination significantly outperforms the individual models as well as other baseline methods.",
author = "Anh Tran and Mihai Surdeanu and Cohen, {Paul R}",
year = "2014",
month = "1",
day = "1",
language = "English (US)",
pages = "121--131",
booktitle = "Proceedings of the 3rd Joint Conference on Lexical and Computational Semantics, *SEM 2014",
publisher = "Association for Computational Linguistics (ACL)",

}

TY - GEN

T1 - Extracting latent attributes from video scenes using text as background knowledge

AU - Tran, Anh

AU - Surdeanu, Mihai

AU - Cohen, Paul R

PY - 2014/1/1

Y1 - 2014/1/1

N2 - We explore the novel task of identifying latent attributes in video scenes, such as the mental states of actors, using only large text collections as background knowledge and minimal information about the videos, such as activity and actor types. We formalize the task and a measure of merit that accounts for the semantic relatedness of mental state terms. We develop and test several largely unsupervised information extraction models that identify the mental states of human participants in video scenes. We show that these models produce complementary information and their combination significantly outperforms the individual models as well as other baseline methods.

AB - We explore the novel task of identifying latent attributes in video scenes, such as the mental states of actors, using only large text collections as background knowledge and minimal information about the videos, such as activity and actor types. We formalize the task and a measure of merit that accounts for the semantic relatedness of mental state terms. We develop and test several largely unsupervised information extraction models that identify the mental states of human participants in video scenes. We show that these models produce complementary information and their combination significantly outperforms the individual models as well as other baseline methods.

UR - http://www.scopus.com/inward/record.url?scp=85035788983&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85035788983&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85035788983

SP - 121

EP - 131

BT - Proceedings of the 3rd Joint Conference on Lexical and Computational Semantics, *SEM 2014

PB - Association for Computational Linguistics (ACL)

ER -