A generative probabilistic framework for learning spatial language

Colin R. Dawson, Jeremy Wright, Antons Rebguns, Marco Valenzuela Escarcega, Daniel Fried, Paul R. Cohen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

The language of space and spatial relations is a rich source of abstract semantic structure. We develop a probabilistic model that learns to understand utterances that describe spatial configurations of objects in a tabletop scene by seeking the meaning that best explains the sentence chosen. The inference problem is simplified by assuming that sentences express symbolic representations of (latent) semantic relations between referents and landmarks in space, and that given these symbolic representations, utterances and physical locations are conditionally independent. As such, the inference problem factors into a symbol-grounding component (linking propositions to physical locations) and a symbol-translation component (linking propositions to parse trees). We evaluate the model by eliciting production and comprehension data from human English speakers and find that our system recovers the referent of spatial utterances at a level of proficiency approaching human performance.

Original languageEnglish (US)
Title of host publication2013 IEEE 3rd Joint International Conference on Development and Learning and Epigenetic Robotics, ICDL 2013 - Electronic Conference Proceedings
DOIs
StatePublished - Dec 31 2013
Event2013 IEEE 3rd Joint International Conference on Development and Learning and Epigenetic Robotics, ICDL 2013 - Osaka, Japan
Duration: Aug 18 2013Aug 22 2013

Publication series

Name2013 IEEE 3rd Joint International Conference on Development and Learning and Epigenetic Robotics, ICDL 2013 - Electronic Conference Proceedings

Other

Other2013 IEEE 3rd Joint International Conference on Development and Learning and Epigenetic Robotics, ICDL 2013
CountryJapan
CityOsaka
Period8/18/138/22/13

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Software

Fingerprint Dive into the research topics of 'A generative probabilistic framework for learning spatial language'. Together they form a unique fingerprint.

  • Cite this

    Dawson, C. R., Wright, J., Rebguns, A., Escarcega, M. V., Fried, D., & Cohen, P. R. (2013). A generative probabilistic framework for learning spatial language. In 2013 IEEE 3rd Joint International Conference on Development and Learning and Epigenetic Robotics, ICDL 2013 - Electronic Conference Proceedings [6652560] (2013 IEEE 3rd Joint International Conference on Development and Learning and Epigenetic Robotics, ICDL 2013 - Electronic Conference Proceedings). https://doi.org/10.1109/DevLrn.2013.6652560