Teaching and executing verb phrases

Daniel Hewlett, Thomas J. Walsh, Paul R Cohen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

This paper describes a framework for an agent to learn models of verb-phrase meanings from human teachers and combine these models with environmental dynamics to enact verb commands. The framework extends prior work in apprenticeship learning and leverages recent advancements in modeling activities and planning in domains with multiple objects. We show how to both learn a verb model as a relational finite state machine and how to turn this model into reward and heuristic functions that can then be composed with an MDP model of an environment. The resulting "combined model" can then be efficiently searched by a planner to enact a verb command in this environment. Our experiments in simulated robot domains show this framework can be used to quickly teach verb commands and improves over the current state of the art method.

Original languageEnglish (US)
Title of host publication2011 IEEE International Conference on Development and Learning, ICDL 2011
DOIs
StatePublished - 2011
Event2011 IEEE International Conference on Development and Learning, ICDL 2011 - Frankfurt am Main, Germany
Duration: Aug 24 2011Aug 27 2011

Other

Other2011 IEEE International Conference on Development and Learning, ICDL 2011
CountryGermany
CityFrankfurt am Main
Period8/24/118/27/11

Fingerprint

Teaching
apprenticeship
Finite automata
robot
reward
heuristics
Robots
Planning
planning
experiment
teacher
learning
Experiments

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Education

Cite this

Hewlett, D., Walsh, T. J., & Cohen, P. R. (2011). Teaching and executing verb phrases. In 2011 IEEE International Conference on Development and Learning, ICDL 2011 [6037340] https://doi.org/10.1109/DEVLRN.2011.6037340

Teaching and executing verb phrases. / Hewlett, Daniel; Walsh, Thomas J.; Cohen, Paul R.

2011 IEEE International Conference on Development and Learning, ICDL 2011. 2011. 6037340.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hewlett, D, Walsh, TJ & Cohen, PR 2011, Teaching and executing verb phrases. in 2011 IEEE International Conference on Development and Learning, ICDL 2011., 6037340, 2011 IEEE International Conference on Development and Learning, ICDL 2011, Frankfurt am Main, Germany, 8/24/11. https://doi.org/10.1109/DEVLRN.2011.6037340
Hewlett D, Walsh TJ, Cohen PR. Teaching and executing verb phrases. In 2011 IEEE International Conference on Development and Learning, ICDL 2011. 2011. 6037340 https://doi.org/10.1109/DEVLRN.2011.6037340
Hewlett, Daniel ; Walsh, Thomas J. ; Cohen, Paul R. / Teaching and executing verb phrases. 2011 IEEE International Conference on Development and Learning, ICDL 2011. 2011.
@inproceedings{1dc5d1d67c714cf3af2b809de6ed872a,
title = "Teaching and executing verb phrases",
abstract = "This paper describes a framework for an agent to learn models of verb-phrase meanings from human teachers and combine these models with environmental dynamics to enact verb commands. The framework extends prior work in apprenticeship learning and leverages recent advancements in modeling activities and planning in domains with multiple objects. We show how to both learn a verb model as a relational finite state machine and how to turn this model into reward and heuristic functions that can then be composed with an MDP model of an environment. The resulting {"}combined model{"} can then be efficiently searched by a planner to enact a verb command in this environment. Our experiments in simulated robot domains show this framework can be used to quickly teach verb commands and improves over the current state of the art method.",
author = "Daniel Hewlett and Walsh, {Thomas J.} and Cohen, {Paul R}",
year = "2011",
doi = "10.1109/DEVLRN.2011.6037340",
language = "English (US)",
isbn = "9781612849904",
booktitle = "2011 IEEE International Conference on Development and Learning, ICDL 2011",

}

TY - GEN

T1 - Teaching and executing verb phrases

AU - Hewlett, Daniel

AU - Walsh, Thomas J.

AU - Cohen, Paul R

PY - 2011

Y1 - 2011

N2 - This paper describes a framework for an agent to learn models of verb-phrase meanings from human teachers and combine these models with environmental dynamics to enact verb commands. The framework extends prior work in apprenticeship learning and leverages recent advancements in modeling activities and planning in domains with multiple objects. We show how to both learn a verb model as a relational finite state machine and how to turn this model into reward and heuristic functions that can then be composed with an MDP model of an environment. The resulting "combined model" can then be efficiently searched by a planner to enact a verb command in this environment. Our experiments in simulated robot domains show this framework can be used to quickly teach verb commands and improves over the current state of the art method.

AB - This paper describes a framework for an agent to learn models of verb-phrase meanings from human teachers and combine these models with environmental dynamics to enact verb commands. The framework extends prior work in apprenticeship learning and leverages recent advancements in modeling activities and planning in domains with multiple objects. We show how to both learn a verb model as a relational finite state machine and how to turn this model into reward and heuristic functions that can then be composed with an MDP model of an environment. The resulting "combined model" can then be efficiently searched by a planner to enact a verb command in this environment. Our experiments in simulated robot domains show this framework can be used to quickly teach verb commands and improves over the current state of the art method.

UR - http://www.scopus.com/inward/record.url?scp=80055016245&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80055016245&partnerID=8YFLogxK

U2 - 10.1109/DEVLRN.2011.6037340

DO - 10.1109/DEVLRN.2011.6037340

M3 - Conference contribution

AN - SCOPUS:80055016245

SN - 9781612849904

BT - 2011 IEEE International Conference on Development and Learning, ICDL 2011

ER -