Learning what is relevant to the effects of actions for a mobile robot

Matthew D. Schmill, Michael T. Rosenstein, Paul R Cohen, Paul Utgoff

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

We have developed a learning mechanism that allows robots to discover the conditional effects of their actions. Based on sensorimotor experience, this mechanism permits a robot to explore its environment and observe effects of its actions. These observations are used to learn a context operator difference table, a structure that relates circumstances (context) and actions (operators) to effects on the environment. From the context operator difference table, one can extract a relatively small set of state variables, which simplifies the problem of learning policies for complex activities. We demonstrate results with the Pioneer 1 mobile robot.

Original languageEnglish (US)
Title of host publicationProceedings of the International Conference on Autonomous Agents
Editors Anon
Pages247-253
Number of pages7
StatePublished - 1998
Externally publishedYes
EventProceedings of the 1998 2nd International Conference on Autonomous Agents - Minneapolis, MN, USA
Duration: May 9 1998May 13 1998

Other

OtherProceedings of the 1998 2nd International Conference on Autonomous Agents
CityMinneapolis, MN, USA
Period5/9/985/13/98

Fingerprint

Mobile robots
Robots

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Schmill, M. D., Rosenstein, M. T., Cohen, P. R., & Utgoff, P. (1998). Learning what is relevant to the effects of actions for a mobile robot. In Anon (Ed.), Proceedings of the International Conference on Autonomous Agents (pp. 247-253)

Learning what is relevant to the effects of actions for a mobile robot. / Schmill, Matthew D.; Rosenstein, Michael T.; Cohen, Paul R; Utgoff, Paul.

Proceedings of the International Conference on Autonomous Agents. ed. / Anon. 1998. p. 247-253.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Schmill, MD, Rosenstein, MT, Cohen, PR & Utgoff, P 1998, Learning what is relevant to the effects of actions for a mobile robot. in Anon (ed.), Proceedings of the International Conference on Autonomous Agents. pp. 247-253, Proceedings of the 1998 2nd International Conference on Autonomous Agents, Minneapolis, MN, USA, 5/9/98.
Schmill MD, Rosenstein MT, Cohen PR, Utgoff P. Learning what is relevant to the effects of actions for a mobile robot. In Anon, editor, Proceedings of the International Conference on Autonomous Agents. 1998. p. 247-253
Schmill, Matthew D. ; Rosenstein, Michael T. ; Cohen, Paul R ; Utgoff, Paul. / Learning what is relevant to the effects of actions for a mobile robot. Proceedings of the International Conference on Autonomous Agents. editor / Anon. 1998. pp. 247-253
@inproceedings{f1685bb473314e9984505c5e5ce7e717,
title = "Learning what is relevant to the effects of actions for a mobile robot",
abstract = "We have developed a learning mechanism that allows robots to discover the conditional effects of their actions. Based on sensorimotor experience, this mechanism permits a robot to explore its environment and observe effects of its actions. These observations are used to learn a context operator difference table, a structure that relates circumstances (context) and actions (operators) to effects on the environment. From the context operator difference table, one can extract a relatively small set of state variables, which simplifies the problem of learning policies for complex activities. We demonstrate results with the Pioneer 1 mobile robot.",
author = "Schmill, {Matthew D.} and Rosenstein, {Michael T.} and Cohen, {Paul R} and Paul Utgoff",
year = "1998",
language = "English (US)",
pages = "247--253",
editor = "Anon",
booktitle = "Proceedings of the International Conference on Autonomous Agents",

}

TY - GEN

T1 - Learning what is relevant to the effects of actions for a mobile robot

AU - Schmill, Matthew D.

AU - Rosenstein, Michael T.

AU - Cohen, Paul R

AU - Utgoff, Paul

PY - 1998

Y1 - 1998

N2 - We have developed a learning mechanism that allows robots to discover the conditional effects of their actions. Based on sensorimotor experience, this mechanism permits a robot to explore its environment and observe effects of its actions. These observations are used to learn a context operator difference table, a structure that relates circumstances (context) and actions (operators) to effects on the environment. From the context operator difference table, one can extract a relatively small set of state variables, which simplifies the problem of learning policies for complex activities. We demonstrate results with the Pioneer 1 mobile robot.

AB - We have developed a learning mechanism that allows robots to discover the conditional effects of their actions. Based on sensorimotor experience, this mechanism permits a robot to explore its environment and observe effects of its actions. These observations are used to learn a context operator difference table, a structure that relates circumstances (context) and actions (operators) to effects on the environment. From the context operator difference table, one can extract a relatively small set of state variables, which simplifies the problem of learning policies for complex activities. We demonstrate results with the Pioneer 1 mobile robot.

UR - http://www.scopus.com/inward/record.url?scp=0031681986&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0031681986&partnerID=8YFLogxK

M3 - Conference contribution

SP - 247

EP - 253

BT - Proceedings of the International Conference on Autonomous Agents

A2 - Anon, null

ER -