Intrinsically motivated information foraging

Ian Fasel, Andrew Wilt, Nassim Mafi, Clayton T Morrison

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

We treat information gathering as a POMDP in which the goal is to maximize an accumulated intrinsic reward at each time step based on the negative entropy of the agent's beliefs about the world state. We show that such information foraging agents can discover intelligent exploration policies that take into account the long-term effects of sensor and motor actions, and can automatically adapt to variations in sensor noise, different amounts of prior information, and limited memory conditions.

Original languageEnglish (US)
Title of host publication2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program
Pages101-107
Number of pages7
DOIs
StatePublished - 2010
Event2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Ann Arbor, MI, United States
Duration: Aug 18 2010Aug 21 2010

Other

Other2010 IEEE 9th International Conference on Development and Learning, ICDL-2010
CountryUnited States
CityAnn Arbor, MI
Period8/18/108/21/10

Fingerprint

Sensors
Entropy
entropy
Data storage equipment
reward

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Software
  • Education

Cite this

Fasel, I., Wilt, A., Mafi, N., & Morrison, C. T. (2010). Intrinsically motivated information foraging. In 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program (pp. 101-107). [5578859] https://doi.org/10.1109/DEVLRN.2010.5578859

Intrinsically motivated information foraging. / Fasel, Ian; Wilt, Andrew; Mafi, Nassim; Morrison, Clayton T.

2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program. 2010. p. 101-107 5578859.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Fasel, I, Wilt, A, Mafi, N & Morrison, CT 2010, Intrinsically motivated information foraging. in 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program., 5578859, pp. 101-107, 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010, Ann Arbor, MI, United States, 8/18/10. https://doi.org/10.1109/DEVLRN.2010.5578859
Fasel I, Wilt A, Mafi N, Morrison CT. Intrinsically motivated information foraging. In 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program. 2010. p. 101-107. 5578859 https://doi.org/10.1109/DEVLRN.2010.5578859
Fasel, Ian ; Wilt, Andrew ; Mafi, Nassim ; Morrison, Clayton T. / Intrinsically motivated information foraging. 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program. 2010. pp. 101-107
@inproceedings{877f444ff7b14ca2abdd31634fadc30f,
title = "Intrinsically motivated information foraging",
abstract = "We treat information gathering as a POMDP in which the goal is to maximize an accumulated intrinsic reward at each time step based on the negative entropy of the agent's beliefs about the world state. We show that such information foraging agents can discover intelligent exploration policies that take into account the long-term effects of sensor and motor actions, and can automatically adapt to variations in sensor noise, different amounts of prior information, and limited memory conditions.",
author = "Ian Fasel and Andrew Wilt and Nassim Mafi and Morrison, {Clayton T}",
year = "2010",
doi = "10.1109/DEVLRN.2010.5578859",
language = "English (US)",
isbn = "9781424469024",
pages = "101--107",
booktitle = "2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program",

}

TY - GEN

T1 - Intrinsically motivated information foraging

AU - Fasel, Ian

AU - Wilt, Andrew

AU - Mafi, Nassim

AU - Morrison, Clayton T

PY - 2010

Y1 - 2010

N2 - We treat information gathering as a POMDP in which the goal is to maximize an accumulated intrinsic reward at each time step based on the negative entropy of the agent's beliefs about the world state. We show that such information foraging agents can discover intelligent exploration policies that take into account the long-term effects of sensor and motor actions, and can automatically adapt to variations in sensor noise, different amounts of prior information, and limited memory conditions.

AB - We treat information gathering as a POMDP in which the goal is to maximize an accumulated intrinsic reward at each time step based on the negative entropy of the agent's beliefs about the world state. We show that such information foraging agents can discover intelligent exploration policies that take into account the long-term effects of sensor and motor actions, and can automatically adapt to variations in sensor noise, different amounts of prior information, and limited memory conditions.

UR - http://www.scopus.com/inward/record.url?scp=78149267893&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78149267893&partnerID=8YFLogxK

U2 - 10.1109/DEVLRN.2010.5578859

DO - 10.1109/DEVLRN.2010.5578859

M3 - Conference contribution

AN - SCOPUS:78149267893

SN - 9781424469024

SP - 101

EP - 107

BT - 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program

ER -