Dynamic Scheduling Of A Robot Servicing Machines On A One-Dimensional Line

Pierre L’Ecuyer, Marcel Mayrand, Moshe Dror

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

We examine the operation of a single robot servicing a finite set of machines lined up in succession. Each machine operates for a random time, gets blocked (or fails), waits for the robot, waits for the repair duration, starts operating again, and so on. We seek a dynamic decision rule which at any time, depending on the state of the whole system, will decide what action the robot should take: to repair the machine in front of it, or to move left or right, or to stop and wait. The objective is to maximize the average number of operating machines, over an infinite horizon. This problem arises in the practical context of a textile winding process. We model this system as a Markov Renewal Decision Process, and present a computational approach, based on dynamic programming, to approximate an optimal decision policy, under the assumption of exponential times to failure. We consider the case in which the robot can stop and change direction anywhere, and the case where the robot can stop or change direction only in front of a machine. Since the optimal policies turn out to be very complex, we examine simpler suboptimal rules, and compare them to the optimal policy and to other previously proposed or commonly used decision rules. For the numerical examples that we have examined, our best suboptimal rules almost always take the optimal decision, and their costs differ from the optimum by a negligible amount. For the case where the robot can stop or change direction anywhere, we used computer simulation to compare the suboptimal rules and conclude that our proposed rules are in general better than those previously proposed or commonly used.

Original languageEnglish (US)
Pages (from-to)371-382
Number of pages12
JournalIIE Transactions (Institute of Industrial Engineers)
Volume23
Issue number4
DOIs
StatePublished - 1991

Fingerprint

Scheduling
Robots
Repair
Dynamic programming
Textiles
Computer simulation
Costs

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering

Cite this

Dynamic Scheduling Of A Robot Servicing Machines On A One-Dimensional Line. / L’Ecuyer, Pierre; Mayrand, Marcel; Dror, Moshe.

In: IIE Transactions (Institute of Industrial Engineers), Vol. 23, No. 4, 1991, p. 371-382.

Research output: Contribution to journalArticle

@article{89ce1085f7374449a3ea085ca98d09a5,
title = "Dynamic Scheduling Of A Robot Servicing Machines On A One-Dimensional Line",
abstract = "We examine the operation of a single robot servicing a finite set of machines lined up in succession. Each machine operates for a random time, gets blocked (or fails), waits for the robot, waits for the repair duration, starts operating again, and so on. We seek a dynamic decision rule which at any time, depending on the state of the whole system, will decide what action the robot should take: to repair the machine in front of it, or to move left or right, or to stop and wait. The objective is to maximize the average number of operating machines, over an infinite horizon. This problem arises in the practical context of a textile winding process. We model this system as a Markov Renewal Decision Process, and present a computational approach, based on dynamic programming, to approximate an optimal decision policy, under the assumption of exponential times to failure. We consider the case in which the robot can stop and change direction anywhere, and the case where the robot can stop or change direction only in front of a machine. Since the optimal policies turn out to be very complex, we examine simpler suboptimal rules, and compare them to the optimal policy and to other previously proposed or commonly used decision rules. For the numerical examples that we have examined, our best suboptimal rules almost always take the optimal decision, and their costs differ from the optimum by a negligible amount. For the case where the robot can stop or change direction anywhere, we used computer simulation to compare the suboptimal rules and conclude that our proposed rules are in general better than those previously proposed or commonly used.",
author = "Pierre L’Ecuyer and Marcel Mayrand and Moshe Dror",
year = "1991",
doi = "10.1080/07408179108963870",
language = "English (US)",
volume = "23",
pages = "371--382",
journal = "IISE Transactions",
issn = "2472-5854",
publisher = "Taylor and Francis Ltd.",
number = "4",

}

TY - JOUR

T1 - Dynamic Scheduling Of A Robot Servicing Machines On A One-Dimensional Line

AU - L’Ecuyer, Pierre

AU - Mayrand, Marcel

AU - Dror, Moshe

PY - 1991

Y1 - 1991

N2 - We examine the operation of a single robot servicing a finite set of machines lined up in succession. Each machine operates for a random time, gets blocked (or fails), waits for the robot, waits for the repair duration, starts operating again, and so on. We seek a dynamic decision rule which at any time, depending on the state of the whole system, will decide what action the robot should take: to repair the machine in front of it, or to move left or right, or to stop and wait. The objective is to maximize the average number of operating machines, over an infinite horizon. This problem arises in the practical context of a textile winding process. We model this system as a Markov Renewal Decision Process, and present a computational approach, based on dynamic programming, to approximate an optimal decision policy, under the assumption of exponential times to failure. We consider the case in which the robot can stop and change direction anywhere, and the case where the robot can stop or change direction only in front of a machine. Since the optimal policies turn out to be very complex, we examine simpler suboptimal rules, and compare them to the optimal policy and to other previously proposed or commonly used decision rules. For the numerical examples that we have examined, our best suboptimal rules almost always take the optimal decision, and their costs differ from the optimum by a negligible amount. For the case where the robot can stop or change direction anywhere, we used computer simulation to compare the suboptimal rules and conclude that our proposed rules are in general better than those previously proposed or commonly used.

AB - We examine the operation of a single robot servicing a finite set of machines lined up in succession. Each machine operates for a random time, gets blocked (or fails), waits for the robot, waits for the repair duration, starts operating again, and so on. We seek a dynamic decision rule which at any time, depending on the state of the whole system, will decide what action the robot should take: to repair the machine in front of it, or to move left or right, or to stop and wait. The objective is to maximize the average number of operating machines, over an infinite horizon. This problem arises in the practical context of a textile winding process. We model this system as a Markov Renewal Decision Process, and present a computational approach, based on dynamic programming, to approximate an optimal decision policy, under the assumption of exponential times to failure. We consider the case in which the robot can stop and change direction anywhere, and the case where the robot can stop or change direction only in front of a machine. Since the optimal policies turn out to be very complex, we examine simpler suboptimal rules, and compare them to the optimal policy and to other previously proposed or commonly used decision rules. For the numerical examples that we have examined, our best suboptimal rules almost always take the optimal decision, and their costs differ from the optimum by a negligible amount. For the case where the robot can stop or change direction anywhere, we used computer simulation to compare the suboptimal rules and conclude that our proposed rules are in general better than those previously proposed or commonly used.

UR - http://www.scopus.com/inward/record.url?scp=6944256183&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=6944256183&partnerID=8YFLogxK

U2 - 10.1080/07408179108963870

DO - 10.1080/07408179108963870

M3 - Article

VL - 23

SP - 371

EP - 382

JO - IISE Transactions

JF - IISE Transactions

SN - 2472-5854

IS - 4

ER -