東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Acting, Planning, and Learning Using...

Patra, Sunandita.

Linked to FindBook

Google Book

Amazon

博客來

Acting, Planning, and Learning Using Hierarchical Operational Models.

Record Type:	Electronic resources : Monograph/item
Title/Author:	Acting, Planning, and Learning Using Hierarchical Operational Models./
Author:	Patra, Sunandita.
Published:	Ann Arbor : ProQuest Dissertations & Theses, : 2020,
Description:	253 p.
Notes:	Source: Dissertations Abstracts International, Volume: 82-05, Section: B.
Contained By:	Dissertations Abstracts International82-05B.
Subject:	Artificial intelligence. -
Online resource:	https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=28029382
ISBN:	9798678124920

Acting, Planning, and Learning Using Hierarchical Operational Models.
Patra, Sunandita.

Acting, Planning, and Learning Using Hierarchical Operational Models. - Ann Arbor : ProQuest Dissertations & Theses, 2020 - 253 p.

Source: Dissertations Abstracts International, Volume: 82-05, Section: B.

Thesis (Ph.D.)--University of Maryland, College Park, 2020.

This item must not be sold to any third party vendors.

The most common representation formalisms for planning are descriptive models that abstractly describe what the actions do and are tailored for efficiently computing the next state(s) in a state-transition system. However, real-world acting requires operational models that describe how to do things, with rich control structures for closed-loop online decision-making in a dynamic environment. Use of a different action model for planning than the one used for acting causes problems with combining acting and planning, in particular for the development and consistency verification of the different models.As an alternative, this dissertation defines and implements an integrated acting-and-planning system in which both planning and acting use the same operational models, which are written in a general-purpose hierarchical task-oriented language offering rich control structures.The acting component, called Reactive Acting Engine (RAE), is inspired by the well-known PRS system, except that instead of being purely reactive, it can get advice from a planner. The dissertation also describes three planning algorithms which plan by doing several Monte Carlo rollouts in the space of operational models. The best of these three planners, Plan-with-UPOM uses a UCT-like Monte Carlo Tree Search procedure called UPOM (UCT Procedure for Operational Models), whose rollouts are simulated executions of the actor's operational models. The dissertation also presents learning strategies for use with RAE and UPOM that acquire from online acting experiences and/or simulated planning results, a mapping from decision contexts to method instances as well as a heuristic function to guide UPOM. The experimental results show that Plan-with-UPOM and the learning strategies significantly improve the acting efficiency and robustness of RAE. It can be proved that UPOM converges asymptotically by mapping its search space to an MDP. The dissertation also describes a real-world prototype of RAE and Plan-with-UPOM to defend software-defined networks, a relatively new network management architecture, against incoming attacks.

ISBN: 9798678124920Subjects--Topical Terms:

516317
Artificial intelligence.
Subjects--Index Terms:

Acting and planning

Acting, Planning, and Learning Using Hierarchical Operational Models.
LDR:03598nmm a2200469 4500 001 2278389
005 20210628075014.5
008 220723s2020 ||||||||||||||||| ||eng d
020 $a 9798678124920
035 $a (MiAaPQ)AAI28029382
035 $a AAI28029382
040 $a MiAaPQ $c MiAaPQ
100 1 $a Patra, Sunandita. $0 (orcid)0000-0002-6291-7565 $3 3556765
245 1 0 $a Acting, Planning, and Learning Using Hierarchical Operational Models.
260 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2020
300 $a 253 p.
500 $a Source: Dissertations Abstracts International, Volume: 82-05, Section: B.
500 $a Advisor: Nau, Dana.
502 $a Thesis (Ph.D.)--University of Maryland, College Park, 2020.
506 $a This item must not be sold to any third party vendors.
520 $a The most common representation formalisms for planning are descriptive models that abstractly describe what the actions do and are tailored for efficiently computing the next state(s) in a state-transition system. However, real-world acting requires operational models that describe how to do things, with rich control structures for closed-loop online decision-making in a dynamic environment. Use of a different action model for planning than the one used for acting causes problems with combining acting and planning, in particular for the development and consistency verification of the different models.As an alternative, this dissertation defines and implements an integrated acting-and-planning system in which both planning and acting use the same operational models, which are written in a general-purpose hierarchical task-oriented language offering rich control structures.The acting component, called Reactive Acting Engine (RAE), is inspired by the well-known PRS system, except that instead of being purely reactive, it can get advice from a planner. The dissertation also describes three planning algorithms which plan by doing several Monte Carlo rollouts in the space of operational models. The best of these three planners, Plan-with-UPOM uses a UCT-like Monte Carlo Tree Search procedure called UPOM (UCT Procedure for Operational Models), whose rollouts are simulated executions of the actor's operational models. The dissertation also presents learning strategies for use with RAE and UPOM that acquire from online acting experiences and/or simulated planning results, a mapping from decision contexts to method instances as well as a heuristic function to guide UPOM. The experimental results show that Plan-with-UPOM and the learning strategies significantly improve the acting efficiency and robustness of RAE. It can be proved that UPOM converges asymptotically by mapping its search space to an MDP. The dissertation also describes a real-world prototype of RAE and Plan-with-UPOM to defend software-defined networks, a relatively new network management architecture, against incoming attacks.
590 $a School code: 0117.
650 4 $a Artificial intelligence. $3 516317
650 4 $a Computer science. $3 523869
650 4 $a Systems science. $3 3168411
650 4 $a Information technology. $3 532993
650 4 $a Instructional design. $3 3172279
653 $a Acting and planning
653 $a Dynamic environments
653 $a Hierarchical operational models
653 $a Online planning
653 $a Supervised learning
653 $a Descriptive models
653 $a State-transition system
653 $a Operational models
653 $a Closed-loop online decision-making
653 $a Reactive Acting Engine
653 $a Network management architecture
690 $a 0800
690 $a 0984
690 $a 0489
690 $a 0447
690 $a 0790
710 2 $a University of Maryland, College Park. $b Computer Science. $3 1018451
773 0 $t Dissertations Abstracts International $g 82-05B.
790 $a 0117
791 $a Ph.D.
792 $a 2020
793 $a English
856 4 0 $u https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=28029382