東華大學圖書館 |

語系: 繁體中文

說明(常見問題)

回圖書館首頁

手機版館藏查詢

登入

回首頁

切換: 標籤 | MARC模式 | ISBD

AdaStress: Adaptive Stress Testing a...

Lee, Ritchie.

FindBook

Google Book

Amazon

博客來

AdaStress: Adaptive Stress Testing and Interpretable Categorization for Safety-Critical Systems.

Record Type:	Electronic resources : Monograph/item
Title/Author:	AdaStress: Adaptive Stress Testing and Interpretable Categorization for Safety-Critical Systems./
Author:	Lee, Ritchie.
Published:	Ann Arbor : ProQuest Dissertations & Theses, : 2019,
Description:	145 p.
Notes:	Source: Dissertations Abstracts International, Volume: 80-11, Section: B.
Contained By:	Dissertations Abstracts International80-11B.
Subject:	Engineering. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=13864608
ISBN:	9781392154106

AdaStress: Adaptive Stress Testing and Interpretable Categorization for Safety-Critical Systems.
Lee, Ritchie.

AdaStress: Adaptive Stress Testing and Interpretable Categorization for Safety-Critical Systems. - Ann Arbor : ProQuest Dissertations & Theses, 2019 - 145 p.

Source: Dissertations Abstracts International, Volume: 80-11, Section: B.

Thesis (Ph.D.)--Carnegie Mellon University, 2019.

This item must not be sold to any third party vendors.

This thesis considers tools and techniques for the design-time validation of cyber-physical systems, where a software system interacts with or controls a physical system over time. We focus on safety-critical systems that may be fully or partially autonomous. The goal of the design-time validation is to identify and diagnose potential failures during system development so that issues can be addressed before they can manifest in operation. However, finding and analyzing failure scenarios in cyber-physical systems can be very challenging due to the size and complexity of the system, interactions with large environments, operation over time, black box and hidden states, rarity of failures, heterogeneous variable types, and difficulty in diagnosing failures.This thesis presents AdaStress, a set of design-time validation tools for finding and analyzing the most likely failure scenarios of a safety-critical system. We present adaptive stress testing (AST), a framework for simulation-based stress testing to find the most likely path to a failure event. The key innovation in AST is to frame the search for the most likely failure scenarios as a sequential decision-making problem and then use reinforcement learning algorithms to adaptively search the scenarios. To handle systems with hidden state, we present an algorithm for AST, based on Monte Carlo tree search and pseudorandom seeds, that can be applied to test systems where the state is not fully observable. Furthermore, we present differential adaptive stress testing (DAST), an extension to AST. DAST compares the failure behavior of two systems. Specifically, DAST finds the most likely scenarios where a failure occurs with the system under test but not with a baseline system. This type of differential analysis is useful, for example, when choosing between two candidate systems or in regression testing. Lastly, grammar-based decision tree (GBDT) learning is an algorithm for automatically categorizing failure events based on their most relevant patterns. The algorithm combines a context-free grammar, temporal logic, and decision tree to produce categorizations with human-interpretable explanations.We demonstrate AdaStress on two cyber-physical systems within aerospace. The first application analyzes prototypes of the next-generation Airborne Collision Avoidance System (ACAS X) in simulated aircraft encounters. We find, categorize, and analyze the most likely scenarios of near mid-air collisions (NMACs). We also perform differential studies comparing ACAS X to the existing Traffic Alert and Collision Avoidance System (TCAS). Our results give confidence that ACAS X offers a safety benefit over TCAS. The second application analyzes a prototype trajectory planning system for a small unmanned aircraft navigating through a three-dimensional maze. We find and analyze the most likely collision scenarios and planning failures. Our analysis identifies a variety of potential safety issues that include algorithmic robustness issues, emergent behaviors from interacting systems, and implementation bugs.

ISBN: 9781392154106Subjects--Topical Terms:

586835
Engineering.

AdaStress: Adaptive Stress Testing and Interpretable Categorization for Safety-Critical Systems.
LDR:04198nmm a2200337 4500 001 2210799
005 20191121124313.5
008 201008s2019 ||||||||||||||||| ||eng d
020 $a 9781392154106
035 $a (MiAaPQ)AAI13864608
035 $a (MiAaPQ)cmu:10379
035 $a AAI13864608
040 $a MiAaPQ $c MiAaPQ
100 1 $a Lee, Ritchie. $3 3437937
245 1 0 $a AdaStress: Adaptive Stress Testing and Interpretable Categorization for Safety-Critical Systems.
260 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2019
300 $a 145 p.
500 $a Source: Dissertations Abstracts International, Volume: 80-11, Section: B.
500 $a Publisher info.: Dissertation/Thesis.
500 $a Advisor: Mengshoel, Ole J.
502 $a Thesis (Ph.D.)--Carnegie Mellon University, 2019.
506 $a This item must not be sold to any third party vendors.
520 $a This thesis considers tools and techniques for the design-time validation of cyber-physical systems, where a software system interacts with or controls a physical system over time. We focus on safety-critical systems that may be fully or partially autonomous. The goal of the design-time validation is to identify and diagnose potential failures during system development so that issues can be addressed before they can manifest in operation. However, finding and analyzing failure scenarios in cyber-physical systems can be very challenging due to the size and complexity of the system, interactions with large environments, operation over time, black box and hidden states, rarity of failures, heterogeneous variable types, and difficulty in diagnosing failures.This thesis presents AdaStress, a set of design-time validation tools for finding and analyzing the most likely failure scenarios of a safety-critical system. We present adaptive stress testing (AST), a framework for simulation-based stress testing to find the most likely path to a failure event. The key innovation in AST is to frame the search for the most likely failure scenarios as a sequential decision-making problem and then use reinforcement learning algorithms to adaptively search the scenarios. To handle systems with hidden state, we present an algorithm for AST, based on Monte Carlo tree search and pseudorandom seeds, that can be applied to test systems where the state is not fully observable. Furthermore, we present differential adaptive stress testing (DAST), an extension to AST. DAST compares the failure behavior of two systems. Specifically, DAST finds the most likely scenarios where a failure occurs with the system under test but not with a baseline system. This type of differential analysis is useful, for example, when choosing between two candidate systems or in regression testing. Lastly, grammar-based decision tree (GBDT) learning is an algorithm for automatically categorizing failure events based on their most relevant patterns. The algorithm combines a context-free grammar, temporal logic, and decision tree to produce categorizations with human-interpretable explanations.We demonstrate AdaStress on two cyber-physical systems within aerospace. The first application analyzes prototypes of the next-generation Airborne Collision Avoidance System (ACAS X) in simulated aircraft encounters. We find, categorize, and analyze the most likely scenarios of near mid-air collisions (NMACs). We also perform differential studies comparing ACAS X to the existing Traffic Alert and Collision Avoidance System (TCAS). Our results give confidence that ACAS X offers a safety benefit over TCAS. The second application analyzes a prototype trajectory planning system for a small unmanned aircraft navigating through a three-dimensional maze. We find and analyze the most likely collision scenarios and planning failures. Our analysis identifies a variety of potential safety issues that include algorithmic robustness issues, emergent behaviors from interacting systems, and implementation bugs.
590 $a School code: 0041.
650 4 $a Engineering. $3 586835
650 4 $a Aerospace engineering. $3 1002622
650 4 $a Computer science. $3 523869
690 $a 0537
690 $a 0538
690 $a 0984
710 2 $a Carnegie Mellon University. $b Electrical and Computer Engineering. $3 2094139
773 0 $t Dissertations Abstracts International $g 80-11B.
790 $a 0041
791 $a Ph.D.
792 $a 2019
793 $a English
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=13864608