東華大學圖書館 |

Neuromorphic Systems for Pattern Recognition and UAV Trajectory Planning.

紀錄類型:	書目-電子資源 : Monograph/item
正題名/作者:	Neuromorphic Systems for Pattern Recognition and UAV Trajectory Planning./
作者:	Li, Yilan.
出版者:	Ann Arbor : ProQuest Dissertations & Theses, : 2021,
面頁冊數:	134 p.
附註:	Source: Dissertations Abstracts International, Volume: 83-01, Section: B.
Contained By:	Dissertations Abstracts International83-01B.
標題:	Computer engineering. -
電子資源:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=28415942
ISBN:	9798516959844

Neuromorphic Systems for Pattern Recognition and UAV Trajectory Planning.
Li, Yilan.

Neuromorphic Systems for Pattern Recognition and UAV Trajectory Planning. - Ann Arbor : ProQuest Dissertations & Theses, 2021 - 134 p.

Source: Dissertations Abstracts International, Volume: 83-01, Section: B.

Thesis (Ph.D.)--Syracuse University, 2021.

This item must not be sold to any third party vendors.

Detection and control are two essential components in an intelligent system. This thesis investigates novel techniques in both areas with a focus on the applications of handwritten text recognition and UAV flight control. Recognizing handwritten texts is a challenging task due to many different writing styles and lack of clear boundary between adjacent characters. The difficulty is greatly increased if the detection algorithms is solely based on pattern matching without information of dynamics of handwriting trajectories. Motivated by the aforementioned challenges, this thesis first investigates the pattern recognition problem. We use offline handwritten texts recognition as a case study to explore the performance of a recurrent belief propagation model. We first develop a probabilistic inference network to post process the recognition results of deep Convolutional Neural Network (CNN) (e.g. LeNet) and collect individual characters to form words. The output of the inference network is a set of words and their probability. A series of post processing and improvement techniques are then introduced to further increase the recognition accuracy. We study the performance of proposed model through various comparisons. The results show that it significantly improves the accuracy by correcting deletion, insertion and replacement errors, which are the main sources of invalid candidate words.Deep Reinforcement Learning (DRL) has widely been applied to control the autonomous systems because it provides solutions for various complex decision-making tasks that previously could not be solved solely with deep learning. To enable autonomous Unmanned Aerial Vehicles (UAV), this thesis presents a two-level trajectory planning framework for UAVs in an indoor environment. A sequence of waypoints is selected at the higher-level, which leads the UAV from its current position to the destination. At the lower-level, an optimal trajectory is generated analytically between each pair of adjacent waypoints. The goal of trajectory generation is to maintain the stability of the UAV, and the goal of the waypoints planning is to select waypoints with the lowest control thrust throughout the entire trip while avoiding collisions with obstacles. The entire framework is implemented using DRL, which learns the highly complicated and nonlinear interaction between those two levels, and the impact from the environment. Given the pre-planned trajectory, this thesis further presents an actor-critic reinforcement learning framework that realizes continuous trajectory control of the UAV through a set of desired waypoints. We construct a deep neural network and develop reinforcement learning for better trajectory tracking. In addition, Field Programmable Gate Arrays (FPGA) based hardware acceleration is designed for energy efficient real-time control.If we are to integrate the trajectory planning model onto a UAV system for real-time on-board planning, a key challenge is how to deliver required performance under strict memory and computational constraints. Techniques that compress Deep Neural Network (DNN) models attract our attention because they allow optimized neural network models to be efficiently deployed on platforms with limited energy and storage capacity. However, conventional model compression techniques prune the DNN after it is fully trained, which is very time-consuming especially when the model is trained using DRL. To overcome the limitation, we present an early phase integrated neural network weight compression system for DRL based waypoints planning. By applying pruning at an early phase, the compression of the DRL model can be realized without significant overhead in training. By tightly integrating pruning and retraining at the early phase, we achieve a higher model compression rate, reduce more memory and computing complexity, and improve the success rate compared to the original work.

ISBN: 9798516959844Subjects--Topical Terms:

621879
Computer engineering.
Subjects--Index Terms:

Recurrent belief propagation model

Neuromorphic Systems for Pattern Recognition and UAV Trajectory Planning.
LDR:05105nmm a2200361 4500 001 2350350
005 20221020125740.5
008 241004s2021 ||||||||||||||||| ||eng d
020 $a 9798516959844
035 $a (MiAaPQ)AAI28415942
035 $a AAI28415942
040 $a MiAaPQ $c MiAaPQ
100 1 $a Li, Yilan. $3 3689828
245 1 0 $a Neuromorphic Systems for Pattern Recognition and UAV Trajectory Planning.
260 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2021
300 $a 134 p.
500 $a Source: Dissertations Abstracts International, Volume: 83-01, Section: B.
500 $a Advisor: Qiu, Qinru.
502 $a Thesis (Ph.D.)--Syracuse University, 2021.
506 $a This item must not be sold to any third party vendors.
520 $a Detection and control are two essential components in an intelligent system. This thesis investigates novel techniques in both areas with a focus on the applications of handwritten text recognition and UAV flight control. Recognizing handwritten texts is a challenging task due to many different writing styles and lack of clear boundary between adjacent characters. The difficulty is greatly increased if the detection algorithms is solely based on pattern matching without information of dynamics of handwriting trajectories. Motivated by the aforementioned challenges, this thesis first investigates the pattern recognition problem. We use offline handwritten texts recognition as a case study to explore the performance of a recurrent belief propagation model. We first develop a probabilistic inference network to post process the recognition results of deep Convolutional Neural Network (CNN) (e.g. LeNet) and collect individual characters to form words. The output of the inference network is a set of words and their probability. A series of post processing and improvement techniques are then introduced to further increase the recognition accuracy. We study the performance of proposed model through various comparisons. The results show that it significantly improves the accuracy by correcting deletion, insertion and replacement errors, which are the main sources of invalid candidate words.Deep Reinforcement Learning (DRL) has widely been applied to control the autonomous systems because it provides solutions for various complex decision-making tasks that previously could not be solved solely with deep learning. To enable autonomous Unmanned Aerial Vehicles (UAV), this thesis presents a two-level trajectory planning framework for UAVs in an indoor environment. A sequence of waypoints is selected at the higher-level, which leads the UAV from its current position to the destination. At the lower-level, an optimal trajectory is generated analytically between each pair of adjacent waypoints. The goal of trajectory generation is to maintain the stability of the UAV, and the goal of the waypoints planning is to select waypoints with the lowest control thrust throughout the entire trip while avoiding collisions with obstacles. The entire framework is implemented using DRL, which learns the highly complicated and nonlinear interaction between those two levels, and the impact from the environment. Given the pre-planned trajectory, this thesis further presents an actor-critic reinforcement learning framework that realizes continuous trajectory control of the UAV through a set of desired waypoints. We construct a deep neural network and develop reinforcement learning for better trajectory tracking. In addition, Field Programmable Gate Arrays (FPGA) based hardware acceleration is designed for energy efficient real-time control.If we are to integrate the trajectory planning model onto a UAV system for real-time on-board planning, a key challenge is how to deliver required performance under strict memory and computational constraints. Techniques that compress Deep Neural Network (DNN) models attract our attention because they allow optimized neural network models to be efficiently deployed on platforms with limited energy and storage capacity. However, conventional model compression techniques prune the DNN after it is fully trained, which is very time-consuming especially when the model is trained using DRL. To overcome the limitation, we present an early phase integrated neural network weight compression system for DRL based waypoints planning. By applying pruning at an early phase, the compression of the DRL model can be realized without significant overhead in training. By tightly integrating pruning and retraining at the early phase, we achieve a higher model compression rate, reduce more memory and computing complexity, and improve the success rate compared to the original work.
590 $a School code: 0659.
650 4 $a Computer engineering. $3 621879
650 4 $a Artificial intelligence. $3 516317
650 4 $a Robotics. $3 519753
650 4 $a Sparsity. $3 3680690
650 4 $a Propagation. $3 3680519
650 4 $a Neurons. $3 588699
650 4 $a Accuracy. $3 3559958
650 4 $a Embedded systems. $2 gtt $3 1068308
650 4 $a Deep learning. $3 3554982
650 4 $a Success. $3 518195
650 4 $a Genetic algorithms. $3 533907
650 4 $a Knowledge. $3 872758
650 4 $a Optimization. $3 891104
650 4 $a Neural networks. $3 677449
650 4 $a Internet of Things. $3 3538511
650 4 $a Unmanned aerial vehicles. $3 3560267
650 4 $a Energy consumption. $3 631630
650 4 $a Field programmable gate arrays. $3 666370
650 4 $a Lie groups. $3 526114
653 $a Recurrent belief propagation model
653 $a Pattern recognition problem
653 $a Unmanned Aerial Vehicles
653 $a Field Programmable Gate Arrays
690 $a 0464
690 $a 0800
690 $a 0771
710 2 $a Syracuse University. $b Electrical Engineering and Computer Science. $3 3169988
773 0 $t Dissertations Abstracts International $g 83-01B.
790 $a 0659
791 $a Ph.D.
792 $a 2021
793 $a English
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=28415942