東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Linked to FindBook

Google Book

Amazon

博客來

3D Sensing by Optics and Algorithm Co-Design.

Record Type:	Electronic resources : Monograph/item
Title/Author:	3D Sensing by Optics and Algorithm Co-Design./
Author:	Wu, Yicheng.
Published:	Ann Arbor : ProQuest Dissertations & Theses, : 2021,
Description:	137 p.
Notes:	Source: Dissertations Abstracts International, Volume: 83-02, Section: A.
Contained By:	Dissertations Abstracts International83-02A.
Subject:	Electrical engineering. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=28734885
ISBN:	9798535517568

3D Sensing by Optics and Algorithm Co-Design.
Wu, Yicheng.

3D Sensing by Optics and Algorithm Co-Design. - Ann Arbor : ProQuest Dissertations & Theses, 2021 - 137 p.

Source: Dissertations Abstracts International, Volume: 83-02, Section: A.

Thesis (Ph.D.)--Rice University, 2021.

This item must not be sold to any third party vendors.

3D sensing provides the full spatial context of the world, which is important for applications such as augmented reality, virtual reality, and autonomous driving. Unfortunately, conventional cameras only capture a 2D projection of a 3D scene, while depth information is lost. In my research, I propose 3D sensors by jointly designing optics and algorithms. The key idea is to optically encode depth on the sensor measurement, and digitally decode depth using computational solvers. This allows us to recover depth accurately and robustly. In the first part of my thesis, I explore depth estimation using wavefront sensing, which is useful for scientific systems. Depth is encoded in the phase of a wavefront. I build a novel wavefront imaging sensor with high resolution (a.k.a. WISH), using a programmable spatial light modulator (SLM) and a phase retrieval algorithm. WISH offers fine phase estimation with significantly better spatial resolution as compared to currently available wavefront sensors. However, WISH only provides a micron-scale depth range limited by the optical wavelength. To work for macroscopic objects, I propose WISHED, which increases the depth range by more than 1,000x. It is achieved based on the idea of wavelength diversity by combining the estimated phase at two close optical wavelengths. WISHED is capable of measuring transparent, translucent, and opaque 3D objects with smooth and rough surfaces. In the second part of my thesis, I study depth recovery with 3D point spread function (PSF) engineering, which has wide applications for commercial devices. Depth is encoded into the blurriness of the image. To increase the PSF variation over depth, I propose to insert a phase mask on the lens aperture. Then, a deep learning-based algorithm is used to predict depth from the sensor image. To optimize the entire system, I developed an end-to-end optimization pipeline. The key insight is to incorporate the learning of hardware parameters by building a differentiable physics simulator that maps the scene to a sensor image. This simulator represents the optical layer of the deep neural network, followed by digital layers that represent the computational algorithm. This network is trained by datasets with a task-specific loss and outputs optimal parameters for both hardware and algorithms. Based on this idea, I develop two prototypes: PhaseCam3D - a passive single view depth sensor, and FreeCam3D - a structured light framework for scene depth estimation and localization with freely moving cameras.In summary, this thesis provides two 3D-sensing solutions with the idea of optical/digital co-design. I envision different modalities of 3D imaging to be widely adopted in the near future, enabling improved capabilities in many existing applications while revealing entirely new, hitherto unexplored application areas.

ISBN: 9798535517568Subjects--Topical Terms:

649834
Electrical engineering.
Subjects--Index Terms:

3D sensing

3D Sensing by Optics and Algorithm Co-Design.
LDR:03978nmm a2200373 4500 001 2343733
005 20220512072143.5
008 241004s2021 ||||||||||||||||| ||eng d
020 $a 9798535517568
035 $a (MiAaPQ)AAI28734885
035 $a (MiAaPQ)0187rice3749Wu
035 $a AAI28734885
040 $a MiAaPQ $c MiAaPQ
100 1 $a Wu, Yicheng. $3 3682377
245 1 0 $a 3D Sensing by Optics and Algorithm Co-Design.
260 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2021
300 $a 137 p.
500 $a Source: Dissertations Abstracts International, Volume: 83-02, Section: A.
500 $a Advisor: Veeraraghavan, Ashok.
502 $a Thesis (Ph.D.)--Rice University, 2021.
506 $a This item must not be sold to any third party vendors.
520 $a 3D sensing provides the full spatial context of the world, which is important for applications such as augmented reality, virtual reality, and autonomous driving. Unfortunately, conventional cameras only capture a 2D projection of a 3D scene, while depth information is lost. In my research, I propose 3D sensors by jointly designing optics and algorithms. The key idea is to optically encode depth on the sensor measurement, and digitally decode depth using computational solvers. This allows us to recover depth accurately and robustly. In the first part of my thesis, I explore depth estimation using wavefront sensing, which is useful for scientific systems. Depth is encoded in the phase of a wavefront. I build a novel wavefront imaging sensor with high resolution (a.k.a. WISH), using a programmable spatial light modulator (SLM) and a phase retrieval algorithm. WISH offers fine phase estimation with significantly better spatial resolution as compared to currently available wavefront sensors. However, WISH only provides a micron-scale depth range limited by the optical wavelength. To work for macroscopic objects, I propose WISHED, which increases the depth range by more than 1,000x. It is achieved based on the idea of wavelength diversity by combining the estimated phase at two close optical wavelengths. WISHED is capable of measuring transparent, translucent, and opaque 3D objects with smooth and rough surfaces. In the second part of my thesis, I study depth recovery with 3D point spread function (PSF) engineering, which has wide applications for commercial devices. Depth is encoded into the blurriness of the image. To increase the PSF variation over depth, I propose to insert a phase mask on the lens aperture. Then, a deep learning-based algorithm is used to predict depth from the sensor image. To optimize the entire system, I developed an end-to-end optimization pipeline. The key insight is to incorporate the learning of hardware parameters by building a differentiable physics simulator that maps the scene to a sensor image. This simulator represents the optical layer of the deep neural network, followed by digital layers that represent the computational algorithm. This network is trained by datasets with a task-specific loss and outputs optimal parameters for both hardware and algorithms. Based on this idea, I develop two prototypes: PhaseCam3D - a passive single view depth sensor, and FreeCam3D - a structured light framework for scene depth estimation and localization with freely moving cameras.In summary, this thesis provides two 3D-sensing solutions with the idea of optical/digital co-design. I envision different modalities of 3D imaging to be widely adopted in the near future, enabling improved capabilities in many existing applications while revealing entirely new, hitherto unexplored application areas.
590 $a School code: 0187.
650 4 $a Electrical engineering. $3 649834
650 4 $a Software. $2 gtt. $3 619355
650 4 $a Projectors. $3 3680704
650 4 $a Estimates. $3 3561047
650 4 $a Calibration. $3 2068745
650 4 $a CMOS. $3 3681646
650 4 $a Optics. $3 517925
650 4 $a Simulation. $3 644748
650 4 $a Cameras. $3 524039
650 4 $a Physics. $3 516296
650 4 $a Lasers. $3 535503
650 4 $a Experiments. $3 525909
650 4 $a Sensors. $3 3549539
650 4 $a Maps. $3 544078
650 4 $a Design. $3 518875
650 4 $a Three dimensional imaging. $3 1084804
650 4 $a Algorithms. $3 536374
650 4 $a Aperture. $3 3682378
650 4 $a Ablation. $3 3562462
650 4 $a Light. $3 524021
650 4 $a Geometry. $3 517251
650 4 $a Pipelines. $3 899458
650 4 $a Semantics. $3 520060
653 $a 3D sensing
653 $a Computational imaging
653 $a Deep learning
690 $a 0544
690 $a 0389
690 $a 0605
690 $a 0752
710 2 $a Rice University. $b Applied Physics. $3 2105391
773 0 $t Dissertations Abstracts International $g 83-02A.
790 $a 0187
791 $a Ph.D.
792 $a 2021
793 $a English
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=28734885