東華大學圖書館 |

Spectrally-Programmable Cameras for Imaging and Inference.

紀錄類型:	書目-電子資源 : Monograph/item
正題名/作者:	Spectrally-Programmable Cameras for Imaging and Inference./
作者:	Saragadam, Vishwanath.
出版者:	Ann Arbor : ProQuest Dissertations & Theses, : 2020,
面頁冊數:	141 p.
附註:	Source: Dissertations Abstracts International, Volume: 81-10, Section: B.
Contained By:	Dissertations Abstracts International81-10B.
標題:	Electrical engineering. -
電子資源:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=27740570
ISBN:	9781658454599

Spectrally-Programmable Cameras for Imaging and Inference.
Saragadam, Vishwanath.

Spectrally-Programmable Cameras for Imaging and Inference. - Ann Arbor : ProQuest Dissertations & Theses, 2020 - 141 p.

Source: Dissertations Abstracts International, Volume: 81-10, Section: B.

Thesis (Ph.D.)--Carnegie Mellon University, 2020.

This item must not be sold to any third party vendors.

Understanding light and its interactions with materials in a scene forms the bedrock of modern computer vision. In this context, the spectral properties of light play a very important role, especially when we seek to study the material composition of a scene. As a consequence, spectral measurements find applications across a wide range of scientific fields such as medical diagnostics, microscopy, geospace intelligence, remote sensing, and computer vision.Several vision tasks benefit immensely from capturing spectra at all spatial locations in a scene. This requires an optical system called hyperspectral camera, which captures images across finely spaced wavelengths. Despite its wide applicability, measuring a high resolution hyperspectral image is inherently a hard task. Sampling a scene over million of spatial locations, and across hundreds of spectral bands results in diminishing photon count at each spatio-spectral voxel, leading to extremely low signal to noise ratios (SNR). This is often compensated with long exposure times, which precludes imaging of dynamic scenes. Further, the giga-pixels of data associated with each scan places immense burden on capture and processing hardware.The work in this thesis seeks to simplify the process of capturing spectral information of a scene with design of novel imaging systems. This thesis relies on two key observations. First, despite the high dimensional nature of hyperspectral images, the number of distinct materials in any given scene is very small; this leads to a concise low-dimensional representation of the hyperspectral image. Second, owing to this low diversity, capturing a small set of spectrally-filtered images of the scene suffices for most sensing and inference tasks. Exploiting these two observations, this thesis builds novel and efficient optical systems for imaging and inference.Central to the contributions of this thesis is an optical system that can provide programmable spectral filtering, by attenuating intensity of light at each wavelength arbitrarily and capturing the resultant image. The first contribution of this thesis shows that capturing sharp images with arbitrarily high resolution spectral filtering is not possible -- a property that arises due to the shape of the pupil function of the camera. This fundamental limit is provided in the form of the space-spectrum uncertainty principle, which sets a lower bound on product of spectral and spatial spreads. We then show that the resolutions can be enhanced computationally, if the pupil function is carefully engineered to introduce invertible spatial and spectral blurs.Armed with the insights of a spectrally-programmable setup, we show that such cameras can be used to efficiently sense hyperspectral images. Since the true complexity of sensing hyperspectral images lies not in high resolution space or spectrum, but only the diversity of materials, the hyperspectral image can be represented using a low-rank matrix model. This thesis provides a novel adaptive sensing strategy to optically compute this low-rank model. We note that the dominant spatial and spectral singular vectors can be sensed by building two optical operators, namely a spatially-coded spectrometer, and a spectrally-programmable camera. By alternating between the two operators, and using output of one operator as input to the second, we can measure a low-rank approximation with as few as ten measurements -- contrasted with several hundreds of measurements for fully scanning the hyperspectral image.Finally, the thesis builds on spectral-programmability and optical computing to enable per-pixel material classification. This is achieved by capturing images of the scene with learned, discriminative spectral filters and then using the images to classify materials. This enables a per-pixel classification strategy with a small set of high SNR measurements -- thereby leading to real-time vision capabilities. At its culmination, this thesis lays groundwork for making hyperspectral cameras more practical by introducing computing into the sensing pipeline, and moving most of computational burden into the optical domain. This successfully decouples the number of measurements and SNR, thereby allowing future optical systems to achieve very high resolution along spatial and spectral axes.

ISBN: 9781658454599Subjects--Topical Terms:

649834
Electrical engineering.
Subjects--Index Terms:

Adaptive sensing

Spectrally-Programmable Cameras for Imaging and Inference.
LDR:05536nmm a2200385 4500 001 2266126
005 20200608114804.5
008 220629s2020 ||||||||||||||||| ||eng d
020 $a 9781658454599
035 $a (MiAaPQ)AAI27740570
035 $a AAI27740570
040 $a MiAaPQ $c MiAaPQ
100 1 $a Saragadam, Vishwanath. $3 3543311
245 1 0 $a Spectrally-Programmable Cameras for Imaging and Inference.
260 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2020
300 $a 141 p.
500 $a Source: Dissertations Abstracts International, Volume: 81-10, Section: B.
500 $a Advisor: Sankaranarayanan, Aswin;Li, Xin.
502 $a Thesis (Ph.D.)--Carnegie Mellon University, 2020.
506 $a This item must not be sold to any third party vendors.
520 $a Understanding light and its interactions with materials in a scene forms the bedrock of modern computer vision. In this context, the spectral properties of light play a very important role, especially when we seek to study the material composition of a scene. As a consequence, spectral measurements find applications across a wide range of scientific fields such as medical diagnostics, microscopy, geospace intelligence, remote sensing, and computer vision.Several vision tasks benefit immensely from capturing spectra at all spatial locations in a scene. This requires an optical system called hyperspectral camera, which captures images across finely spaced wavelengths. Despite its wide applicability, measuring a high resolution hyperspectral image is inherently a hard task. Sampling a scene over million of spatial locations, and across hundreds of spectral bands results in diminishing photon count at each spatio-spectral voxel, leading to extremely low signal to noise ratios (SNR). This is often compensated with long exposure times, which precludes imaging of dynamic scenes. Further, the giga-pixels of data associated with each scan places immense burden on capture and processing hardware.The work in this thesis seeks to simplify the process of capturing spectral information of a scene with design of novel imaging systems. This thesis relies on two key observations. First, despite the high dimensional nature of hyperspectral images, the number of distinct materials in any given scene is very small; this leads to a concise low-dimensional representation of the hyperspectral image. Second, owing to this low diversity, capturing a small set of spectrally-filtered images of the scene suffices for most sensing and inference tasks. Exploiting these two observations, this thesis builds novel and efficient optical systems for imaging and inference.Central to the contributions of this thesis is an optical system that can provide programmable spectral filtering, by attenuating intensity of light at each wavelength arbitrarily and capturing the resultant image. The first contribution of this thesis shows that capturing sharp images with arbitrarily high resolution spectral filtering is not possible -- a property that arises due to the shape of the pupil function of the camera. This fundamental limit is provided in the form of the space-spectrum uncertainty principle, which sets a lower bound on product of spectral and spatial spreads. We then show that the resolutions can be enhanced computationally, if the pupil function is carefully engineered to introduce invertible spatial and spectral blurs.Armed with the insights of a spectrally-programmable setup, we show that such cameras can be used to efficiently sense hyperspectral images. Since the true complexity of sensing hyperspectral images lies not in high resolution space or spectrum, but only the diversity of materials, the hyperspectral image can be represented using a low-rank matrix model. This thesis provides a novel adaptive sensing strategy to optically compute this low-rank model. We note that the dominant spatial and spectral singular vectors can be sensed by building two optical operators, namely a spatially-coded spectrometer, and a spectrally-programmable camera. By alternating between the two operators, and using output of one operator as input to the second, we can measure a low-rank approximation with as few as ten measurements -- contrasted with several hundreds of measurements for fully scanning the hyperspectral image.Finally, the thesis builds on spectral-programmability and optical computing to enable per-pixel material classification. This is achieved by capturing images of the scene with learned, discriminative spectral filters and then using the images to classify materials. This enables a per-pixel classification strategy with a small set of high SNR measurements -- thereby leading to real-time vision capabilities. At its culmination, this thesis lays groundwork for making hyperspectral cameras more practical by introducing computing into the sensing pipeline, and moving most of computational burden into the optical domain. This successfully decouples the number of measurements and SNR, thereby allowing future optical systems to achieve very high resolution along spatial and spectral axes.
590 $a School code: 0041.
650 4 $a Electrical engineering. $3 649834
650 4 $a Artificial intelligence. $3 516317
650 4 $a Optics. $3 517925
653 $a Adaptive sensing
653 $a Computational photography
653 $a Hyperspectral
653 $a Material classification
653 $a Optical computing
653 $a Spectrum
690 $a 0544
690 $a 0800
690 $a 0752
710 2 $a Carnegie Mellon University. $b Electrical and Computer Engineering. $3 2094139
773 0 $t Dissertations Abstracts International $g 81-10B.
790 $a 0041
791 $a Ph.D.
792 $a 2020
793 $a English
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=27740570