CMOS Image Sensors with Multi-bucket Pixels for Computational Photography

CMOS Image Sensors with Multi-bucket Pixels for Computational Photography

Author: Chung Chun Wan

Publisher:

Published: 2011

Total Pages:

ISBN-13:

DOWNLOAD EBOOK

When applied to multi-image computational photography such as flash/no-flash imaging, multiple exposure high dynamic range imaging, multi-flash imaging for depth edge detection, color imaging using active illumination, and flash matting, an image sensor that can capture multiple time-interleaved images would provide a dramatic advantage over capturing and combining a burst of images having different camera settings. In particular, this interleaving eliminates the need to align the frames after capture. Moreover, all frames have the same handshake or object motion blur, and moving objects are in the same position in all frames. A sensor with multi-bucket analog memories in each pixel can accomplish this task. Whereas frames are acquired sequentially in a conventional sensor, in a multi-bucket sensor photo-generated charges in a photodiode can be transferred and accumulated in the in-pixel memories in any chosen time sequence during an exposure so multiple frames can be acquired virtually simultaneously. Designing a multi-bucket pixel which is compact and scalable is challenging because space is required to accommodate the additional in-pixel memories and their associated control signal lines. This research explored and developed a new multi-bucket pixel technology by adapting the concept of virtual phase charge-coupled device into a standard 4-transistor CMOS pixel such that area overhead is small and true correlated double sampling is preserved to cancel kTC noise. Based on the developed pixel technology, two prototype CMOS image sensors with dual and quad-bucket pixels were designed and fabricated. Pixel sizes are the smallest among similar pixels reported in the literature. Some computational photography applications were implemented using the two multi-bucket sensors to demonstrate their values in avoiding artifacts that would otherwise occur when a conventional sensor is used.


Per-Pixel Coded-Exposure CMOS Image Sensors

Per-Pixel Coded-Exposure CMOS Image Sensors

Author: Navid Sarhangnejad

Publisher:

Published: 2021

Total Pages: 0

ISBN-13:

DOWNLOAD EBOOK

The ever-growing demand for applications of cameras necessitate research not only on improving the performance of image sensors but also on new image sensor architectures. One of the most recent image sensor architectures, based on coded-exposure pixels (CEP), allows for the programmability of exposure time at the pixel level, and allows for imaging in new ways that were not possible so far. In this thesis, first a comparison of different photo-detectors is presented to highlight their operation principle as well as their capabilities. Five photo-detector architectures are simulated to compare the most important specifications in CEP cameras, namely sensitivity and tap-contrast. Next, a first prototype, a CEP image sensor based on photogate (PG) pixels, is presented. The sensor has a total resolution of 180x160 pixels and is fabricated in 0.35um CMOS technology. Dual-tap pixels with per-tap conversion gain are proposed, where the photogenerated charges in the pixel are collected in one of the taps based on the code stored in the pixel at each interval of the exposure. The second prototype is an image sensor based on pinned-photodiode (PPD) pixels. The sensor is fabricated in a 0.11um CMOS technology with the main array consisting of 244x162 pixels. The dual-tap pixel proposed in this work has the same conversion gain for the two taps but provides per-tap adjustable gain in the readout. The array operates at a maximum subframe rate of 180Hz, which is equivalent to 4 subframes per frame at 25fps considering the overhead time of frame readout. The sensor is deployed in two different single-shot 3D computational imaging techniques. Finally, an architecture based on global-shutter PPD pixels is presented allowing the implementation of smallest CEP pixels (7um pitch) reported to date. The sensor is fabricated in 0.11um CMOS technology with a resolution of 312x320 pixels. In the proposed pixel, a pinned storage diode operates as a charge memory to pipeline the charge generation and charge sorting operations. At a subframe rate of 2.7kHz, a reasonable tap-contrast of more than 90% is measured. Finally, a few different computational imaging techniques that are demonstrated with this camera are presented.


Computer Vision – ECCV 2018

Computer Vision – ECCV 2018

Author: Vittorio Ferrari

Publisher: Springer

Published: 2018-10-06

Total Pages: 891

ISBN-13: 3030012190

DOWNLOAD EBOOK

The sixteen-volume set comprising the LNCS volumes 11205-11220 constitutes the refereed proceedings of the 15th European Conference on Computer Vision, ECCV 2018, held in Munich, Germany, in September 2018.The 776 revised papers presented were carefully reviewed and selected from 2439 submissions. The papers are organized in topical sections on learning for vision; computational photography; human analysis; human sensing; stereo and reconstruction; optimization; matching and recognition; video attention; and poster sessions.


Smart CMOS Image Sensors and Applications

Smart CMOS Image Sensors and Applications

Author: Jun Ohta

Publisher: CRC Press

Published: 2020-05-12

Total Pages: 295

ISBN-13: 1498797342

DOWNLOAD EBOOK

Revised and expanded for this new edition, Smart CMOS Image Sensors and Applications, Second Edition is the only book available devoted to smart CMOS image sensors and applications. The book describes the fundamentals of CMOS image sensors and optoelectronic device physics, and introduces typical CMOS image sensor structures, such as the active pixel sensor (APS). Also included are the functions and materials of smart CMOS image sensors and present examples of smart imaging. Various applications of smart CMOS image sensors are also discussed. Several appendices supply a range of information on constants, illuminance, MOSFET characteristics, and optical resolution. Expansion of smart materials, smart imaging and applications, including biotechnology and optical wireless communication, are included. Features • Covers the fundamentals and applications including smart materials, smart imaging, and various applications • Includes comprehensive references • Discusses a wide variety of applications of smart CMOS image sensors including biotechnology and optical wireless communication • Revised and expanded to include the state of the art of smart image sensors


A Biologically Inspired CMOS Image Sensor

A Biologically Inspired CMOS Image Sensor

Author: Mukul Sarkar

Publisher: Springer

Published: 2012-12-14

Total Pages: 264

ISBN-13: 3642349013

DOWNLOAD EBOOK

Biological systems are a source of inspiration in the development of small autonomous sensor nodes. The two major types of optical vision systems found in nature are the single aperture human eye and the compound eye of insects. The latter are among the most compact and smallest vision sensors. The eye is a compound of individual lenses with their own photoreceptor arrays. The visual system of insects allows them to fly with a limited intelligence and brain processing power. A CMOS image sensor replicating the perception of vision in insects is discussed and designed in this book for industrial (machine vision) and medical applications. The CMOS metal layer is used to create an embedded micro-polarizer able to sense polarization information. This polarization information is shown to be useful in applications like real time material classification and autonomous agent navigation. Further the sensor is equipped with in pixel analog and digital memories which allow variation of the dynamic range and in-pixel binarization in real time. The binary output of the pixel tries to replicate the flickering effect of the insect’s eye to detect smallest possible motion based on the change in state. An inbuilt counter counts the changes in states for each row to estimate the direction of the motion. The chip consists of an array of 128x128 pixels, it occupies an area of 5 x 4 mm2 and it has been designed and fabricated in an 180nm CMOS CIS process from UMC.


Integrated CMOS Image Sensors for Computational Imaging

Integrated CMOS Image Sensors for Computational Imaging

Author: Sriram Sivaramakrishnan

Publisher:

Published: 2015

Total Pages: 262

ISBN-13:

DOWNLOAD EBOOK

Low cost cameras have proliferated in the last decade by taking advantage of the semiconductor technology (CMOS) used for the manufacture of computer processors and other integrated circuits. An image sensor is the key integrated circuit component in a camera that serves the role of faithfully recording the interaction of light with the world. Fabrication in a CMOS process allows a variety of passive and active components to be included with the image sensor. This manufacturing flexibility combined with increasing availability of computational power opens new possibilities for image sensing. This dissertation presents two CMOS image sensors intended not for direct image capture but to enable information processing tasks such as post-capture refocusing, depth mapping, feature extraction, optical flow, and velocimetry. A major portion of this thesis advances a recently introduced light sensing device, called angle sensitive pixel (ASP), which selectively responds to the local incident angle of light rays. Although the previously presented device enabled post-capture refocus and range finding by capturing light fields it was limited by its poor optical sensitivity due to its use of metallic gratings. In this work, I report on a new set of structures for angle detection with significantly better optical efficiency. For the fabrication of these devices, I develop a post-CMOS process flow for etching phase gratings at each pixel site and demonstrate its scalability on a 2.6 mm x 2 mm sensor. Further, the merits of an image sensor whose pixels possess carefully tailored angular responses is demonstrated by building an array of angle sensitive pixels to compute Gabor transforms in the optical domain. Images are captured by the sensor in the form of transform coefficients that readily lend themselves to data compression. An amplifier and analog-to-digital converter that exploit the sparsity of the image transform coefficients are included on the chip. I show how measurements captured by the sensor can be used to recover either a low-resolution 4D light field using fast, linear processing, or a high-resolution light field using sparsity-constrained optimization. In the latter part of this dissertation I present a CMOS image sensor for efficient computation of rotation parameters such as angular position and velocity. Unlike a conventional image sensors built using a rectangular grid of pixels, the array introduced here uses circular photodiodes arranged uniformly in polar coordinates to enable rapid image based measurements on revolving targets.


CMOS Imagers

CMOS Imagers

Author: Orly Yadid-Pecht

Publisher: Springer Science & Business Media

Published: 2007-05-08

Total Pages: 251

ISBN-13: 1402079621

DOWNLOAD EBOOK

The idea of writing a book on CMOS imaging has been brewing for several years. It was placed on a fast track after we agreed to organize a tutorial on CMOS sensors for the 2004 IEEE International Symposium on Circuits and Systems (ISCAS 2004). This tutorial defined the structure of the book, but as first time authors/editors, we had a lot to learn about the logistics of putting together information from multiple sources. Needless to say, it was a long road between the tutorial and the book, and it took more than a few months to complete. We hope that you will find our journey worthwhile and the collated information useful. The laboratories of the authors are located at many universities distributed around the world. Their unifying theme, however, is the advancement of knowledge for the development of systems for CMOS imaging and image processing. We hope that this book will highlight the ideas that have been pioneered by the authors, while providing a roadmap for new practitioners in this field to exploit exciting opportunities to integrate imaging and “smartness” on a single VLSI chip. The potential of these smart imaging systems is still unfulfilled. Hence, there is still plenty of research and development to be done.


High Performance Silicon Imaging

High Performance Silicon Imaging

Author: Daniel Durini

Publisher: Elsevier

Published: 2014-05-14

Total Pages: 479

ISBN-13: 0857097520

DOWNLOAD EBOOK

High Performance Silicon Imaging covers the fundamentals of silicon image sensors, with a focus on existing performance issues and potential solutions. The book considers several applications for the technology as well. Silicon imaging is a fast growing area of the semiconductor industry. Its use in cell phone cameras is already well established, and emerging applications include web, security, automotive, and digital cinema cameras. Part one begins with a review of the fundamental principles of photosensing and the operational principles of silicon image sensors. It then focuses in on charged coupled device (CCD) image sensors and complementary metal oxide semiconductor (CMOS) image sensors. The performance issues considered include image quality, sensitivity, data transfer rate, system level integration, rate of power consumption, and the potential for 3D imaging. Part two then discusses how CMOS technology can be used in a range of areas, including in mobile devices, image sensors for automotive applications, sensors for several forms of scientific imaging, and sensors for medical applications. High Performance Silicon Imaging is an excellent resource for both academics and engineers working in the optics, photonics, semiconductor, and electronics industries. Covers the fundamentals of silicon-based image sensors and technical advances, focusing on performance issues Looks at image sensors in applications such as mobile phones, scientific imaging, TV broadcasting, automotive, and biomedical applications


High Performance Silicon Imaging

High Performance Silicon Imaging

Author: Daniel Durini

Publisher: Woodhead Publishing

Published: 2019-10-19

Total Pages: 522

ISBN-13: 0081024355

DOWNLOAD EBOOK

High Performance Silicon Imaging: Fundamentals and Applications of CMOS and CCD Sensors, Second Edition, covers the fundamentals of silicon image sensors, addressing existing performance issues and current and emerging solutions. Silicon imaging is a fast growing area of the semiconductor industry. Its use in cell phone cameras is already well established, with emerging applications including web, security, automotive and digital cinema cameras. The book has been revised to reflect the latest state-of-the art developments in the field, including 3D imaging, advances in achieving lower signal noise, and new applications for consumer markets. The fundamentals section has also been expanded to include a chapter on the characterization and testing of CMOS and CCD sensors that is crucial to the success of new applications. This book is an excellent resource for both academics and engineers working in the optics, photonics, semiconductor and electronics industries. Covers the fundamentals of silicon-based image sensors and technical advances, focusing on performance issues Looks at image sensors in applications, such as mobile phones, scientific imaging, and TV broadcasting, and in automotive, consumer and biomedical applications Addresses the theory behind 3D imaging and 3D sensor development, including challenges and opportunities