Panasonic has announced that it has developed a new sensor using Organic Photoconductive Film (OPF), developed by Fujifilm, that is capable of recording a much wider range of tones (up to 3 EV greater dynamic range) than current silicon-based sensors, and in which each pixel is read out simultaneously to effect a true global shutter.
We first heard about this collaboration back in 2013, and it appears that the companies have made progress during that time. Similar to InVisage Quantum Film technology, the OPF sensor employs a thin, light-sensitive film on top of CMOS silicon circuitry. Panasonic says that the separation of the light conversion medium and electronic charge storage removes some design trade-offs that need to be made with conventional CMOS designs. The design allows for a larger active pixel area that makes it 1.2x more sensitive to light than normal photodiodes. Decoupling the photoconversion and storage areas also allows for the ability to store more total charge (higher full well capacity), resulting in 10x, or 3 EV, greater dynamic range.
Additionally, the OPF layer is only 0.5 microns thick, or four to six times thinner than silicon photodiodes that are typically 2-3 microns in depth. According to Panasonic this expands the incident angle of light that can be collected to 60 degrees, compared to 30-40 degrees for conventional silicon sensors, which should allow greater flexibility in lens design. It should also help reduce false color and vignetting.
In addition to better sensitivity and dynamic range, the new technology brings other benefits as well. In particular, the OPF-based sensor will provide global shutter, by allowing all pixels to be exposed essentially at the same time by turning on and off the entire photosensitive area at once. The net effect is that all the lines of the sensor are essentially exposed simultaneously, as opposed to line-by-line as is the case with traditional ‘rolling’ electronic shutters. This helps avoid the dreaded ‘jello effect’ often seen in video, or the distortion of fast moving objects. It also helps avoid flickering and banding with artificial light sources, which with a ‘rolling’ shutter otherwise result in different rows on the sensor being exposed while the pulsating light source is on vs. off.
When combined with Panasonic’s historical strength in video-oriented products this will likely get the attention of the videography crowd. The potential benefits don’t stop there though. Panasonic has also developed a method of recording sequences of images at slightly different exposure values, that it calls Variable Sensitivity Multiple Exposure Technology. The process can track the direction of motion in the scene by tracing the subject as it moves across the scene becoming gradually darker from one frame to the next. If the camera knows it applied less exposure to the second frame than to the first, it can determine in which direction the subject is moving and at what speed. This could be of great assistance to AF algorithms.
The company is not absolutely clear about what practical uses it will put this new sensor to, but says ‘We expect this technology to be used widely in motion capture applications and also extend to other applications that have been thought to be difficult to realize unless high saturation global shutter or variable sensitivity multiple exposure.’ Panasonic is also developing a system for using cameras that replace wing mirrors in cars, and this technology will probably see the light of day in that area first, but the lessons learned will be very useful for its regular camera business.
Panasonic develops 10times Higher Saturation & Highly Functional Global Shutter Technology by controlling of Organic-Photoconductive-Film on CMOS Image Sensor
Osaka, Japan – Panasonic Corporation today announced that it has developed a new highly functional global shutter[1] technology for CMOS image sensor using organic photoconductive film (OPF)*1. This technology enables to capture high speed moving object up to 10 times brighter*2 scene in global shutter mode. In OPF CMOS image sensor, charge-storage function and photoelectric-conversion function can be set independently. By utilizing the unique feature of OPF CMOS image sensor, this technology solves the degradation of saturation signal[2] in conventional image sensor with global shutter function. Motion direction can be detected from acquired object’s signal level in one picture by fine control of shutter sensitivity by changing applied voltage to OPF which is hardly realized by conventional CMOS image sensors.
The newly developed highly functional global shutter technology contributes to high speed image sensing of moving objects without image distortion which appears in conventional shutter operation under very bright scene. We expect this technology to be used widely in motion capture applications and also extend to other applications that have been thought to be difficult to realize unless high saturation global shutter or variable sensitivity multiple exposure.
The new technology has the following advantages.
1. Wide incident angle (60 degrees), high sensitivity, high saturation and highly-functional circuits due to a unique feature of OPF, in which an OPF for photoelectric-conversion and a readout circuits are independent.
2. High saturation signal up to 10 times larger*3 than conventional image sensors with global shutter function due to Photoelectric Conversion Controlled Global Shutter Technology.
This development is based on the following new technologies.
1. CMOS Image Sensor Design Technology, in that, an OPF photoelectric-conversion part and a circuit part can be designed independently.
2. Photoelectric Conversion Controlled Global Shutter Technology that is realized by controlling of organic photoconductive film sensitivity.
3. Variable Sensitivity Multiple Exposure Technology which can detect the motion and its direction by changing image capturing sensitivity in each frame.
Panasonic holds 60 Japanese patents and 41 overseas patents (including pending) related to this technology.
Panasonic will present part of the research at the international conference ISSCC (International Solid-State Circuit Conference) 2016 which is to be held in San Francisco, USA on January 31 to February 4.
Notes:
*1: We are using an organic photoconductive film (OPF) that FUJIFILM Corporation has developed.
*2: Saturation signal per pixel area, compared with conventional silicon based CMOS image sensor with global shutter function.
More on the Technology
1. The OPF CMOS Image Sensor Design Technology, in that, photoelectric-conversion part and a circuit part can be designed independently.
The conventional image sensor consists of a silicon photodiode for capturing light, metal interconnects and an on-chip micro-lens. And, both a photoelectric-conversion function and a signal charge-storage function are executed by a silicon photodiode. On the other hand, in an OPF CMOS image sensor, a photoelectric-conversion function is executed by an OPF, instead of a silicon photodiode, and a signal charge-storage function is executed by circuits beneath the OPF. Both functions are almost independent, so an OPF CMOS image sensor can achieve the following features.
Expansion of the incident light range to 60 degrees and reproduction of faithful color.
An OPF with high optical absorption coefficient[3], instead of a silicon photodiode, is adopted, the thickness of an OPF has been reduced to just 0.5 microns, four to six times thinner than silicon photodiodes. Since the conventional silicon photodiode needs at least 2 – 3 microns in depth, the range of incident angles was limited to around 30 – 40 degrees. An OPF, achieved with the OPF CMOS image sensor technology, has enabled the expansion of this range to 60 degrees, efficiently utilizing light entering at an angle for faithful color reproduction with no color mixing. It also gives greater flexibility in lens designs, facilitating the reduction of overall camera size.
Boost of sensor sensitivity by 1.2 times compared to conventional silicon image sensors to deliver clear images, particularly in dark conditions.
The transistors and metal interconnects in each pixel, fabricated using Panasonic’s semiconductor device technology, are coated with an OPF. The area of the light receiving section becomes limited in conventional image sensors because of the existence of metal interconnects and the need to form a light shield film to prevent light incidence into areas other than the photodiode in each pixel. However, an OPF CMOS image sensor technology coats the sensor with an OPF, which can harvest all the light received on the sensor. This unique structure and high quantum efficiency of OPF boosts sensor sensitivity by 1.2 times compared to conventional silicon image sensors to deliver clear images, particularly in dark conditions.
Cross-sectional image of conventional Back Side Illumination (BSI) CMOS image sensor and OPF CMOS image Sensor
Design of OPF and circuits completely independent and realization of high-performance (high-saturation)
In the architecture of an OPF CMOS image sensor, the OPF, that converts light into electric signals, and the circuits, that store electric signal charges and readout electric signals, are designed completely independently. Therefore, by selecting an OPF, photoelectric-conversion characteristics, wavelength, sensitivity, etc., can be set with flexibility.
Moreover, in conventional image sensors, it is necessary to place both a silicon photodiode and circuits (transistors and capacitors) on silicon substrate in each pixel, so an area of circuits is limited. On the other hand, in an OPF CMOS image sensor, it is not necessary to place a silicon photodiode, so high-performance circuits, such as high-speed or wide dynamic range[4], can be formed on a silicon substrate.
In particular, in an OPF CMOS image sensor, by providing a large capacitor for storing signal charge, a saturation value[2] of electric signal can be significantly increased from conventional image sensors.
2. Photoelectric Conversion Controlled Global Shutter Technology that is realized by controlling of organic photoconductive film sensitivity.
Conventional CMOS image sensors with global shutter function require storage located near photoconversion area which makes it difficult to simultaneously shrink the pixel size and enlarge the saturation signal. Developed “Photoelectric conversion controlled global shutter technology” realizes shutter function by controlling of photoelectric conversion efficiency by only modulating applied voltage to OPF, without additional in-pixel circuit and no degradation of saturation signal. And developed “high saturation pixel technology” by pixel gain switching operation can capture under extremely bright scene, up to 10 times or more saturation signal per unit square pixel than conventional CMOS image sensor with global shutter function. This technology will solve imaging problems caused by rolling shutter distortion, flash bands[5] and LED flickers[6] in very bright scene.
Comparison of Global shutter pixel structure
3. Variable Sensitivity Multiple Exposure Technology which can detect the motion and its direction by changing image capturing sensitivity in each frame.
Conventional multiple exposure cannot detect the direction of motion because the capture sensitivity is fixed. Panasonic have developed “variable sensitivity multiple exposure technology” by controlling the voltage applied to OPF with elapse of time, which is hardly realized in conventional silicon based image sensor. We can get several images of different exposure time and different exposure sensitivity in one picture that enables character recognition by choosing optimum exposure time, so direction of motion can be detected by acquired object’s signal level. This technology enables sensing of moving object detection and motion directions.
Technical Terms:
[1] Global shutter
Shutter operation which can capture the image at the same time in all pixels.
Ordinary CMOS image sensor operates in rolling shutter mode in which exposure and shutter operation is executed row by row.
[2] Saturation/Saturation signals
Maximum amount of electric signal that can be handled by image sensors. Receiving a signal greater than this value leads to highlight clipping.
[3] Optical absorption coefficient
A constant value that indicates how much light is absorbed into a material, when incident light enter to the material.
[4] Dynamic range
Range of brightness that can be captured. (the ratio between highest and lowest signal can be captured by image sensor)
[5] Flash band
stripe shaped contrast appears in captured image, because light flashes during image sensor capture the image row by row pixel (rolling shutter operation).
[6] LED flicker
Imaging phenomenon resulting in incomplete image capture, caused by a LED’s (traffic, headlights, signs, etc.) frequency and a camera’s imaging speed.
Captured images of rotating propeller by different shutter mode
Multiple exposure images by Variable exposure time and sensitivity
You must be logged in to post a comment.