Two researchers from the University of California, Davis have created a camera that uses a microlens array and new image processing algorithms to capture 3D photos in a single exposure.
Weijian Yang, Ph.D., and doctoral student Feng Tian say that because the camera is able to learn from existing data on how to digitally reconstruct a 3D scene it can produce these images in real-time, Phys reports.
“We consider our camera lensless because it replaces the bulk lenses used in conventional cameras with a thin, lightweight microlens array made of flexible polymer,” Yang says.
“Because each microlens can observe objects from different viewing angles, it can accomplish complex imaging tasks such as acquiring 3D information from objects partially obscured by objects closer to the camera.”
The duo say that the camera is especially useful for giving robots 3D vision, which would in turn allow them to better navigate spaces or perform complex tasks such as manipulating small or fine objects.
“It could also be used to acquire rich 3D information that could provide content for 3D displays used in gaming, entertainment or many other applications,” Yang adds.
The microlens array is made up of 37 smaller lenses that are distributed in an area just 12 millimeters in diameter. This array captures an entire scene and then a “simple and robust” physics-aware deep learning model depth-resolves photorealistic reconstructions in real-time.
“Our lensless imager does not require calibrating the point spread function and has the capability to resolve depth and ‘see-through’ opaque obstacles to image features being blocked, enabling broad applications in computational imaging,” the research paper, published on Optica, explains.
The resulting images can be refocused to different depths and distances and the camera can also create a depth map that the researchers confirm is in line with the actual arrangement of test objects.
“In a final demonstration we showed that our camera could image objects behind the opaque obstacles,” said Yang. “To the best of our knowledge, this is the first demonstration of imaging objects behind opaque obstacles using a lensless camera.”
The two researchers are currently refining the system to reduce artifacts and errors and will then work on miniaturizing the system to make it small enough to fit in a smartphone, greatly expanding its usability.
The full research paper titled Learned lensless 3D camera can be read on Optica.
Image credits: Left: Weijian Yang, Ph.D., and Feng Tian developed a camera that uses a thin microlens array and new image processing algorithms to capture 3D information about multiple objects in single exposure. The raw sub-images from the microarray are displayed on the monitor; Photo by Savannah Luy, University of California—Davis. | Right: “See through obstacles” experiment using the lensless camera via Learned lensless 3D camera.
Author: Jaron Schneider
Source: Petapixel
