Deep learning method for pinhole array color image reconstruction

Eliezer Danan, Noa E. Cohen, Ariel Schwarz, Amir Shemer, Yossef Danan

Research output: Contribution to journalArticlepeer-review


The following paper proposes a combination of a supervised encoder-decoder neural network with coded apertures. Coded apertures provide improved sensitivity and signal-to-noise ratio (SNR) in planar images. The unique array design of this method overcomes the spatial frequency cutoff found in standard multi-pinhole arrays. In this design, the pinholes were positioned to minimize loss in spatial frequencies. The large number of pinholes results in significant overlapping on the detector. To overcome the overlapping issue, reconstruction of the object from the obtained image is done using inverse filtering methods. However, traces of duplications remain leading to a decline in SNR, contrast, and resolution. The proposed technique addresses the challenge of image distortion caused by the lack of accuracy in the inverse filter methods, by using a deep neural network. In this work, the coded aperture is combined with a deep convolutional neural network (CNN) to remove noise caused by pinhole imaging and inverse filter limitations. Compared to only using Wiener filtering, the proposed method delivers higher SNR, contrast, and resolution. The imaging system is presented in detail with experimental results that illustrate its efficiency.

Original languageEnglish
Pages (from-to)1116-1119
Number of pages4
JournalOptics Letters
Issue number5
StatePublished - 1 Mar 2023
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2023 Optica Publishing Group.


Dive into the research topics of 'Deep learning method for pinhole array color image reconstruction'. Together they form a unique fingerprint.

Cite this