Image Restoration by Iterative Denoising and Backward Projections

Tom Tirer, Raja Giryes

Research output: Contribution to journalArticlepeer-review

170 Scopus citations

Abstract

Inverse problems appear in many applications, such as image deblurring and inpainting. The common approach to address them is to design a specific algorithm for each problem. The Plug-and-Play (PP) framework, which has been recently introduced, allows solving general inverse problems by leveraging the impressive capabilities of existing denoising algorithms. While this fresh strategy has found many applications, a burdensome parameter tuning is often required in order to obtain high-quality results. In this paper, we propose an alternative method for solving inverse problems using off-the-shelf denoisers, which requires less parameter tuning. First, we transform a typical cost function, composed of fidelity and prior terms, into a closely related, novel optimization problem. Then, we propose an efficient minimization scheme with a PP property, i.e., the prior term is handled solely by a denoising operation. Finally, we present an automatic tuning mechanism to set the method's parameters. We provide a theoretical analysis of the method and empirically demonstrate its competitiveness with task-specific techniques and the PP approach for image inpainting and deblurring.

Original languageEnglish
Article number8489894
Pages (from-to)1220-1234
Number of pages15
JournalIEEE Transactions on Image Processing
Volume28
Issue number3
DOIs
StatePublished - Mar 2019
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 1992-2012 IEEE.

Funding

Manuscript received January 3, 2018; revised June 13, 2018 and August 25, 2018; accepted September 27, 2018. Date of publication October 11, 2018; date of current version November 2, 2018. This work was supported by the European Research Council under Grant ERC StG 757497 PI Giryes. The associate editor coordinating the review of this manuscript and approving it for publication was Dr. Zhengguo LI. (Corresponding author: Tom Tirer.) The authors are with the School of Electrical Engineering, Tel Aviv University, Tel Aviv 69978, Israel (e-mail: [email protected]; raja@tauex. tau.ac.il).

FundersFunder number
Horizon 2020 Framework Programme757497
European Commission

    Keywords

    • Plug-and-play
    • denoising neural network
    • image deblurring
    • image denoising
    • image inpainting
    • image restoration
    • inverse problems

    Fingerprint

    Dive into the research topics of 'Image Restoration by Iterative Denoising and Backward Projections'. Together they form a unique fingerprint.

    Cite this