Geometric deep optical sensing

Shaofan Yuan, Chao Ma, Ethan Fetaya, Thomas Mueller, Doron Naveh, Fan Zhang, Fengnian Xia

Research output: Contribution to journalReview articlepeer-review


Geometry, an ancient yet vibrant branch of mathematics, has important and far-reaching impacts on various disciplines such as art, science, and engineering. Here, we introduce an emerging concept dubbed “geometric deep optical sensing” that is based on a number of recent demonstrations in advanced optical sensing and imaging, in which a reconfigurable sensor (or an array thereof) can directly decipher the rich information of an unknown incident light beam, including its intensity, spectrum, polarization, spatial features, and possibly angular momentum. We present the physical, mathematical, and engineering foundations of this concept, with particular emphases on the roles of classical and quantum geometry and deep neural networks. Furthermore, we discuss the new opportunities that this emerging scheme can enable and the challenges associated with future developments.

Original languageEnglish
Article numbereade1220
Issue number6637
StatePublished - 17 Mar 2023

Bibliographical note

Funding Information:
T.M. acknowledges support from the European Union (grant agreement no. 785219 Graphene Flagship). F.Z. acknowledges support from the Army Research Office under grant number W911NF-18-1-0416 and the National Science Foundation (NSF) under grant numbers DMR-1945351 through the Faculty Early Career Development Program (CAREER), DMR-2105139 through the Condensed Matter Physics (CMP) program, and DMR-1921581 through the Designing Materials to Revolutionize and Engineer our Future (DMREF) program. F.X., S.Y., and C.M. acknowledge support from the NSF Emerging Frontiers in Research and Innovation (EFRI) NewLAW program under grant number 1741693, NSF grant 2150561, the Yale Raymond John Wean Foundation, and the government of Israel. D.N. acknowledges support from the Binational Science Foundation under Electrical, Communications, and Cyber Systems (ECCS) grant NSF-BSF 2021721.

Publisher Copyright:
Copyright © 2023 The Authors, some rights reserved.


Dive into the research topics of 'Geometric deep optical sensing'. Together they form a unique fingerprint.

Cite this