Geometric deep optical sensing

Shaofan Yuan; Chao Ma; Ethan Fetaya; Thomas Mueller; Doron Naveh; Fan Zhang; Fengnian Xia

doi:10.1126/science.ade1220

Geometric deep optical sensing

Shaofan Yuan, Chao Ma, Ethan Fetaya, Thomas Mueller, Doron Naveh, Fan Zhang, Fengnian Xia

Bar-Ilan University - The Alexander Kofkin Faculty of Engineering

Research output: Contribution to journal › Review article › peer-review

31 Scopus citations

Abstract

Geometry, an ancient yet vibrant branch of mathematics, has important and far-reaching impacts on various disciplines such as art, science, and engineering. Here, we introduce an emerging concept dubbed “geometric deep optical sensing” that is based on a number of recent demonstrations in advanced optical sensing and imaging, in which a reconfigurable sensor (or an array thereof) can directly decipher the rich information of an unknown incident light beam, including its intensity, spectrum, polarization, spatial features, and possibly angular momentum. We present the physical, mathematical, and engineering foundations of this concept, with particular emphases on the roles of classical and quantum geometry and deep neural networks. Furthermore, we discuss the new opportunities that this emerging scheme can enable and the challenges associated with future developments.

Original language	English
Article number	eade1220
Journal	Science
Volume	379
Issue number	6637
DOIs	https://doi.org/10.1126/science.ade1220
State	Published - 17 Mar 2023

Bibliographical note

Publisher Copyright:
Copyright © 2023 The Authors, some rights reserved.

Funding

T.M. acknowledges support from the European Union (grant agreement no. 785219 Graphene Flagship). F.Z. acknowledges support from the Army Research Office under grant number W911NF-18-1-0416 and the National Science Foundation (NSF) under grant numbers DMR-1945351 through the Faculty Early Career Development Program (CAREER), DMR-2105139 through the Condensed Matter Physics (CMP) program, and DMR-1921581 through the Designing Materials to Revolutionize and Engineer our Future (DMREF) program. F.X., S.Y., and C.M. acknowledge support from the NSF Emerging Frontiers in Research and Innovation (EFRI) NewLAW program under grant number 1741693, NSF grant 2150561, the Yale Raymond John Wean Foundation, and the government of Israel. D.N. acknowledges support from the Binational Science Foundation under Electrical, Communications, and Cyber Systems (ECCS) grant NSF-BSF 2021721.

Funders	Funder number
NSF-BSF	2021721
Yale Raymond John Wean Foundation
Government of Israel
National Science Foundation	DMR-1945351, DMR-2105139, DMR-1921581
Division of Emerging Frontiers in Research and Innovation	2150561, 1741693
Army Research Office	W911NF-18-1-0416
European Commission	785219
United States-Israel Binational Science Foundation

Access to Document

10.1126/science.ade1220

Cite this

@article{9cd7222d4391403ea00d24301ff8caec,

title = "Geometric deep optical sensing",

abstract = "Geometry, an ancient yet vibrant branch of mathematics, has important and far-reaching impacts on various disciplines such as art, science, and engineering. Here, we introduce an emerging concept dubbed “geometric deep optical sensing” that is based on a number of recent demonstrations in advanced optical sensing and imaging, in which a reconfigurable sensor (or an array thereof) can directly decipher the rich information of an unknown incident light beam, including its intensity, spectrum, polarization, spatial features, and possibly angular momentum. We present the physical, mathematical, and engineering foundations of this concept, with particular emphases on the roles of classical and quantum geometry and deep neural networks. Furthermore, we discuss the new opportunities that this emerging scheme can enable and the challenges associated with future developments.",

author = "Shaofan Yuan and Chao Ma and Ethan Fetaya and Thomas Mueller and Doron Naveh and Fan Zhang and Fengnian Xia",

note = "Publisher Copyright: Copyright {\textcopyright} 2023 The Authors, some rights reserved.",

year = "2023",

month = mar,

day = "17",

doi = "10.1126/science.ade1220",

language = "אנגלית",

volume = "379",

journal = "Science",

issn = "0036-8075",

publisher = "American Association for the Advancement of Science",

number = "6637",

}

TY - JOUR

T1 - Geometric deep optical sensing

AU - Yuan, Shaofan

AU - Ma, Chao

AU - Fetaya, Ethan

AU - Mueller, Thomas

AU - Naveh, Doron

AU - Zhang, Fan

AU - Xia, Fengnian

PY - 2023/3/17

Y1 - 2023/3/17

N2 - Geometry, an ancient yet vibrant branch of mathematics, has important and far-reaching impacts on various disciplines such as art, science, and engineering. Here, we introduce an emerging concept dubbed “geometric deep optical sensing” that is based on a number of recent demonstrations in advanced optical sensing and imaging, in which a reconfigurable sensor (or an array thereof) can directly decipher the rich information of an unknown incident light beam, including its intensity, spectrum, polarization, spatial features, and possibly angular momentum. We present the physical, mathematical, and engineering foundations of this concept, with particular emphases on the roles of classical and quantum geometry and deep neural networks. Furthermore, we discuss the new opportunities that this emerging scheme can enable and the challenges associated with future developments.

AB - Geometry, an ancient yet vibrant branch of mathematics, has important and far-reaching impacts on various disciplines such as art, science, and engineering. Here, we introduce an emerging concept dubbed “geometric deep optical sensing” that is based on a number of recent demonstrations in advanced optical sensing and imaging, in which a reconfigurable sensor (or an array thereof) can directly decipher the rich information of an unknown incident light beam, including its intensity, spectrum, polarization, spatial features, and possibly angular momentum. We present the physical, mathematical, and engineering foundations of this concept, with particular emphases on the roles of classical and quantum geometry and deep neural networks. Furthermore, we discuss the new opportunities that this emerging scheme can enable and the challenges associated with future developments.

UR - http://www.scopus.com/inward/record.url?scp=85150311964&partnerID=8YFLogxK

U2 - 10.1126/science.ade1220

DO - 10.1126/science.ade1220

M3 - ???researchoutput.researchoutputtypes.contributiontojournal.systematicreview???

C2 - 36927029

AN - SCOPUS:85150311964

SN - 0036-8075

VL - 379

JO - Science

JF - Science

IS - 6637

M1 - eade1220

ER -

Geometric deep optical sensing

Abstract

Bibliographical note

Funding

Access to Document

Other files and links

Fingerprint

Cite this