The Power of Reframing: Using LLMs in Synthesizing RV Monitors

Itay Cohen; Klaus Havelund; Doron Peled; Yoav Goldberg

doi:10.1007/978-3-032-05435-7_12

The Power of Reframing: Using LLMs in Synthesizing RV Monitors

Itay Cohen
, Klaus Havelund
, Doron Peled
, Yoav Goldberg

Department of Computer Science

California Institute of Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

We present a method and an interactive tool named LLMon that utilizes an LLM for synthesizing RV monitors from temporal or natural language (NL) specifications. Our focus is on allowing the flexibility of defining further temporal constructs on top of the standard ones; it helps to better customize the temporal formalism for expressing requirements originally given in NL. Our method allows the user to define new temporal operators through interaction with the tool. The LLM reframes the given descriptions of new operators, provided by the user in natural language, and synthesizes code for each alternative description. It performs analysis that compares the alternative generated codes, based on searching for traces with distinguishing verdicts. It then generates verbal descriptions that help the user to select the correct semantic interpretation. The tool can be used to synthesize monitors either directly from specifications in the extended temporal logic, or from NL descriptions.

Original language	English
Title of host publication	Runtime Verification - 25th International Conference, RV 2025, Proceedings
Editors	Bettina Könighofer, Hazem Torfah
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	202-212
Number of pages	11
ISBN (Print)	9783032054340
DOIs	https://doi.org/10.1007/978-3-032-05435-7_12
State	Published - 2026
Event	25th International Conference on Runtime Verification, RV 2025 - Graz, Austria Duration: 15 Sep 2025 → 19 Sep 2025

Publication series

Name	Lecture Notes in Computer Science
Volume	16087 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	25th International Conference on Runtime Verification, RV 2025
Country/Territory	Austria
City	Graz
Period	15/09/25 → 19/09/25

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2026.

Access to Document

10.1007/978-3-032-05435-7_12

Cite this

Cohen, I., Havelund, K., Peled, D., & Goldberg, Y. (2026). The Power of Reframing: Using LLMs in Synthesizing RV Monitors. In B. Könighofer, & H. Torfah (Eds.), Runtime Verification - 25th International Conference, RV 2025, Proceedings (pp. 202-212). (Lecture Notes in Computer Science; Vol. 16087 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-032-05435-7_12

@inproceedings{14c36d42ed894c619d5dc20228846622,

title = "The Power of Reframing: Using LLMs in Synthesizing RV Monitors",

abstract = "We present a method and an interactive tool named LLMon that utilizes an LLM for synthesizing RV monitors from temporal or natural language (NL) specifications. Our focus is on allowing the flexibility of defining further temporal constructs on top of the standard ones; it helps to better customize the temporal formalism for expressing requirements originally given in NL. Our method allows the user to define new temporal operators through interaction with the tool. The LLM reframes the given descriptions of new operators, provided by the user in natural language, and synthesizes code for each alternative description. It performs analysis that compares the alternative generated codes, based on searching for traces with distinguishing verdicts. It then generates verbal descriptions that help the user to select the correct semantic interpretation. The tool can be used to synthesize monitors either directly from specifications in the extended temporal logic, or from NL descriptions.",

author = "Itay Cohen and Klaus Havelund and Doron Peled and Yoav Goldberg",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2026.; 25th International Conference on Runtime Verification, RV 2025 ; Conference date: 15-09-2025 Through 19-09-2025",

year = "2026",

doi = "10.1007/978-3-032-05435-7\_12",

language = "אנגלית",

isbn = "9783032054340",

series = "Lecture Notes in Computer Science",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "202--212",

editor = "Bettina K{\"o}nighofer and Hazem Torfah",

booktitle = "Runtime Verification - 25th International Conference, RV 2025, Proceedings",

address = "גרמניה",

}

Cohen, I, Havelund, K, Peled, D & Goldberg, Y 2026, The Power of Reframing: Using LLMs in Synthesizing RV Monitors. in B Könighofer & H Torfah (eds), Runtime Verification - 25th International Conference, RV 2025, Proceedings. Lecture Notes in Computer Science, vol. 16087 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 202-212, 25th International Conference on Runtime Verification, RV 2025, Graz, Austria, 15/09/25. https://doi.org/10.1007/978-3-032-05435-7_12

The Power of Reframing: Using LLMs in Synthesizing RV Monitors. / Cohen, Itay; Havelund, Klaus; Peled, Doron et al.
Runtime Verification - 25th International Conference, RV 2025, Proceedings. ed. / Bettina Könighofer; Hazem Torfah. Springer Science and Business Media Deutschland GmbH, 2026. p. 202-212 (Lecture Notes in Computer Science; Vol. 16087 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - The Power of Reframing

T2 - 25th International Conference on Runtime Verification, RV 2025

AU - Cohen, Itay

AU - Havelund, Klaus

AU - Peled, Doron

AU - Goldberg, Yoav

PY - 2026

Y1 - 2026

N2 - We present a method and an interactive tool named LLMon that utilizes an LLM for synthesizing RV monitors from temporal or natural language (NL) specifications. Our focus is on allowing the flexibility of defining further temporal constructs on top of the standard ones; it helps to better customize the temporal formalism for expressing requirements originally given in NL. Our method allows the user to define new temporal operators through interaction with the tool. The LLM reframes the given descriptions of new operators, provided by the user in natural language, and synthesizes code for each alternative description. It performs analysis that compares the alternative generated codes, based on searching for traces with distinguishing verdicts. It then generates verbal descriptions that help the user to select the correct semantic interpretation. The tool can be used to synthesize monitors either directly from specifications in the extended temporal logic, or from NL descriptions.

AB - We present a method and an interactive tool named LLMon that utilizes an LLM for synthesizing RV monitors from temporal or natural language (NL) specifications. Our focus is on allowing the flexibility of defining further temporal constructs on top of the standard ones; it helps to better customize the temporal formalism for expressing requirements originally given in NL. Our method allows the user to define new temporal operators through interaction with the tool. The LLM reframes the given descriptions of new operators, provided by the user in natural language, and synthesizes code for each alternative description. It performs analysis that compares the alternative generated codes, based on searching for traces with distinguishing verdicts. It then generates verbal descriptions that help the user to select the correct semantic interpretation. The tool can be used to synthesize monitors either directly from specifications in the extended temporal logic, or from NL descriptions.

UR - https://www.scopus.com/pages/publications/105016708644

U2 - 10.1007/978-3-032-05435-7_12

DO - 10.1007/978-3-032-05435-7_12

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:105016708644

SN - 9783032054340

T3 - Lecture Notes in Computer Science

SP - 202

EP - 212

BT - Runtime Verification - 25th International Conference, RV 2025, Proceedings

A2 - Könighofer, Bettina

A2 - Torfah, Hazem

PB - Springer Science and Business Media Deutschland GmbH

Y2 - 15 September 2025 through 19 September 2025

ER -