LLM-Based Scheme for Synthesis of Formal Verification Algorithms

Itay Cohen; Doron Peled

doi:10.1007/978-3-031-75434-0_11

LLM-Based Scheme for Synthesis of Formal Verification Algorithms

Itay Cohen, Doron Peled

Department of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

The research of Large Language Models (LLMs) has significant ground to cover in the context of formal verification. In this work, we present a methodology that aims to increase the reliability of code synthesized through the use of LLMs. Our approach capitalizes on the intrinsic knowledge embedded within LLMs to achieve a more reliable code synthesis. We specifically illustrate the possibility of teaching model checking and runtime verification (RV) algorithms through our approach. Our experiments demonstrate that LLMs grasp the concept of dynamic programming, allowing them to synthesize code for these verification tasks with minimal guidance.

Original language	English
Title of host publication	Bridging the Gap Between AI and Reality - 2nd International Conference, AISoLA 2024, Proceedings
Editors	Bernhard Steffen
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	167-182
Number of pages	16
ISBN (Print)	9783031754333
DOIs	https://doi.org/10.1007/978-3-031-75434-0_11
State	Published - 2025
Event	2nd International Conference on Bridging the Gap Between AI and Reality, AISoLA 2024 - Crete, Greece Duration: 30 Oct 2024 → 3 Nov 2024

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	15217 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	2nd International Conference on Bridging the Gap Between AI and Reality, AISoLA 2024
Country/Territory	Greece
City	Crete
Period	30/10/24 → 3/11/24

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

Access to Document

10.1007/978-3-031-75434-0_11

Cite this

Cohen, I., & Peled, D. (2025). LLM-Based Scheme for Synthesis of Formal Verification Algorithms. In B. Steffen (Ed.), Bridging the Gap Between AI and Reality - 2nd International Conference, AISoLA 2024, Proceedings (pp. 167-182). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 15217 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-75434-0_11

Cohen, Itay ; Peled, Doron. / LLM-Based Scheme for Synthesis of Formal Verification Algorithms. Bridging the Gap Between AI and Reality - 2nd International Conference, AISoLA 2024, Proceedings. editor / Bernhard Steffen. Springer Science and Business Media Deutschland GmbH, 2025. pp. 167-182 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{b99962390f4c4268b285d13efdd2168a,

title = "LLM-Based Scheme for Synthesis of Formal Verification Algorithms",

abstract = "The research of Large Language Models (LLMs) has significant ground to cover in the context of formal verification. In this work, we present a methodology that aims to increase the reliability of code synthesized through the use of LLMs. Our approach capitalizes on the intrinsic knowledge embedded within LLMs to achieve a more reliable code synthesis. We specifically illustrate the possibility of teaching model checking and runtime verification (RV) algorithms through our approach. Our experiments demonstrate that LLMs grasp the concept of dynamic programming, allowing them to synthesize code for these verification tasks with minimal guidance.",

author = "Itay Cohen and Doron Peled",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.; 2nd International Conference on Bridging the Gap Between AI and Reality, AISoLA 2024 ; Conference date: 30-10-2024 Through 03-11-2024",

year = "2025",

doi = "10.1007/978-3-031-75434-0_11",

language = "אנגלית",

isbn = "9783031754333",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "167--182",

editor = "Bernhard Steffen",

booktitle = "Bridging the Gap Between AI and Reality - 2nd International Conference, AISoLA 2024, Proceedings",

address = "גרמניה",

}

Cohen, I & Peled, D 2025, LLM-Based Scheme for Synthesis of Formal Verification Algorithms. in B Steffen (ed.), Bridging the Gap Between AI and Reality - 2nd International Conference, AISoLA 2024, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 15217 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 167-182, 2nd International Conference on Bridging the Gap Between AI and Reality, AISoLA 2024, Crete, Greece, 30/10/24. https://doi.org/10.1007/978-3-031-75434-0_11

LLM-Based Scheme for Synthesis of Formal Verification Algorithms. / Cohen, Itay; Peled, Doron.
Bridging the Gap Between AI and Reality - 2nd International Conference, AISoLA 2024, Proceedings. ed. / Bernhard Steffen. Springer Science and Business Media Deutschland GmbH, 2025. p. 167-182 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 15217 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - LLM-Based Scheme for Synthesis of Formal Verification Algorithms

AU - Cohen, Itay

AU - Peled, Doron

PY - 2025

Y1 - 2025

N2 - The research of Large Language Models (LLMs) has significant ground to cover in the context of formal verification. In this work, we present a methodology that aims to increase the reliability of code synthesized through the use of LLMs. Our approach capitalizes on the intrinsic knowledge embedded within LLMs to achieve a more reliable code synthesis. We specifically illustrate the possibility of teaching model checking and runtime verification (RV) algorithms through our approach. Our experiments demonstrate that LLMs grasp the concept of dynamic programming, allowing them to synthesize code for these verification tasks with minimal guidance.

AB - The research of Large Language Models (LLMs) has significant ground to cover in the context of formal verification. In this work, we present a methodology that aims to increase the reliability of code synthesized through the use of LLMs. Our approach capitalizes on the intrinsic knowledge embedded within LLMs to achieve a more reliable code synthesis. We specifically illustrate the possibility of teaching model checking and runtime verification (RV) algorithms through our approach. Our experiments demonstrate that LLMs grasp the concept of dynamic programming, allowing them to synthesize code for these verification tasks with minimal guidance.

UR - http://www.scopus.com/inward/record.url?scp=85215817270&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-75434-0_11

DO - 10.1007/978-3-031-75434-0_11

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85215817270

SN - 9783031754333

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 167

EP - 182

BT - Bridging the Gap Between AI and Reality - 2nd International Conference, AISoLA 2024, Proceedings

A2 - Steffen, Bernhard

PB - Springer Science and Business Media Deutschland GmbH

T2 - 2nd International Conference on Bridging the Gap Between AI and Reality, AISoLA 2024

Y2 - 30 October 2024 through 3 November 2024

ER -

Cohen I, Peled D. LLM-Based Scheme for Synthesis of Formal Verification Algorithms. In Steffen B, editor, Bridging the Gap Between AI and Reality - 2nd International Conference, AISoLA 2024, Proceedings. Springer Science and Business Media Deutschland GmbH. 2025. p. 167-182. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-75434-0_11