Abstract
Learning-enabled autonomous systems (LEAS) use machine learning (ML) components for essential functions of autonomous operation, such as perception and control. LEAS are often safety-critical. The development and integration of trustworthy ML components present new challenges that extend beyond the boundaries of system’s design to the system’s operation in its real environment. This paper introduces the methodology and tools developed within the frame of the FOCETA European project towards the continuous engineering of trustworthy LEAS. Continuous engineering includes iterations between two alternating phases, namely: (i) design and virtual testing, and (ii) deployment and operation. Phase (i) encompasses the design of trustworthy ML components and the system’s validation with respect to formal specifications of its requirements via modeling and simulation. An integral part of both the simulation-based testing and the operation of LEAS is the monitoring and enforcement of safety, security and performance properties and the acquisition of information for the system’s operation in its environment. Finally, we show how the FOCETA approach has been applied to realistic continuous engineering workflowsfor three different LEAS from automotive and medical application domains.
Original language | English |
---|---|
Title of host publication | Bridging the Gap Between AI and Reality - 1st International Conference, AISoLA 2023, Proceedings |
Editors | Bernhard Steffen |
Publisher | Springer Science and Business Media Deutschland GmbH |
Pages | 256-278 |
Number of pages | 23 |
ISBN (Print) | 9783031460012 |
DOIs | |
State | Published - 2024 |
Event | 1st International Conference on Bridging the Gap between AI and Reality, AISoLA 2023 - Crete, Greece Duration: 23 Oct 2023 → 28 Oct 2023 |
Publication series
Name | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
---|---|
Volume | 14380 LNCS |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Conference
Conference | 1st International Conference on Bridging the Gap between AI and Reality, AISoLA 2023 |
---|---|
Country/Territory | Greece |
City | Crete |
Period | 23/10/23 → 28/10/23 |
Bibliographical note
Publisher Copyright:© 2024, The Author(s).
Funding
This project has received funding from the European Unions Horizon 2020 research and innovation programme under grant agreement No 956123.
Funders | Funder number |
---|---|
Horizon 2020 | 956123 |
Keywords
- Learning-enabled Autonomous Systems
- continuous engineering
- formal analysis
- machine learning
- safety
- security