Skip to main navigation Skip to search Skip to main content

NEUSIS: A Compositional Neuro-Symbolic Framework for Autonomous Perception, Reasoning, and Planning in Complex UAV Search Missions

  • Zhixi Cai
  • , Cristian Rojas Cardenas
  • , Kevin Leo
  • , Chenyuan Zhang
  • , Kal Backman
  • , Hanbing Li
  • , Boying Li
  • , Mahsa Ghorbanali
  • , Stavya Datta
  • , Lizhen Qu
  • , Julian Gutierrez
  • , Alexey Ignatiev
  • , Yuan Fang Li
  • , Mor Vered
  • , Peter J. Stuckey
  • , Maria Garcia De La Banda
  • , Hamid Rezatofighi
  • Monash University
  • University of Sussex

Research output: Contribution to journal › Article › peer-review

7 Scopus citations

Abstract

This letter addresses the problem of autonomous UAV search missions, where a UAV must locate specific Entities of Interest (EOIs) within a time limit, based on brief descriptions in large, hazard-prone environments with keep-out zones. The UAV must perceive, reason, and make decisions with limited and uncertain information. We propose NEUSIS, a compositional neuro-symbolic system designed for effective UAV search and navigation in realistic scenarios. NEUSIS integrates neuro-symbolic visual perception, reasoning, and grounding (GRiD) to process raw sensory inputs, maintains a probabilistic world model for environment representation, and uses a hierarchical planning component (SNaC) for efficient path planning. Experimental results from simulated urban search missions using AirSim and Unreal Engine show that NEUSIS outperforms state-of-the-art baselines for both perception and planning. These results demonstrate the effectiveness of our compositional neuro-symbolic approach in handling complex scenarios, making it a promising solution for autonomous UAV systems in search missions.

Original languageEnglish
Pages (from-to)9502-9509
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume10
Issue number9
DOIs
StatePublished - 2025
Externally publishedYes

Bibliographical note

Publisher Copyright:
© IEEE. 2016 IEEE.

Keywords

  • Aerial systems: perception and autonomy
  • planning under uncertainty
  • recognition

Fingerprint

Dive into the research topics of 'NEUSIS: A Compositional Neuro-Symbolic Framework for Autonomous Perception, Reasoning, and Planning in Complex UAV Search Missions'. Together they form a unique fingerprint.

Cite this