Optimizing Source Localization via Reinforcement Learning in Multi-Agent Underwater Networks

  • J. Moos Middelkoop
  • , Federico Celi
  • , Alessandro Faggiani
  • , Hilde Hummel
  • , Sandjai Bhulai
  • , Alessandra Tesei
  • , Robert Been
  • , Gabriele Ferri

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

In this paper, we propose a novel approach to multi-agent underwater source localization by means of Multi-Agent Reinforcement Learning (MARL). Our framework optimizes the trajectories of two autonomous underwater vehicles, each towing an antenna, to maximize the probability of detection of the source. We implement a shared-parameter MARL strategy with non-synchronous actions to address the challenges posed by non-stationary multi-agent environments. We train a neural network on a simplified simulation environment and evaluate it in a realistic simulation engine, demonstrating robustness to communication losses of up to 60%. Our preliminary results indicate that RL-based trajectory optimization can achieve comparable performance to traditional approaches.

Original languageEnglish
Title of host publicationOCEANS 2025 Brest
Subtitle of host publication[Proceedings]
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-10
Number of pages10
ISBN (Electronic)9798331537470
ISBN (Print)9798331537487
DOIs
Publication statusPublished - 2025
EventOCEANS 2025 Brest, OCEANS 2025 - Brest, France
Duration: 16 Jun 202519 Jun 2025

Publication series

NameOceans Conference Record (IEEE)
ISSN (Print)0197-7385

Conference

ConferenceOCEANS 2025 Brest, OCEANS 2025
Country/TerritoryFrance
CityBrest
Period16/06/2519/06/25

Bibliographical note

Publisher Copyright:
© 2025 IEEE.

Fingerprint

Dive into the research topics of 'Optimizing Source Localization via Reinforcement Learning in Multi-Agent Underwater Networks'. Together they form a unique fingerprint.

Cite this