An EO/IR monitoring system for non-contact physiological signal analysis in automated vehicles

Lotte Nijskens*, Sander E. van der Hurk, Sebastiaan P. van den Broek, Susanne Louvenberg, Jan L. Souman, Jelte E. Bos, Frank B. ter Haar

*Corresponding author for this work

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

Personnel shortages in the military sector require deploying soldiers as effectively as possible. Increased vehicle automation, e.g. for displacements or for resupply convoys, can improve this effectiveness by lowering the mental load needed for driving. Drivers of automated vehicles resemble passengers and are thereby more susceptible to motion sickness than drivers of non-autonomous vehicles. It is useful to monitor potential motion sickness, to ensure personnel arrive fit for duty at their destination. Therefore, a system to automatically detect the presence of motion sickness would be beneficial. In this paper, we introduce a camera-based system that uses electro-optical (EO) and infrared (IR) video sets to monitor facial skin temperature and respiratory rate as a step towards camera-based motion sickness monitoring in autonomous vehicles. Our proof-of-concept system obtained sufficient measurement accuracy for use in an experimental setting in which participants were subjected to a condition that induced motion sickness. We discuss the successes and challenges encountered during system set-up and data analysis, and share insights relevant to the envisioned application in an autonomous vehicle. Specifically, we compare recordings with and without subject motion caused by the motion sickness inducing condition and discuss measurement inaccuracies that might be encountered because of IR thermal drift. Additionally, we reflect on obstacles that can arise when employing an EO/IR monitoring system in a military context.

Original languageEnglish
Title of host publicationAutonomous Systems for Security and Defence
EditorsJudith Dijk, Jose Luis Sanchez-Lopez
PublisherSPIE
ISBN (Electronic)9781510681231
ISBN (Print)9781510681224
DOIs
Publication statusPublished - 2024
EventAutonomous Systems for Security and Defence 2024 - Edinburgh, United Kingdom
Duration: 16 Sept 202417 Sept 2024

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume13207
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceAutonomous Systems for Security and Defence 2024
Country/TerritoryUnited Kingdom
CityEdinburgh
Period16/09/2417/09/24

Bibliographical note

Publisher Copyright:
© 2024 SPIE.

Keywords

  • autonomous driving
  • EO/IR videography
  • motion sickness
  • physiological state monitoring

Fingerprint

Dive into the research topics of 'An EO/IR monitoring system for non-contact physiological signal analysis in automated vehicles'. Together they form a unique fingerprint.

Cite this