End-to-End Personalization of Digital Health Interventions using Raw Sensor Data with Deep Reinforcement Learning: A comparative study in digital health interventions for behavior change

Ali El Hassouni, Mark Hoogendoorn, A. E. Eiben, Martijn Van Otterlo, Vesa Muhonen

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

We introduce an end-to-end reinforcement learning (RL) solution for the problem of sending personalized digital health interventions. Previous work has shown that personalized interventions can be obtained through RL using simple, discrete state information such as the recent activity performed. In reality however, such features are often not observed, but instead could be inferred from noisy, low-level sensor information obtained from mobile devices (e.g. accelerometers in mobile phones). One could first transform such raw data into discrete activities, but that could throw away important details and would require training a classifier to infer these discrete activities which would need a labeled training set.
Instead, we propose to directly learn intervention strategies for the low-level sensor data end-to-end using deep neural networks
and RL. We test our novel approach in a self-developed simulation environment which models, and generates, realistic sensor data for daily human activities and show the short-and long-term efficacy of sending personalized physical workout interventions using RL policies. We compare several different input representations and show that learning using raw sensor data is nearly as effective and much more flexible.
Original languageEnglish
Title of host publicationWI '19 - IEEE/WIC/ACM International Conference on Web Intelligence - Proceedings
EditorsPayam Barnaghi, Georg Gottlob, Yannis Manolopoulos, Theodoros Tzouramanis, Athena Vakali
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery, Inc
Pages258-264
Number of pages7
ISBN (Electronic)9781450369343
DOIs
Publication statusPublished - 14 Oct 2019
Event19th IEEE/WIC/ACM International Conference on Web Intelligence, WI 2019 - Thessaloniki, Greece
Duration: 13 Oct 201917 Oct 2019

Publication series

NameProceedings - 2019 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2019

Conference

Conference19th IEEE/WIC/ACM International Conference on Web Intelligence, WI 2019
CountryGreece
CityThessaloniki
Period13/10/1917/10/19

Keywords

  • Personalization
  • Health Interventions
  • eHealth
  • mHealth
  • Sensor data
  • Advantage Actor-Critic
  • Reinforcement Learning
  • LSTM
  • GANs
  • MHealth
  • EHealth
  • Health interventions

Fingerprint Dive into the research topics of 'End-to-End Personalization of Digital Health Interventions using Raw Sensor Data with Deep Reinforcement Learning: A comparative study in digital health interventions for behavior change'. Together they form a unique fingerprint.

Cite this