Characterizing Technical Debt and Antipatterns in AI-Based Systems: A Systematic Mapping Study

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

Background: With the rising popularity of Artificial Intelligence (AI), there is a growing need to build large and complex AI-based systems in a cost-effective and manageable way. Like with traditional software, Technical Debt (TD) will emerge naturally over time in these systems, therefore leading to challenges and risks if not managed appropriately. The influence of data science and the stochastic nature of AI-based systems may also lead to new types of TD or antipatterns, which are not yet fully understood by researchers and practitioners. Objective: The goal of our study is to provide a clear overview and characterization of the types of TD (both established and new ones) that appear in AI-based systems, as well as the antipatterns and related solutions that have been proposed. Method: Following the process of a systematic mapping study, 21 primary studies are identified and analyzed. Results: Our results show that (i) established TD types, variations of them, and four new TD types (data, model, configuration, and ethics debt) are present in AI-based systems, (ii) 72 antipatterns are discussed in the literature, the majority related to data and model deficiencies, and (iii) 46 solutions have been proposed, either to address specific TD types, antipatterns, or TD in general. Conclusions: Our results can support AI professionals with reasoning about and communicating aspects of TD present in their systems. Additionally, they can serve as a foundation for future research to further our understanding of TD in AI-based systems.

Original languageEnglish
Title of host publication2021 IEEE/ACM International Conference on Technical Debt (TechDebt)
Subtitle of host publication[Proceedings]
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages64-73
Number of pages10
ISBN (Electronic)9781665414050
ISBN (Print)9781665414067
DOIs
Publication statusPublished - 25 Jun 2021
Event4th IEEE/ACM International Conference on Technical Debt, TechDebt 2021 - Virtual, Online, Spain
Duration: 19 May 202121 May 2021

Conference

Conference4th IEEE/ACM International Conference on Technical Debt, TechDebt 2021
Country/TerritorySpain
CityVirtual, Online
Period19/05/2121/05/21

Bibliographical note

Publisher Copyright:
© 2021 IEEE.

Keywords

  • Antipatterns
  • Artificial Intelligence
  • Machine Learning
  • Systematic Mapping Study
  • Technical Debt

Fingerprint

Dive into the research topics of 'Characterizing Technical Debt and Antipatterns in AI-Based Systems: A Systematic Mapping Study'. Together they form a unique fingerprint.

Cite this