Attention-based deep multiple instance learning

Maximilian Ilse, Jakub M. Tomczak, Max Welling

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

Multiple instance learning (MIL) is a variation of supervised learning where a single class label is assigned to a bag of instances. In this paper, we state the MIL problem as learning the Bernoulli distribution of the bag label where the bag label probability is fully parameterized by neural networks. Furthermore, we propose a neural network-based permutation-invariant aggregation operator that corresponds to the attention mechanism. Notably, an application of the proposed attention-based operator provides insight into the contribution of each instance to the bag label. We show empirically that our approach achieves comparable performance to the best MIL methods on benchmark MIL datasets and it outperforms other methods on a MNIST-based MIL dataset and two real-life histopathology datasets without sacrificing interpretability.

Original languageEnglish
Title of host publication35th International Conference on Machine Learning, ICML 2018
EditorsJennifer Dy, Andreas Krause
PublisherInternational Machine Learning Society (IMLS)
Pages3376-3391
Number of pages16
ISBN (Electronic)9781510867963
Publication statusPublished - 1 Jan 2018
Externally publishedYes
Event35th International Conference on Machine Learning, ICML 2018 - Stockholm, Sweden
Duration: 10 Jul 201815 Jul 2018

Publication series

Name35th International Conference on Machine Learning, ICML 2018
Volume5

Conference

Conference35th International Conference on Machine Learning, ICML 2018
CountrySweden
CityStockholm
Period10/07/1815/07/18

Fingerprint

Labels
Neural networks
Supervised learning
Agglomeration

Cite this

Ilse, M., Tomczak, J. M., & Welling, M. (2018). Attention-based deep multiple instance learning. In J. Dy, & A. Krause (Eds.), 35th International Conference on Machine Learning, ICML 2018 (pp. 3376-3391). (35th International Conference on Machine Learning, ICML 2018; Vol. 5). International Machine Learning Society (IMLS).
Ilse, Maximilian ; Tomczak, Jakub M. ; Welling, Max. / Attention-based deep multiple instance learning. 35th International Conference on Machine Learning, ICML 2018. editor / Jennifer Dy ; Andreas Krause. International Machine Learning Society (IMLS), 2018. pp. 3376-3391 (35th International Conference on Machine Learning, ICML 2018).
@inproceedings{e103e0858a5f47d4901ce719427388af,
title = "Attention-based deep multiple instance learning",
abstract = "Multiple instance learning (MIL) is a variation of supervised learning where a single class label is assigned to a bag of instances. In this paper, we state the MIL problem as learning the Bernoulli distribution of the bag label where the bag label probability is fully parameterized by neural networks. Furthermore, we propose a neural network-based permutation-invariant aggregation operator that corresponds to the attention mechanism. Notably, an application of the proposed attention-based operator provides insight into the contribution of each instance to the bag label. We show empirically that our approach achieves comparable performance to the best MIL methods on benchmark MIL datasets and it outperforms other methods on a MNIST-based MIL dataset and two real-life histopathology datasets without sacrificing interpretability.",
author = "Maximilian Ilse and Tomczak, {Jakub M.} and Max Welling",
year = "2018",
month = "1",
day = "1",
language = "English",
series = "35th International Conference on Machine Learning, ICML 2018",
publisher = "International Machine Learning Society (IMLS)",
pages = "3376--3391",
editor = "Jennifer Dy and Andreas Krause",
booktitle = "35th International Conference on Machine Learning, ICML 2018",

}

Ilse, M, Tomczak, JM & Welling, M 2018, Attention-based deep multiple instance learning. in J Dy & A Krause (eds), 35th International Conference on Machine Learning, ICML 2018. 35th International Conference on Machine Learning, ICML 2018, vol. 5, International Machine Learning Society (IMLS), pp. 3376-3391, 35th International Conference on Machine Learning, ICML 2018, Stockholm, Sweden, 10/07/18.

Attention-based deep multiple instance learning. / Ilse, Maximilian; Tomczak, Jakub M.; Welling, Max.

35th International Conference on Machine Learning, ICML 2018. ed. / Jennifer Dy; Andreas Krause. International Machine Learning Society (IMLS), 2018. p. 3376-3391 (35th International Conference on Machine Learning, ICML 2018; Vol. 5).

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Attention-based deep multiple instance learning

AU - Ilse, Maximilian

AU - Tomczak, Jakub M.

AU - Welling, Max

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Multiple instance learning (MIL) is a variation of supervised learning where a single class label is assigned to a bag of instances. In this paper, we state the MIL problem as learning the Bernoulli distribution of the bag label where the bag label probability is fully parameterized by neural networks. Furthermore, we propose a neural network-based permutation-invariant aggregation operator that corresponds to the attention mechanism. Notably, an application of the proposed attention-based operator provides insight into the contribution of each instance to the bag label. We show empirically that our approach achieves comparable performance to the best MIL methods on benchmark MIL datasets and it outperforms other methods on a MNIST-based MIL dataset and two real-life histopathology datasets without sacrificing interpretability.

AB - Multiple instance learning (MIL) is a variation of supervised learning where a single class label is assigned to a bag of instances. In this paper, we state the MIL problem as learning the Bernoulli distribution of the bag label where the bag label probability is fully parameterized by neural networks. Furthermore, we propose a neural network-based permutation-invariant aggregation operator that corresponds to the attention mechanism. Notably, an application of the proposed attention-based operator provides insight into the contribution of each instance to the bag label. We show empirically that our approach achieves comparable performance to the best MIL methods on benchmark MIL datasets and it outperforms other methods on a MNIST-based MIL dataset and two real-life histopathology datasets without sacrificing interpretability.

UR - http://www.scopus.com/inward/record.url?scp=85057238355&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85057238355&partnerID=8YFLogxK

M3 - Conference contribution

T3 - 35th International Conference on Machine Learning, ICML 2018

SP - 3376

EP - 3391

BT - 35th International Conference on Machine Learning, ICML 2018

A2 - Dy, Jennifer

A2 - Krause, Andreas

PB - International Machine Learning Society (IMLS)

ER -

Ilse M, Tomczak JM, Welling M. Attention-based deep multiple instance learning. In Dy J, Krause A, editors, 35th International Conference on Machine Learning, ICML 2018. International Machine Learning Society (IMLS). 2018. p. 3376-3391. (35th International Conference on Machine Learning, ICML 2018).