Comparing Methods for Finding Search Sessions on a Specified Topic: A Double Case Study

Tessel Bogaard; Aysenur Bilgin; Jan Wielemaker; Laura Hollink; Kees Ribbens; Jacco van Ossenbruggen

doi:10.1007/978-3-030-86324-1_23

Comparing Methods for Finding Search Sessions on a Specified Topic: A Double Case Study

Tessel Bogaard^*, Aysenur Bilgin, Jan Wielemaker, Laura Hollink, Kees Ribbens, Jacco van Ossenbruggen

^*Corresponding author for this work

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

153 Downloads (Pure)

Abstract

Users searching for different topics in a collection may show distinct search patterns. To analyze search behavior of users searching for a specific topic, we need to retrieve the sessions containing this topic. In this paper, we compare different topic representations and approaches to find topic-specific sessions. We conduct our research in a double case study of two topics, World War II and feminism, using search logs of a historical newspaper collection. We evaluate the results using manually created ground truths of over 600 sessions per topic. The two case studies show similar results: The query-based methods yield high precision, at the expense of recall. The document-based methods find more sessions, at the expense of precision. In both approaches, precision improves significantly by manually curating the topic representations. This study demonstrates how different methods to find sessions containing specific topics can be applied by digital humanities scholars and practitioners.

Original language	English
Title of host publication	Linking Theory and Practice of Digital Libraries
Subtitle of host publication	25th International Conference on Theory and Practice of Digital Libraries, TPDL 2021, Virtual Event, September 13–17, 2021, Proceedings
Editors	Gerd Berget, Mark Michael Hall, Daniel Brenn, Sanna Kumpulainen
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	189-201
Number of pages	13
ISBN (Electronic)	9783030863241
ISBN (Print)	9783030863234
DOIs	https://doi.org/10.1007/978-3-030-86324-1_23
Publication status	Published - 2021
Event	25th International Conference on Theory and Practice of Digital Libraries, TPDL 2021 - Virtual, Online Duration: 13 Sept 2021 → 17 Sept 2021

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	12866 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	25th International Conference on Theory and Practice of Digital Libraries, TPDL 2021
City	Virtual, Online
Period	13/09/21 → 17/09/21

Bibliographical note

Funding Information:
We would like to thank the National Library of the Netherlands, and Lynda Hardman (Centrum Wiskunde & Informatica) for their support. The Wikipedia articles related to WWII were assessed by Kees Ribbens with the assistance of Caroline Schoofs and Koen Smilde. This research is partially supported by the VRE4EIC project, a project that has received funding from the European Union?s Horizon 2020 research and innovation program under grant agreement No 676247.

Funding Information:
Acknowledgements. We would like to thank the National Library of the Netherlands, and Lynda Hardman (Centrum Wiskunde & Informatica) for their support. The Wikipedia articles related to WWII were assessed by Kees Ribbens with the assistance of Caroline Schoofs and Koen Smilde. This research is partially supported by the VRE4EIC project, a project that has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No 676247.

Publisher Copyright:
© 2021, Springer Nature Switzerland AG.

Funding

We would like to thank the National Library of the Netherlands, and Lynda Hardman (Centrum Wiskunde & Informatica) for their support. The Wikipedia articles related to WWII were assessed by Kees Ribbens with the assistance of Caroline Schoofs and Koen Smilde. This research is partially supported by the VRE4EIC project, a project that has received funding from the European Union?s Horizon 2020 research and innovation program under grant agreement No 676247. Acknowledgements. We would like to thank the National Library of the Netherlands, and Lynda Hardman (Centrum Wiskunde & Informatica) for their support. The Wikipedia articles related to WWII were assessed by Kees Ribbens with the assistance of Caroline Schoofs and Koen Smilde. This research is partially supported by the VRE4EIC project, a project that has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No 676247.

Keywords

Digital libraries
Log analysis
User interests

Access to Document

10.1007/978-3-030-86324-1_23Licence: Unspecified

Finding_Sessions_on_a_Specified_TopicAccepted author manuscript, 261 KBLicence: Article 25fa Dutch Copyright Act
Comparing Methods for Finding Search Sessions on a Specified TopicFinal published version, 283 KBLicence: Article 25fa Dutch Copyright Act

https://ir.cwi.nl/pub/31052/31052.pdf

Persistent URL (handle)

Persistent link

Cite this

Bogaard, T., Bilgin, A., Wielemaker, J., Hollink, L., Ribbens, K., & van Ossenbruggen, J. (2021). Comparing Methods for Finding Search Sessions on a Specified Topic: A Double Case Study. In G. Berget, M. M. Hall, D. Brenn, & S. Kumpulainen (Eds.), Linking Theory and Practice of Digital Libraries: 25th International Conference on Theory and Practice of Digital Libraries, TPDL 2021, Virtual Event, September 13–17, 2021, Proceedings (pp. 189-201). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12866 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-86324-1_23

Bogaard, Tessel ; Bilgin, Aysenur ; Wielemaker, Jan et al. / Comparing Methods for Finding Search Sessions on a Specified Topic : A Double Case Study. Linking Theory and Practice of Digital Libraries: 25th International Conference on Theory and Practice of Digital Libraries, TPDL 2021, Virtual Event, September 13–17, 2021, Proceedings. editor / Gerd Berget ; Mark Michael Hall ; Daniel Brenn ; Sanna Kumpulainen. Springer Science and Business Media Deutschland GmbH, 2021. pp. 189-201 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{0a1ee28bbe5d4beb972e3b2e587dcf09,

title = "Comparing Methods for Finding Search Sessions on a Specified Topic: A Double Case Study",

abstract = "Users searching for different topics in a collection may show distinct search patterns. To analyze search behavior of users searching for a specific topic, we need to retrieve the sessions containing this topic. In this paper, we compare different topic representations and approaches to find topic-specific sessions. We conduct our research in a double case study of two topics, World War II and feminism, using search logs of a historical newspaper collection. We evaluate the results using manually created ground truths of over 600 sessions per topic. The two case studies show similar results: The query-based methods yield high precision, at the expense of recall. The document-based methods find more sessions, at the expense of precision. In both approaches, precision improves significantly by manually curating the topic representations. This study demonstrates how different methods to find sessions containing specific topics can be applied by digital humanities scholars and practitioners.",

keywords = "Digital libraries, Log analysis, User interests",

author = "Tessel Bogaard and Aysenur Bilgin and Jan Wielemaker and Laura Hollink and Kees Ribbens and {van Ossenbruggen}, Jacco",

note = "Funding Information: We would like to thank the National Library of the Netherlands, and Lynda Hardman (Centrum Wiskunde & Informatica) for their support. The Wikipedia articles related to WWII were assessed by Kees Ribbens with the assistance of Caroline Schoofs and Koen Smilde. This research is partially supported by the VRE4EIC project, a project that has received funding from the European Union?s Horizon 2020 research and innovation program under grant agreement No 676247. Funding Information: Acknowledgements. We would like to thank the National Library of the Netherlands, and Lynda Hardman (Centrum Wiskunde & Informatica) for their support. The Wikipedia articles related to WWII were assessed by Kees Ribbens with the assistance of Caroline Schoofs and Koen Smilde. This research is partially supported by the VRE4EIC project, a project that has received funding from the European Union{\textquoteright}s Horizon 2020 research and innovation program under grant agreement No 676247. Publisher Copyright: {\textcopyright} 2021, Springer Nature Switzerland AG.; 25th International Conference on Theory and Practice of Digital Libraries, TPDL 2021 ; Conference date: 13-09-2021 Through 17-09-2021",

year = "2021",

doi = "10.1007/978-3-030-86324-1_23",

language = "English",

isbn = "9783030863234",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "189--201",

editor = "Gerd Berget and Hall, {Mark Michael} and Daniel Brenn and Sanna Kumpulainen",

booktitle = "Linking Theory and Practice of Digital Libraries",

address = "Germany",

}

Bogaard, T, Bilgin, A, Wielemaker, J, Hollink, L, Ribbens, K & van Ossenbruggen, J 2021, Comparing Methods for Finding Search Sessions on a Specified Topic: A Double Case Study. in G Berget, MM Hall, D Brenn & S Kumpulainen (eds), Linking Theory and Practice of Digital Libraries: 25th International Conference on Theory and Practice of Digital Libraries, TPDL 2021, Virtual Event, September 13–17, 2021, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12866 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 189-201, 25th International Conference on Theory and Practice of Digital Libraries, TPDL 2021, Virtual, Online, 13/09/21. https://doi.org/10.1007/978-3-030-86324-1_23

Comparing Methods for Finding Search Sessions on a Specified Topic: A Double Case Study. / Bogaard, Tessel; Bilgin, Aysenur; Wielemaker, Jan et al.
Linking Theory and Practice of Digital Libraries: 25th International Conference on Theory and Practice of Digital Libraries, TPDL 2021, Virtual Event, September 13–17, 2021, Proceedings. ed. / Gerd Berget; Mark Michael Hall; Daniel Brenn; Sanna Kumpulainen. Springer Science and Business Media Deutschland GmbH, 2021. p. 189-201 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12866 LNCS).

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Comparing Methods for Finding Search Sessions on a Specified Topic

T2 - 25th International Conference on Theory and Practice of Digital Libraries, TPDL 2021

AU - Bogaard, Tessel

AU - Bilgin, Aysenur

AU - Wielemaker, Jan

AU - Hollink, Laura

AU - Ribbens, Kees

AU - van Ossenbruggen, Jacco

N1 - Funding Information: We would like to thank the National Library of the Netherlands, and Lynda Hardman (Centrum Wiskunde & Informatica) for their support. The Wikipedia articles related to WWII were assessed by Kees Ribbens with the assistance of Caroline Schoofs and Koen Smilde. This research is partially supported by the VRE4EIC project, a project that has received funding from the European Union?s Horizon 2020 research and innovation program under grant agreement No 676247. Funding Information: Acknowledgements. We would like to thank the National Library of the Netherlands, and Lynda Hardman (Centrum Wiskunde & Informatica) for their support. The Wikipedia articles related to WWII were assessed by Kees Ribbens with the assistance of Caroline Schoofs and Koen Smilde. This research is partially supported by the VRE4EIC project, a project that has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No 676247. Publisher Copyright: © 2021, Springer Nature Switzerland AG.

PY - 2021

Y1 - 2021

N2 - Users searching for different topics in a collection may show distinct search patterns. To analyze search behavior of users searching for a specific topic, we need to retrieve the sessions containing this topic. In this paper, we compare different topic representations and approaches to find topic-specific sessions. We conduct our research in a double case study of two topics, World War II and feminism, using search logs of a historical newspaper collection. We evaluate the results using manually created ground truths of over 600 sessions per topic. The two case studies show similar results: The query-based methods yield high precision, at the expense of recall. The document-based methods find more sessions, at the expense of precision. In both approaches, precision improves significantly by manually curating the topic representations. This study demonstrates how different methods to find sessions containing specific topics can be applied by digital humanities scholars and practitioners.

AB - Users searching for different topics in a collection may show distinct search patterns. To analyze search behavior of users searching for a specific topic, we need to retrieve the sessions containing this topic. In this paper, we compare different topic representations and approaches to find topic-specific sessions. We conduct our research in a double case study of two topics, World War II and feminism, using search logs of a historical newspaper collection. We evaluate the results using manually created ground truths of over 600 sessions per topic. The two case studies show similar results: The query-based methods yield high precision, at the expense of recall. The document-based methods find more sessions, at the expense of precision. In both approaches, precision improves significantly by manually curating the topic representations. This study demonstrates how different methods to find sessions containing specific topics can be applied by digital humanities scholars and practitioners.

KW - Digital libraries

KW - Log analysis

KW - User interests

UR - http://www.scopus.com/inward/record.url?scp=85115322800&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85115322800&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-86324-1_23

DO - 10.1007/978-3-030-86324-1_23

M3 - Conference contribution

SN - 9783030863234

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 189

EP - 201

BT - Linking Theory and Practice of Digital Libraries

A2 - Berget, Gerd

A2 - Hall, Mark Michael

A2 - Brenn, Daniel

A2 - Kumpulainen, Sanna

PB - Springer Science and Business Media Deutschland GmbH

Y2 - 13 September 2021 through 17 September 2021

ER -

Bogaard T, Bilgin A, Wielemaker J, Hollink L, Ribbens K, van Ossenbruggen J. Comparing Methods for Finding Search Sessions on a Specified Topic: A Double Case Study. In Berget G, Hall MM, Brenn D, Kumpulainen S, editors, Linking Theory and Practice of Digital Libraries: 25th International Conference on Theory and Practice of Digital Libraries, TPDL 2021, Virtual Event, September 13–17, 2021, Proceedings. Springer Science and Business Media Deutschland GmbH. 2021. p. 189-201. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). Epub 2021 Sept 7. doi: 10.1007/978-3-030-86324-1_23

Comparing Methods for Finding Search Sessions on a Specified Topic: A Double Case Study

Abstract

Publication series

Conference

Bibliographical note

Funding

Keywords

Access to Document

Persistent URL (handle)

Other files and links

Fingerprint

Cite this