SemEval-2018 Task 5: Counting Events and Participants in the Long Tail

M.C. Postma; F. Ilievski; P.T.J.M. Vossen

SemEval-2018 Task 5: Counting Events and Participants in the Long Tail

M.C. Postma, F. Ilievski, P.T.J.M. Vossen

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

49 Downloads (Pure)

Abstract

This paper discusses SemEval-2018 Task 5: a referential quantification task of counting events and participants in local, long-tail news documents with high ambiguity. The complexity of this task challenges systems to establish the meaning, reference and identity across documents. The task consists of three subtasks and spans across three domains. We detail the design of this referential quantification task, describe the participating systems, and present additional analysis to gain deeper insight into their performance.

Original language	English
Title of host publication	Proceedings of the 12th International Workshop on Semantic Evaluation
Editors	Marianna Apidianaki, Saif M. Mohammad, Jaonathan May, Ekatarina Shutova, Steven Bethard, Marine Carpuat
Publisher	ACL Anthology
Pages	70-80
Number of pages	11
Publication status	Published - 2018
Event	SemEval-2018: International Workshop on Semantic Evaluation 2018 - New Orleans, United States Duration: 5 Jun 2018 → 6 Jun 2018 http://alt.qcri.org/semeval2018/

Conference

Conference	SemEval-2018
Abbreviated title	SemEval-2018
Country/Territory	United States
City	New Orleans
Period	5/06/18 → 6/06/18
Internet address	http://alt.qcri.org/semeval2018/

Access to Document

S18-1009_SemEval-2018 Task 5 Counting Events and Participants in the Long TailFinal published version, 505 KBLicence: CC BY

http://aclweb.org/anthology/S18-1009

Persistent URL (handle)

Persistent link

Cite this

@inproceedings{827f03303aee45b0af5f436104f13b19,

title = "SemEval-2018 Task 5: Counting Events and Participants in the Long Tail",

abstract = "This paper discusses SemEval-2018 Task 5: a referential quantification task of counting events and participants in local, long-tail news documents with high ambiguity. The complexity of this task challenges systems to establish the meaning, reference and identity across documents. The task consists of three subtasks and spans across three domains. We detail the design of this referential quantification task, describe the participating systems, and present additional analysis to gain deeper insight into their performance.",

author = "M.C. Postma and F. Ilievski and P.T.J.M. Vossen",

year = "2018",

language = "English",

pages = "70--80",

editor = "Marianna Apidianaki and Mohammad, {Saif M.} and Jaonathan May and Ekatarina Shutova and Steven Bethard and Marine Carpuat",

booktitle = "Proceedings of the 12th International Workshop on Semantic Evaluation",

publisher = "ACL Anthology",

note = "SemEval-2018 : International Workshop on Semantic Evaluation 2018, SemEval-2018 ; Conference date: 05-06-2018 Through 06-06-2018",

url = "http://alt.qcri.org/semeval2018/",

}

Postma, MC, Ilievski, F & Vossen, PTJM 2018, SemEval-2018 Task 5: Counting Events and Participants in the Long Tail. in M Apidianaki, SM Mohammad, J May, E Shutova, S Bethard & M Carpuat (eds), Proceedings of the 12th International Workshop on Semantic Evaluation. ACL Anthology, pp. 70-80, SemEval-2018, New Orleans, United States, 5/06/18. <http://aclweb.org/anthology/S18-1009>

SemEval-2018 Task 5: Counting Events and Participants in the Long Tail. / Postma, M.C.; Ilievski, F.; Vossen, P.T.J.M.
Proceedings of the 12th International Workshop on Semantic Evaluation. ed. / Marianna Apidianaki; Saif M. Mohammad; Jaonathan May; Ekatarina Shutova; Steven Bethard; Marine Carpuat. ACL Anthology, 2018. p. 70-80.

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - SemEval-2018 Task 5: Counting Events and Participants in the Long Tail

AU - Postma, M.C.

AU - Ilievski, F.

AU - Vossen, P.T.J.M.

PY - 2018

Y1 - 2018

N2 - This paper discusses SemEval-2018 Task 5: a referential quantification task of counting events and participants in local, long-tail news documents with high ambiguity. The complexity of this task challenges systems to establish the meaning, reference and identity across documents. The task consists of three subtasks and spans across three domains. We detail the design of this referential quantification task, describe the participating systems, and present additional analysis to gain deeper insight into their performance.

AB - This paper discusses SemEval-2018 Task 5: a referential quantification task of counting events and participants in local, long-tail news documents with high ambiguity. The complexity of this task challenges systems to establish the meaning, reference and identity across documents. The task consists of three subtasks and spans across three domains. We detail the design of this referential quantification task, describe the participating systems, and present additional analysis to gain deeper insight into their performance.

UR - https://competitions.codalab.org/competitions/17285

M3 - Conference contribution

SP - 70

EP - 80

BT - Proceedings of the 12th International Workshop on Semantic Evaluation

A2 - Apidianaki, Marianna

A2 - Mohammad, Saif M.

A2 - May, Jaonathan

A2 - Shutova, Ekatarina

A2 - Bethard, Steven

A2 - Carpuat, Marine

PB - ACL Anthology

T2 - SemEval-2018

Y2 - 5 June 2018 through 6 June 2018

ER -

SemEval-2018 Task 5: Counting Events and Participants in the Long Tail

Abstract

Conference

Access to Document

Persistent URL (handle)

Other files and links

Fingerprint

Cite this