The article describes the idea, operationalization decisions and results of the first shared task in the Digital Humanities. In the task, different participating teams developed annotation guidelines for narrative levels independently. Annotation guidelines are a prerequisite for the development of systems for the automatic detection of textual phenomena, and thus needed in Computational Literary Studies because they allow large-scale studies of narrative phenomena. The developed guidelines were compared using a newly developed evaluation scheme that brings together the three dimensions of conceptual coverage, applicability and usefulness.
@incollection{ Reiter2020ag,
Title = {{Die Erstellung von Annotationsrichtlinien als Community-Aufgabe für die Digitalen Geisteswissenschaften}},
Address = { Berlin },
Author = { Nils Reiter and Marcus Willand and Evelyn Gius },
Editor = { Julia Nantke and Frederik Schlupkothen },
Booktitle = {{Annotations in Scholarly Editions and Research}},
Pages = { 325-350 },
Publisher = { De Gruyter },
Month = { October },
Doi = { 10.1515/9783110689112-015 },
Year = { 2020 }
}
TY -
TI - Die Erstellung von Annotationsrichtlinien als Community-Aufgabe für die Digitalen Geisteswissenschaften
AU - Nils Reiter
AU - Marcus Willand
AU - Evelyn Gius
ED - Julia Nantke
ED - Frederik Schlupkothen
PY - 2020
CY - Berlin
DO - 10.1515/9783110689112-015
PB - De Gruyter
J2 - Annotations in Scholarly Editions and Research
ER -