• Adrien Barbaresi - Hanno Biber - Friedrich Neubarth - Rainer Osswald (Hrsg.)

Konvens Proceedings

14th Conference on Natural Language Processing - KONVENS 2018

Bild


Verlag der Österreichischen Akademie der Wissenschaften
Austrian Academy of Sciences Press
A-1011 Wien, Dr. Ignaz Seipel-Platz 2
Tel. +43-1-515 81/DW 3420, Fax +43-1-515 81/DW 3400
https://verlag.oeaw.ac.at, e-mail: verlag@oeaw.ac.at

Die Konferenz zur Verarbeitung Natürlicher Sprache (KONVENS) soll den Erfahrungsaustausch auf hohem Niveau durch die Vorstellung computerlinguistischer Grundlagenforschung und ausgewählte Praxisvorträge von Experten befördern.

Copyright Cover: H. Biber (Foto)/F. Neubarth und A. Barbaresi (Bearbeitung).

Bestellung/Order


Bild
Konvens Proceedings



ISBN 978-3-7001-8437-9
Online Edition



Send or fax to your local bookseller or to:

Verlag der Österreichischen Akademie der Wissenschaften
Austrian Academy of Sciences Press
A-1011 Wien, Dr. Ignaz Seipel-Platz 2,
Tel. +43-1-515 81/DW 3420, Fax +43-1-515 81/DW 3400
https://verlag.oeaw.ac.at, e-mail: bestellung.verlag@oeaw.ac.at
UID-Nr.: ATU 16251605, FN 71839x Handelsgericht Wien, DVR: 0096385

Bitte senden Sie mir
Please send me
 
Exemplar(e) der genannten Publikation
copy(ies) of the publication overleaf


NAME


ADRESSE / ADDRESS


ORT / CITY


LAND / COUNTRY


ZAHLUNGSMETHODE / METHOD OF PAYMENT
    Visa     Euro / Master     American Express


NUMMER

Ablaufdatum / Expiry date:  

    I will send a cheque           Vorausrechnung / Send me a proforma invoice
 
DATUM, UNTERSCHRIFT / DATE, SIGNATURE

BANK AUSTRIA CREDITANSTALT, WIEN (IBAN AT04 1100 0006 2280 0100, BIC BKAUATWW), DEUTSCHE BANK MÜNCHEN (IBAN DE16 7007 0024 0238 8270 00, BIC DEUTDEDBMUC)
Bild

Variations on the theme of variation: Dealing with spelling variation for finegrained POS tagging of historical texts

    Fabian Barteld, Chris Biemann, Heike Zinsmeister

konvens 2018 - Konvens Proceedings, pp. 202-212, 2018/12/12

14th Conference on Natural Language Processing - KONVENS 2018


PDF
X
BibTEX-Export:

X
EndNote/Zotero-Export:

X
RIS-Export:

X 
Researchgate-Export (COinS)

Permanent QR-Code

Abstract

In this paper, we present experiments on POS tagging historical texts that contain spelling variation. The experiments are conducted in a low-resource scenario with a small amount of training data (here: 12,000 tokens). We investigate different ways of dealing with spelling variation in such a situation on different variants of historical German. Firstly, we add character n-grams as features to the tagger to enable it to learn spelling variation. Our tagging experiments show that this improves accuracy when there is enough variation in the data, but leads to a decrease in accuracy if the amount of variation is low. Secondly, we preprocess the data before training and applying the tagger, reducing spelling variation by normalization, rule-based simplification and substitution of spelling variants. All three methods improve tagging accuracy in comparable levels. Since normalization has the drawback of requiring additional resources, we recommend rule-based simplification and substitution of spelling variants for low-resourced settings. Finally, we evaluate the utility of additional unlabeled data to create word embeddings and employing external resources, which we use to further improve tagging accuracy.