stefan-it
Abstract
We address in this article the the quality of the WikiNER corpus, a multilingual Named Entity Recognition corpus, and provide a consolidated version of it. The annotation of WikiNER was produced in a semi-supervised manner i.e. no manual verification has been carried out a posteriori. Such corpus is called silver-standard. In this paper we propose WikiNER-fr-gold which is a revised version of the French proportion of WikiNER. Our corpus consists of randomly sampled 20% of the original French sub-corpus (26,818 sentences with 700k tokens). We start by summarizing the entity types included in each category in order to define an annotation guideline, and then we proceed to revise the corpus. Finally we present an analysis of errors and inconsistency observed in the WikiNER-fr corpus, and we discuss potential future work directions.
Community
Oh, the annotators must hate this interface. Normally, you can just use the label and annotate start and end of a span - this can be automatically converted into IOBES later.
Hi @danrun , @becnic and @pfmarteau ,
many thanks for the great work of fixing the French part of WikiNER! I would like to integrate that new gold standard dataset into our Flair library and would like to know if you plan to release the dataset :)
Many thanks in advance!
I submitted the paper to Daily Papers on HF: the paper presents a corrected French part (20%) of the WikiNER dataset, which makes this dataset a great new resource for named entity recognition.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Annotation Guidelines for Corpus Novelties: Part 1 -- Named Entity Recognition (2024)
- Comparative Analysis of Extrinsic Factors for NER in French (2024)
- Annotation Guidelines for Corpus Novelties: Part 2 -- Alias Resolution Version 1.0 (2024)
- Be My Donor. Transfer the NLP Datasets Between the Languages Using LLM (2024)
- SLIMER-IT: Zero-Shot NER on Italian Language (2024)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment:
@librarian-bot
recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper