Hugging Face's logo
Papers
arxiv:2401.03515

RoBERTurk: Adjusting RoBERTa for Turkish

Published on Jan 7, 2024
Upvote
1
Authors:

Abstract

A RoBERTa model pretrained on a smaller Turkish corpus using BPE tokenizer outperforms BERTurk for POS on BOUN, underperforms on IMST for POS, and achieves competitive scores on the Turkish XTREME dataset for NER.

AI-generated summary

We pretrain RoBERTa on a Turkish corpora using BPE tokenizer. Our model outperforms BERTurk family models on the BOUN dataset for the POS task while resulting in underperformance on the IMST dataset for the same task and achieving competitive scores on the Turkish split of the XTREME dataset for the NER task - all while being pretrained on smaller data than its competitors. We release our pretrained model and tokenizer.

View arXiv page View PDF Add to collection

Community

Sign up or log in to comment

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2401.03515 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2401.03515 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2401.03515 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.