---
title: README
emoji: 📚
colorFrom: red
colorTo: pink
sdk: static
pinned: false
---

<p><span style="color: blue"><a href="https://www.kb.se/in-english/research-collaboration/kblab.html">KBLab</a></span> is a national research infrastructure for digital humanities and social science at the <span style="color: blue"><a href="https://kb.se/">National Library of Sweden</a></span>. We train large language models and acoustic models on Swedish data from the librarys collections. Check out our <span style="color: blue"><a href="https://kb-labb.github.io/">blog</a></span>!</p>

Some of our most popular models are

<ul>
  <li><span style="color: blue"><a href="https://huggingface.co./KBLab/bert-base-swedish-cased">the original KB-BERT</a></span></li>
  <li><span style="color: blue"><a href="https://huggingface.co./KBLab/megatron-bert-large-swedish-cased-165k">a large BERT trained with Megatron-LM</a></span></li>
  <li><span style="color: blue"><a href="https://huggingface.co./KBLab/sentence-bert-swedish-cased">a Sentence-BERT</a></span></li>
  <li><span style="color: blue"><a href="https://huggingface.co./KBLab/bert-base-swedish-lowermix-reallysimple-ner">an NER model trained on a mix of cased and uncased data</a></span></li>
  <li><span style="color: blue"><a href="https://huggingface.co./KBLab/wav2vec2-large-voxrex-swedish">a wav2vec model</a></span> </li>
  <li><span style="color: blue"><a href="https://huggingface.co./KBLab/bart-base-swedish-cased">a BART model</a></span></li>
</ul> 

Additionally we provide previous checkpoints for some models and other models closely related to those above.
Models related to each other are linked in the respective model cards.

If you are unsure which model fits you best feel free to contact us.

We also provide a variant of the venerable **SUC 3.0** NER-dataset extended by Språkbanken-Text dubbed <span style="color: blue">[SUCX 3.0 - NER](https://huggingface.co./datasets/KBLab/sucx3_ner)</span> and our own Swedish/Norwegian/Danish GLUE-imitation dubbed <span style="color: blue">[ÖverLim](https://huggingface.co./datasets/KBLab/overlim)</span>.</p>