YAML Metadata Error: "language" with value "african-languages" is not valid. It must be an ISO 639-1, 639-2 or 639-3 code (two/three letters), or a special value like "code", "multilingual". If you want to use BCP-47 identifiers, you can specify them in language_bcp47.
YAML Metadata Error: "model-index[0].results[0].dataset.type" is required
YAML Metadata Error: "model-index[0].results[0].metrics" is required

Interacting with the Masakhane Benchmark Models

I created this demo for very easy interaction with the benchmark models on Masakhane which were trained with JoeyNMT(my forked version).

To access the space click here.

To include your language, all you need to do is:

  1. Create a folder in the format src-tgt/main for your language pair, if it does not exist.
  2. Inside the main folder put the following files:
    1. model checkpoint. Rename it to best.ckpt.
    2. config.yaml file. This is the JoeyNMT config file which loads the model an pre-processing parameters.
    3. src_vocab.txt file.
    4. trg_vocab.txt file.

The space currently supports these languages:

source language target language
English Swahili
English Afrikaans
English Arabic
English Urhobo
English Ẹ̀dó
Efik English
English Hausa
English Igbo
English Fon
English Twi
English Dendi
English Ẹ̀sán
English Isoko
English Kamba
English Luo
English Southern Ndebele
English Tshivenda
Shona English
Swahili English
Yoruba English

TO DO:

  1. Include more languages from the benchmark.
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model's library. Check the docs .

Space using chrisjay/masakhane_benchmarks 1

Evaluation results

Model card error

This model's model-index metadata is invalid: Schema validation error. "model-index[0].results[0].dataset.type" is required. "model-index[0].results[0].metrics" is required