microsoft/xtremedistil-l6-h256-uncased fined-tuned on SQuAD (https://huggingface.co./datasets/squad)
Hyperparameters:
- epochs: 1
- lr: 1e-5
- train batch sie: 16
- optimizer: adamW
- lr_scheduler: linear
- num warming steps: 0
- max_length: 512
Results on the dev set:
- 'exact_match': 62.66792809839168
- 'f1': 74.99490608582015
- Downloads last month
- 8
Inference API (serverless) is not available, repository is disabled.
Dataset used to train haritzpuerto/xtremedistil-l6-h256-uncased-squad_1.1
Evaluation results
- SQuAD EM on SQuADvalidation set self-reported62.668
- SQuAD F1 on SQuADvalidation set self-reported74.995