---
license: other
---
| Metric                | Value                     |
|-----------------------|---------------------------|
| Average               | -                         |
| ARC                   | 35.84                     |
| ARC Easy              | 55.80                     |
| BoolQ                 | 72.23                     |
| HellaSwag             | 64.00                     |
| OpenBookQA            | 32.40                     |
| PiQA                  | 72.14                     |
| Winogrande            | 56.27                     |
|-----------------------|---------------------------|
| MMLU                  | 38.53                     |
| GSM8K                 |                           |
| Truthful QA           | 44.46                     |