OpenMeditron
/

Meditron3-Phi4-14B

Model card Files Files and versions Community

Update README.md

#2

by ETraKoZ - opened 13 days ago

base: refs/heads/main

←

from: refs/pr/2

Discussion Files changed

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -61,7 +61,7 @@ Additional information about the datasets will be included in the Meditron-3 pub
 | Model Name             | MedmcQA | MedQA  | PubmedQA | Average |
 |------------------------|---------|--------|----------|---------|
 | microsoft/phi-4        | 63.11   | 62.77  | 79.00    | 68.29   |
-| MePhitron              | 66.58   | 69.29  | 77.60    | 71.16   |
 | Difference (MePhitron vs.) | 3.47    | 6.52   | -1.40    | 2.86    |
 We evaluated Meditron on medical multiple-choice questions using [lm-harness](https://github.com/EleutherAI/lm-evaluation-harness) for reproducibility.

 | Model Name             | MedmcQA | MedQA  | PubmedQA | Average |
 |------------------------|---------|--------|----------|---------|
 | microsoft/phi-4        | 63.11   | 62.77  | 79.00    | 68.29   |
+| MePhitron (Meditron-3-Phi4-14B)  | 66.58   | 69.29  | 77.60    | 71.16   |
 | Difference (MePhitron vs.) | 3.47    | 6.52   | -1.40    | 2.86    |
 We evaluated Meditron on medical multiple-choice questions using [lm-harness](https://github.com/EleutherAI/lm-evaluation-harness) for reproducibility.