MTEB evaluation results on English language for 'multi-qa-MiniLM-L6-cos-v1' sbert model
Model and licence can be found here
- Downloads last month
- 395
Inference API (serverless) is not available, repository is disabled.
Space using djovak/multi-qa-MiniLM-L6-cos-v1 1
Evaluation results
- accuracy on MTEB AmazonCounterfactualClassification (en)test set self-reported61.791
- ap on MTEB AmazonCounterfactualClassification (en)test set self-reported25.829
- f1 on MTEB AmazonCounterfactualClassification (en)test set self-reported56.004
- accuracy on MTEB AmazonPolarityClassificationtest set self-reported62.361
- ap on MTEB AmazonPolarityClassificationtest set self-reported57.689
- f1 on MTEB AmazonPolarityClassificationtest set self-reported62.248
- accuracy on MTEB AmazonReviewsClassification (en)test set self-reported29.590
- f1 on MTEB AmazonReviewsClassification (en)test set self-reported29.242
- map_at_1 on MTEB ArguAnatest set self-reported25.249
- map_at_10 on MTEB ArguAnatest set self-reported40.196