Sam commited on
Commit
ab62782
·
unverified ·
1 Parent(s): 9859e6e

add german Leaderboard & update README (#64)

Browse files
Files changed (3) hide show
  1. EXTERNAL_MODEL_RESULTS.json +0 -0
  2. README.md +2 -1
  3. config.yaml +21 -1
EXTERNAL_MODEL_RESULTS.json CHANGED
The diff for this file is too large to render. See raw diff
 
README.md CHANGED
@@ -21,7 +21,8 @@ This repository contains the code for pushing and updating the MTEB leaderboard
21
  |------------------------------------------|------------------------------|
22
  | [mteb](https://github.com/embeddings-benchmark/mteb) | The implementation of the benchmark. Here you e.g. find the code to run your model on the benchmark. |
23
  | [leaderboard](https://huggingface.co/spaces/mteb/leaderboard) | The leaderboard itself, here you can view results of model run on MTEB. |
24
- | [results](https://github.com/embeddings-benchmark/results) | The results of MTEB is stored here. Though you can publish them to the leaderboard [adding](https://github.com/embeddings-benchmark/mteb/blob/main/docs/adding_a_model.md) the result to your model card. |
 
25
 
26
  ## Developer setup
27
 
 
21
  |------------------------------------------|------------------------------|
22
  | [mteb](https://github.com/embeddings-benchmark/mteb) | The implementation of the benchmark. Here you e.g. find the code to run your model on the benchmark. |
23
  | [leaderboard](https://huggingface.co/spaces/mteb/leaderboard) | The leaderboard itself, here you can view results of model run on MTEB. |
24
+ | [results](https://github.com/embeddings-benchmark/results) | The results of MTEB is stored here. To learn how to add results to the Leaderboard, refer to the documentation: [Adding a Model to the Leaderboard](https://github.com/embeddings-benchmark/mteb/blob/main/docs/adding_a_model.md).
25
+ |
26
 
27
  ## Developer setup
28
 
config.yaml CHANGED
@@ -287,13 +287,33 @@ boards:
287
  acronym: null
288
  icon: "🇩🇪"
289
  special_icons: null
290
- credits: "[Silvan](https://github.com/slvnwhrl)"
291
  tasks:
292
  Clustering:
293
  - BlurbsClusteringP2P
294
  - BlurbsClusteringS2S
295
  - TenKGnadClusteringP2P
296
  - TenKGnadClusteringS2S
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
297
  pl:
298
  title: Polish
299
  language_long: Polish
 
287
  acronym: null
288
  icon: "🇩🇪"
289
  special_icons: null
290
+ credits: "[Silvan](https://github.com/slvnwhrl), [Sam Heymann](https://github.com/sam-hey)"
291
  tasks:
292
  Clustering:
293
  - BlurbsClusteringP2P
294
  - BlurbsClusteringS2S
295
  - TenKGnadClusteringP2P
296
  - TenKGnadClusteringS2S
297
+ Retrieval:
298
+ - GermanQuAD-Retrieval
299
+ - GermanDPR
300
+ - XMarket (de)
301
+ - GerDaLIR
302
+ STS:
303
+ - GermanSTSBenchmark
304
+ - STS22 (de-en)
305
+ PairClassification:
306
+ - FalseFriendsGermanEnglish
307
+ - PawsXPairClassification (de)
308
+ Reranking:
309
+ - MIRACLReranking (de)
310
+ Classification:
311
+ - AmazonCounterfactualClassification (de)
312
+ - AmazonReviewsClassification (de)
313
+ - MTOPDomainClassification (de)
314
+ - MTOPIntentClassification (de)
315
+ - MassiveIntentClassification (de)
316
+ - MassiveScenarioClassification (de)
317
  pl:
318
  title: Polish
319
  language_long: Polish