lixsh6

/

MegatronBert-1B3-embedding

like 0

Evaluation results

• accuracy on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  70.119
• ap on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  32.378
• f1 on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  63.923
• accuracy on MTEB AmazonPolarityClassification
  test set self-reported
  92.951
• ap on MTEB AmazonPolarityClassification
  test set self-reported
  89.692
• f1 on MTEB AmazonPolarityClassification
  test set self-reported
  92.941
• accuracy on MTEB AmazonReviewsClassification (en)
  test set self-reported
  50.522
• f1 on MTEB AmazonReviewsClassification (en)
  test set self-reported
  48.760
• map_at_1 on MTEB ArguAna
  test set self-reported
  14.865
• map_at_10 on MTEB ArguAna
  test set self-reported
  26.026
• map_at_100 on MTEB ArguAna
  test set self-reported
  27.586
• map_at_1000 on MTEB ArguAna
  test set self-reported
  27.623
• map_at_3 on MTEB ArguAna
  test set self-reported
  21.859
• map_at_5 on MTEB ArguAna
  test set self-reported
  24.049
• mrr_at_1 on MTEB ArguAna
  test set self-reported
  15.505
• mrr_at_10 on MTEB ArguAna
  test set self-reported
  26.265
• mrr_at_100 on MTEB ArguAna
  test set self-reported
  27.810
• mrr_at_1000 on MTEB ArguAna
  test set self-reported
  27.847
• mrr_at_3 on MTEB ArguAna
  test set self-reported
  22.060
• mrr_at_5 on MTEB ArguAna
  test set self-reported
  24.247