Embedding Leaderboard
Use title and abstract to predict future academic impact
Analyze similarity of patent claims and responses
ModernBERT for reasoning and zero-shot classification
Parse and highlight entities in an email thread
Generate answers by querying text in uploaded documents
Test your attribute inference skills with comments
Compare AI models by voting on responses
G2P
Explore BERT model interactions
This is for learning purpose, don't take it seriously :)
Ask questions about air quality data with pre-built prompts or your own queries
Similarity
The MTEB Leaderboard is a comprehensive platform designed for evaluating and comparing text embeddings across various models, benchmarks, and languages. It provides a standardized framework for assessing the performance of different embedding techniques, enabling researchers and developers to identify the most effective solutions for their specific use cases.
What benchmarks are available on the MTEB Leaderboard?
The MTEB Leaderboard supports a wide range of benchmarks tailored for specific tasks in text analysis, including but not limited to text classification, clustering, and information retrieval.
How do I interpret the scores on the leaderboard?
Scores are typically represented as performance metrics (e.g., accuracy, F1-score, or Spearman correlation) depending on the benchmark. Higher scores generally indicate better performance for the specific task.
Can I evaluate my custom model on the MTEB Leaderboard?
Yes, you can evaluate custom models by generating embeddings for the selected benchmarks and languages, and then uploading the results to the leaderboard for comparison.