Audio-visual video embedding quality across retrieval, classification, clustering, pair classification, zero-shot classification, and video-centric...
AI & ML interests
Massive Text Embeddings Benchmark
Recent Activity
Papers
View all Papers Organization Card
MTEB is a Python framework for evaluating embeddings and retrieval systems for both text and image. MTEB covers more than 1000 languages and diverse tasks, from classics like classification and clustering to use-case specialized tasks such as legal, code, or healthcare retrieval.
You can get started using mteb.
| Overview | |
|---|---|
| 📈 Leaderboard | The interactive leaderboard of the benchmark |
| Get Started. | |
| 🏃 Get Started | Overview of how to use mteb |
| 🤖 Defining Models | How to use existing model and define custom ones |
| 📋 Selecting tasks | How to select tasks, benchmarks, splits etc. |
| 🏭 Running Evaluation | How to run the evaluations, including cache management, speeding up evaluations etc. |
| 📊 Loading Results | How to load and work with existing model results |
| Overview. | |
| 📋 Tasks | Overview of available tasks |
| 📐 Benchmarks | Overview of available benchmarks |
| 🤖 Models | Overview of available Models |
| Contributing | |
| 🤖 Adding a model | How to submit a model to MTEB and to the leaderboard |
| 👩💻 Adding a dataset | How to add a new task/dataset to MTEB |
| 👩💻 Adding a benchmark | How to add a new benchmark to MTEB and to the leaderboard |
| 🤝 Contributing | How to contribute to MTEB and set it up for development |
spaces 6
pinned
Running on CPU Upgrade
7.78k
MTEB Leaderboard
📊
Embedding Leaderboard
Running on CPU Upgrade
Leaderboard Backend
🚀
Paused
Agents
1
leaderboard-analytics-service
📊
Analyze competition leaderboards and get visual insights
Running
Agents
40
MTEB Legacy Leaderboard
🥇
Explore and filter MTEB model benchmark results
Running
116
MTEB Arena
⚔
Display MTEB Arena interface
datasets 1,811
mteb/results
Viewer • Updated • 8.94M • 210k • 20
mteb/vqa-2
Viewer • Updated • 450k • 331
mteb/docvqa_test_subsampled_beir
Viewer • Updated • 1.45k • 1.31k
mteb/cub200_retrieval
Viewer • Updated • 175k • 683
mteb/tiny-imagenet
Viewer • Updated • 110k • 419 • 1
mteb/StanfordCars
Viewer • Updated • 16.2k • 652 • 1
mteb/wds_fer2013
Viewer • Updated • 35.9k • 466
mteb/OxfordPets
Viewer • Updated • 7.35k • 1.74k
mteb/wds_country211
Viewer • Updated • 52.8k • 759
mteb/imagecode-multi
Viewer • Updated • 48.3k • 313