Browse and submit language model benchmarks
Leaderboard of information retrieval models in French
Export Hugging Face models to ONNX
Request model evaluation on COCO val 2017 dataset
View LLM Performance Leaderboard
Determine GPU requirements for large language models
Measure execution times of BERT models using WebGPU and WASM
Benchmark models using PyTorch and OpenVINO
Submit deepfake detection models for evaluation
Display LLM benchmark leaderboard and info
Browse and filter ML model leaderboard data
Display genomic embedding leaderboard
View and submit machine learning model evaluations
The HHEM Leaderboard is a platform designed for model benchmarking, specifically tailored for language models. It allows users to browse and submit benchmarks, making it easier to compare performance across different models and datasets. This tool is invaluable for researchers and developers looking to evaluate and improve language models in a competitive and transparent environment.
• Real-time updates: Stay current with the latest benchmark results as they are submitted.
• Customizable filters: Narrow down results by specific models, datasets, or metrics.
• Detailed analytics: Access in-depth performance metrics for each submission.
• Submission interface: Easily upload your own model benchmarks for comparison.
• Community-driven: Engage with a community of researchers and developers to share insights and learn from others.
• Transparency: Clear documentation of evaluation methodologies and metrics.
What types of models can I benchmark on HHEM Leaderboard?
The HHEM Leaderboard supports a variety of language models, including but not limited to transformer-based architectures and other state-of-the-art models.
How do I submit a benchmark?
To submit a benchmark, create an account, ensure your model meets the submission criteria, and follow the step-by-step instructions provided on the platform.
What metrics are used to evaluate models?
The leaderboard uses standard metrics such as perplexity, accuracy, F1-score, and inference speed, depending on the specific task and dataset.