Browse and submit LLM evaluations
Analyze model errors with interactive pages
Convert and upload model files for Stable Diffusion
Benchmark LLMs in accuracy and translation across languages
Convert Hugging Face models to OpenVINO format
Track, rank and evaluate open LLMs and chatbots
Run benchmarks on prediction models
Measure over-refusal in LLMs using OR-Bench
SolidityBench Leaderboard
Create demo spaces for models on Hugging Face
Track, rank and evaluate open LLMs and chatbots
Calculate memory usage for LLM models
Measure BERT model performance using WASM and WebGPU
The Open Medical-LLM Leaderboard is a comprehensive platform designed for benchmarking and comparing large language models (LLMs) specifically tailored for medical and healthcare applications. It provides a centralized hub where users can browse, evaluate, and submit their own model evaluations, fostering transparency and collaboration in the development of AI for medical use cases.
What types of medical applications are supported?
The Open Medical-LLM Leaderboard supports a wide range of medical applications, including clinical text analysis, medical question answering, and healthcare document summarization.
How do I submit my own model evaluation?
To submit your model evaluation, follow these steps:
Is the leaderboard open to non-experts?
Yes, the leaderboard is designed to be accessible to both experts and non-experts. Researchers, developers, and healthcare professionals can all benefit from the platform's resources and tools.