Browse and submit evaluations for CaselawQA benchmarks
Browse and submit LLM evaluations
Evaluate model predictions with TruLens
Browse and filter ML model leaderboard data
Compare and rank LLMs using benchmark scores
Visualize model performance on function calling tasks
Benchmark LLMs in accuracy and translation across languages
Calculate memory usage for LLM models
Browse and filter machine learning models by category and modality
View and submit LLM benchmark evaluations
Track, rank and evaluate open LLMs and chatbots
Display leaderboard for earthquake intent classification models
Optimize and train foundation models using IBM's FMS
The CaselawQA leaderboard (WIP) is a platform designed for tracking and comparing the performance of AI models on the CaselawQA benchmark. It enables researchers and practitioners to evaluate and submit results for their models, fostering collaboration and progress in legal AI applications. The leaderboard is currently a work in progress, with ongoing updates and improvements being made to enhance its functionality and usability.
What is the CaselawQA benchmark?
The CaselawQA benchmark is a dataset and evaluation framework designed to assess the ability of AI models to answer legal questions based on case law.
How do I submit my model's results?
To submit your model's results, use the submission interface on the CaselawQA leaderboard. Follow the provided instructions to upload your results in the required format.
Is the leaderboard open to everyone?
Yes, the leaderboard is open to all researchers and developers who want to evaluate their models on the CaselawQA benchmark. No special access is required.