DuckDB NSQL Leaderboard
View NSQL Scores for Models
You May Also Like
View AllOpenVINO Benchmark
Benchmark models using PyTorch and OpenVINO
Project RewardMATH
Evaluate reward models for math reasoning
MLIP Arena
Browse and evaluate ML tasks in MLIP Arena
Can You Run It? LLM version
Calculate GPU requirements for running LLMs
OpenVINO Export
Convert Hugging Face models to OpenVINO format
ExplaiNER
Analyze model errors with interactive pages
Submission Portal
Evaluate and submit AI model results for Frugal AI Challenge
DécouvrIR
Leaderboard of information retrieval models in French
Hebrew Transcription Leaderboard
Display LLM benchmark leaderboard and info
Convert HF Diffusers repo to single safetensors file V2 (for SDXL / SD 1.5 / LoRA)
Convert Hugging Face model repo to Safetensors
MEDIC Benchmark
View and compare language model evaluations
WebGPU Embedding Benchmark
Measure BERT model performance using WASM and WebGPU
What is DuckDB NSQL Leaderboard ?
DuckDB NSQL Leaderboard is a tool designed to track and compare the performance of different models using the NSQL (Normalized SQL) benchmarking framework. It provides a centralized platform to view and analyze NSQL scores, enabling users to evaluate and compare model performance efficiently.
Features
- Real-time Tracking: Continuously monitors and updates NSQL scores for models.
- Performance Metrics: Displays detailed performance metrics for each model.
- Model Comparison: Allows side-by-side comparison of multiple models based on NSQL scores.
- Filtering and Sorting: Enables users to filter and sort models based on specific criteria.
- Data Export: Supports exporting leaderboard data for further analysis.
- Visualization: Provides graphical representations of NSQL scores for better understanding.
How to use DuckDB NSQL Leaderboard ?
- Access the Leaderboard: Open DuckDB and navigate to the NSQL Leaderboard section.
- Select Models: Choose the models you want to compare from the available list.
- View NSQL Scores: The leaderboard will display the NSQL scores for the selected models.
- Compare Performance: Use the comparison features to analyze differences in scores.
- Filter and Sort: Apply filters or sort the results to focus on specific models or criteria.
- Export Data: Download the leaderboard data for further analysis or reporting.
- Visualize Results: Use the visualization tools to generate charts or graphs of the NSQL scores.
Frequently Asked Questions
What is NSQL in DuckDB?
NSQL (Normalized SQL) is a benchmarking framework used to evaluate the performance of SQL query engines. It provides a standardized way to measure and compare query execution times across different systems.
How do I interpret the NSQL scores?
Higher NSQL scores generally indicate better performance. Scores are calculated based on the execution time of a suite of SQL queries, with faster execution times resulting in higher scores.
Can I customize the leaderboard view?
Yes, you can customize the leaderboard by filtering, sorting, and selecting specific models to compare. This allows you to focus on the models and metrics that are most relevant to your needs.