Evaluate LLMs using Kazakh MC tasks
Analyze data to generate a comprehensive profile report
Explore how datasets shape classifier biases
View and compare pass@k metrics for AI models
Display a treemap of languages and datasets
Select and analyze data subsets
Profile a dataset and publish the report on Hugging Face
Display and analyze PyTorch Image Models leaderboard
Generate synthetic dataset files (JSON Lines)
Browse and compare Indic language LLMs on a leaderboard
Submit evaluations for speaker tagging and view leaderboard
Explore token probability distributions with sliders
Create detailed data reports
Kaz LLM Leaderboard is a data visualization tool designed to evaluate and compare the performance of large language models (LLMs) using Kazakh multiple-choice tasks. It provides a comprehensive platform to assess LLMs based on their ability to handle diverse linguistic and contextual challenges in the Kazakh language.
• LLM Evaluation: Tests LLMs with carefully curated Kazakh multiple-choice questions to assess their understanding and accuracy.
• Multi-Model Support: Allows comparison of various LLMs on the same set of tasks to identify strengths and weaknesses.
• Real-Time Benchmarking: Provides up-to-date performance metrics for LLMs in real-time.
• Performance Tracking: Offers detailed insights into how different models perform across different categories of questions.
• Customizable Insights: Users can filter results based on specific criteria to analyze performance in targeted areas.
• Data Export: Enables users to download evaluation results for further analysis or reporting.
• Multilingual Support: While primarily focused on Kazakh, the platform also supports comparisons in other languages.
What is Kaz LLM Leaderboard used for?
Kaz LLM Leaderboard is used to evaluate and compare the performance of large language models using Kazakh multiple-choice tasks, helping users identify the most accurate models for specific use cases.
Which LLMs are supported?
The platform supports a variety of popular LLMs, including but not limited to GPT, T5, and models specialized in Kazakh or other Central Asian languages.
Is Kaz LLM Leaderboard free to use?
Access to the basic features of Kaz LLM Leaderboard is free, but advanced features such as data export or customizable insights may require a subscription or one-time payment.