Submit evaluations for speaker tagging and view leaderboard
Explore income data with an interactive visualization tool
Analyze Shark Tank India episodes
Launch Argilla for data labeling and annotation
Uncensored General Intelligence Leaderboard
Select and analyze data subsets
Predict linear relationships between numbers
Create a detailed report from a dataset
World warming land sites
Search and save datasets generated with a LLM in real time
Browse and filter LLM benchmark results
Gather data from websites
Life System and Habit Tracker
The Post-ASR LLM based Speaker Tagging Leaderboard is a data visualization tool designed to evaluate and compare the performance of speaker tagging models. It focuses on post-automatic speech recognition (ASR) scenarios, leveraging large language models (LLMs) to identify and tag speakers in audio or text data. This leaderboard provides a platform for researchers and developers to submit evaluations, track performance metrics, and compare results with other state-of-the-art models.
• Model Evaluation Submission: Allows users to submit their speaker tagging model evaluations for benchmarking.
• Performance Tracking: Displays detailed performance metrics such as accuracy, precision, recall, and F1-score.
• Leaderboard Visualization: Presents results in a clear, sortable leaderboard format for easy comparison.
• Support for LLMs: Compatible with various large language models to enhance speaker tagging accuracy.
• Real-Time Updates: Provides up-to-date rankings and performance data as new submissions are added.
• Customizable Filters: Enables filtering of results based on specific models, datasets, or evaluation criteria.
What metrics are used to evaluate speaker tagging models on this leaderboard?
The leaderboard uses standard metrics such as accuracy, precision, recall, and F1-score to evaluate speaker tagging performance.
Can I use any LLM for speaker tagging on this platform?
Yes, the platform supports evaluations using any large language model (LLM) as long as the results are formatted according to the submission guidelines.
How often are the leaderboard rankings updated?
The rankings are updated in real-time as new submissions are processed and verified by the platform.