Text-To-Speech (TTS) Evaluation using objective metrics.
Measure BERT model performance using WASM and WebGPU
Measure over-refusal in LLMs using OR-Bench
Quantize a model for faster inference
View LLM Performance Leaderboard
Leaderboard of information retrieval models in French
Submit deepfake detection models for evaluation
Open Persian LLM Leaderboard
Display genomic embedding leaderboard
Determine GPU requirements for large language models
Evaluate code generation with diverse feedback types
View NSQL Scores for Models
Explore and submit models using the LLM Leaderboard
The TTSDS Benchmark and Leaderboard is a comprehensive evaluation framework designed for Text-To-Speech (TTS) models. It provides a robust platform to assess and compare the performance of different TTS systems using objective metrics. The leaderboard serves as a centralized resource to track advancements in TTS technology and foster innovation in the field.
• Support for Multiple TTS Models: Evaluate and compare various TTS models in a unified framework. • Objective Metrics: Leverage established metrics such as Mean Opinion Score (MOS), Mel-Cepstral Distortion (MCD), and Word Error Rate (WER) to assess model performance. • Automated Benchmarking: Streamline the evaluation process with automated tools for efficient and consistent testing. • Customizable Datasets: Use predefined or custom datasets to tailor evaluations to specific use cases. • Comprehensive Reports: Generate detailed reports with insights into model strengths, weaknesses, and areas for improvement. • Leaderboard Updates: Regularly updated leaderboards to reflect the latest advancements in TTS technology.
What models are supported by TTSDS Benchmark and Leaderboard?
TTSDS Benchmark and Leaderboard supports a wide range of TTS models, including both open-source and commercial systems. Check the documentation for the full list of supported models.
Do I need to use only objective metrics for evaluation?
While TTSDS Benchmark and Leaderboard primarily focuses on objective metrics, you can also incorporate subjective evaluations for a more comprehensive assessment.
How do I access the TTSDS Leaderboard?
Access the TTSDS Leaderboard through the official website or platform. Registration may be required to submit your model for evaluation and view detailed results.