Fish Speech — screenshot of speech.fish.audio

Fish Speech

Fish Speech is an impressive open-source AI model for voice cloning and advanced text-to-speech. It offers fine-grained control and multilingual capabilities, setting a high bar for quality among both open and closed source systems.

Visit speech.fish.audio →

Questions & Answers

What is Fish Speech?
Fish Speech (specifically Fish Audio S2) is an open-source text-to-speech system that leverages a Dual-Autoregressive architecture and reinforcement learning for natural, realistic, and emotionally rich speech generation. It supports rapid voice cloning and multilingual output.
Who is Fish Speech designed for?
Fish Speech is designed for developers, researchers, and AI agents needing a high-quality, controllable, and efficient text-to-speech and voice cloning solution. It is suitable for applications requiring advanced speech synthesis capabilities.
How does Fish Speech compare to other text-to-speech models?
Fish Speech S2 differentiates itself with its Dual-Autoregressive architecture, reinforcement learning alignment, and fine-grained inline control via natural language. It boasts superior benchmark results against both open-source and closed-source systems in areas like WER and Audio Turing Test scores.
When should I consider using Fish Speech for a project?
Use Fish Speech when you require high-fidelity, emotionally rich, and controllable speech generation, especially for multilingual content or scenarios demanding rapid voice cloning. Its production streaming capabilities via SGLang make it suitable for real-time applications.
What are the technical requirements for running Fish Speech inference?
For inference, Fish Speech requires a GPU with at least 4GB of memory and can run on Linux or Windows systems. The flagship model, S2-Pro, has 4 billion parameters and can achieve a Real-Time Factor (RTF) of 0.195 on an NVIDIA H200 GPU.