Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
OpenAI compatible TTS for Sesame CSM:1b & dia:1.6b - Voice Cloning from File/YT
| Date | Stars |
|---|---|
| 2026-07-31 | 437 |
| 2026-08-02 | 437 |
| 2026-08-06 | 437 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# CSM-1B TTS API An OpenAI-compatible Text-to-Speech API that harnesses the power of Sesame's Conversational Speech Model (CSM-1B). This API allows you to generate high-quality speech from text using a variety of consistent voices, compatible with systems like OpenWebUI, and any platform that supports the OpenAI TTS API format. ## Features - **OpenAI API Compatibility**: Drop-in replacement for OpenAI's TTS API - **Multiple Voices**: Six distinct voices (alloy, echo, fable, onyx, nova, shimmer) - **Voice Consistency**: Maintains consistent voice characteristics across multiple requests - **Voice Cloning**: Clone your own voice from audio samples - **Conversational Context**: Supports conversational context for improved naturalness - **Multiple Audio Formats**: Supports MP3, OPUS, AAC, FLAC, and WAV - **Speed Control**: Adjustable speech speed - **CUDA Acceleration**: GPU support for faster generation - **Web UI**: Simple interface for voice cloning and speech generation ## Getting Started ### Prerequisites - Docker and Docker Compose - NVIDIA GPU with CUDA support (recommended) - Hugging Face account with access to `sesame/csm-1b` model ### Installation 1. Clone this repository: ```bash git clone https://github.com/phildougherty/sesame_csm_openai cd sesame_csm_openai ``` 2. Create a `.env` file in the /app folder with your Hugging Face token: ``` HF_TOKEN=your_hugging_face_token_here ``` 3. Build and start the container: ```bash docker compose up -d --build ``` The server will start on port 8000. First startup may take some time as it downloads the model files. ## Hugging Face Configuration (ONLY NEEDED TO ACCEPT TERMS/DOWNLOAD MODEL) This API requires access to the `sesame/csm-1b` model on Hugging Face: 1. Create a Hugging Face account if you don't have one: [https://huggingface.co/join](https://huggingface.co/join) 2. Accept the model license at [https://huggingface.co/sesame/csm-1b](https://huggingface.co/sesame/csm-1b) 3. Generate an access token at [https://huggingface.co/settings/tokens](https://huggingface.co/settings/tokens) 4. Use this token in your `.env` file or pass it directly when building the container: ```bash HF_TOKEN=your_token docker compose up -d --build ``` ### Required Models The API uses the following models which are downloaded automatically: - **CSM-1B**: The main speech generation model from Sesame - **Mimi**: Audio codec for high-quality audio generation - **Llama Tokenizer**: Uses the unsloth/Llama-3.2-1B tokenizer for text processing ## Multi-GPU Support The CSM-1B model can be distributed across multiple GPUs to handle larger models or improve performance. To enable multi-GPU support, set the `CSM_DEVICE_MAP` environment variable: ```bash # Automatic device mapping (recommended) CSM_DEVICE_MAP=auto docker compose up -d # Balanced distribution of layers across GPUs CSM_DEVICE_MAP=balanced docker compose up -d # Sequential distribution (backbone on first GPUs, decoder on remaining) CSM_DEVICE_MAP=sequential docker compose up -d ## Voice Cloning Guide The CSM-1B TTS API comes with powerful voice cloning capabilities that allow you to create custom voices from audio samples. Here's how to use this feature: ### Method 1: Using the Web Interface 1. Access the voice cloning UI by navigating to `http://your-server-ip:8000/voice-cloning` in your browser. 2. **Clone a Voice**: - Go to the "Clone Voice" tab - Enter a name for your voice - Upload an audio sample (2-3 minutes of clear speech works best) - Optionally provide a transcript of the audio for better results - Click "Clone Voice" 3. **View Your Voices**: - Navigate to the "My Voices" tab to see all your cloned voices - You can preview or delete voices from this tab 4. **Generate Speech**: - Go to the "Generate Speech" tab - Select one of your cloned voices - Enter the text you want to synthesize - Adjust the temperature slider if needed (lower for more consistent results) - Click "Gene
Excerpt of 16,532 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:fb685b94331cebd3, desc:voice cloning