Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
VibeVoiceFusion is a full-stack, multi-speaker voice generation web system featuring LoRA fine-tuning, batch generation, and VRAM optimization. Based on Microsoft's VibeVoice (AR + diffusion architecture)
| Date | Stars |
|---|---|
| 2026-07-31 | 486 |
| 2026-08-07 | 487 |
| 2026-08-15 | 490 |
| 2026-09-06 | 491 |
| 2026-09-24 | 490 |
| 2026-09-30 | 490 |
| 2026-10-01 | 490 |
| 2026-10-02 | 490 |
| 2026-10-03 | 489 |
| 2026-10-06 | 490 |
| 2026-10-10 | 491 |
| 2026-10-12 | 492 |
| 2026-10-15 | 493 |
| 2026-10-17 | 494 |
| 2026-10-19 | 495 |
| 2026-10-30 | 494 |
| 2026-11-03 | 495 |
| 2026-11-04 | 495 |
Today
— stars today
This week
— stars this week
This month
+6 stars this month
Momentum
0.0
growth rate 0.00%/day
# VibeVoiceFusion
<div align="center">
<img src="frontend/public/icon-rect-pulse.svg" alt="VibeVoiceFusion Logo" width="120"/>
**A Complete Web Application for Multi-Speaker Voice Generation**
*Built on Microsoft's VibeVoice Model*
[](LICENSE)
[](https://www.python.org/)
[](https://www.typescriptlang.org/)
[](Dockerfile)
[](https://hub.docker.com/r/zhaokundev/vibevoicefusion)
[](https://hub.docker.com/r/zhaokundev/vibevoicefusion)
[](https://hub.docker.com/r/zhaokundev/vibevoicefusion)
[English](README.md) | [简体中文](README_zh.md)
[Features](#features) • [Demo Samples](#demo-samples) • [Get Started](#get-started) • [Documentation](#documentation) • [Community](#community) • [Contributing](#contributing)
</div>
---
## Overview
### Introduction
VibeVoiceFusion is a web application for **multi-speaker speech generation with voice cloning** and **speech recognition**, built on Microsoft's VibeVoice models. It brings text-to-speech, file transcription and live microphone transcription together in one bilingual (English/Chinese) web interface. It also covers LoRA fine-tuning and an OpenAI-compatible API, and it runs on consumer GPUs with 10GB+ of VRAM.
<div align="center">
<a href="https://youtu.be/J9pmcOBWN4c" target="_blank">
<img src="docs/images/VibevoiceFusion.png" alt="Video Introduction" width="700"/>
</a>
</div>
### Features
#### Speech Generation
- **Multi-speaker dialogue** with voice cloning from short reference samples
- **Narration mode** for single-speaker content such as audiobooks and articles
- **Quick Generate**: generate without any project setup, using uploaded or preset voices
- **Multi-Generation**: 2-20 variations with different seeds in one run
- **Dialog editor** with a visual editor and a text editor
#### Speech Recognition
- **File transcription** with VibeVoice-ASR: segments with timestamps and speaker labels, downloadable as TXT or JSON
- **Live transcription** from the browser microphone, with text streaming in as you speak
- Saved transcription history, standalone or inside a project
#### LoRA Fine-Tuning
- **Dataset management** with ZIP or folder import and export
- **LoRA training** with live loss and learning-rate charts
- Trained LoRAs can be applied during generation with an adjustable weight
#### Runs on Consumer GPUs
- **Float8 quantization** halves model memory (RTX 40 series and newer)
- **Layer offloading** presets (Balanced / Aggressive / Extreme) for GPUs with 10GB+ of VRAM. See [VRAM Requirements](#vram-requirements).
#### Integration & Deployment
- **OpenAI-compatible API**: `/v1/audio/speech`, `/v1/audio/transcriptions` and the Realtime WebSocket `/v1/realtime`, so existing OpenAI SDKs work as-is
- **Full English/Chinese UI** with automatic language detection
- **Docker image** on Docker Hub
- **CLI tools** for TTS, streaming TTS with Realtime 0.5B, ASR, and model conversion
---
## Demo Samples
Listen to voice generation samples created with VibeVoiceFusion. Click the links below to download and play:
### Single Speaker
**🎧 [Pandora's Box Story (BFloat16 Model)](https://raw.githubusercontent.com/zhao-kun/VibeVoiceFusion/main/demo/outputs/1p_pandora_box_bf16.wav)**
*Generated with bfloat16 precision model - Full quality, 14GB VRAM*
**🎧 [Pandora's Box Story (Float8 Model)](https://raw.githubusercontent.com/zhao-kun/VibeVoiceFusion/main/demo/outputs/1p_pandora_box_float8_e4m3fn.wav)**
*GeneratedExcerpt of 22,860 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:5da211c1a7963079, topic:fine-tuning, topic:lora, desc:fine-tuning
matched fp:5da211c1a7963079, topic:tts, topic:speech-synthesis, readme:speech recognition