Trending open-source projects · updated daily

Audio GitHub Trending

The audio board covers speech and sound: text-to-speech, speech recognition, voice cloning, music generation, source separation, transcription and audio processing libraries. It is assembled from GitHub topic pages for text-to-speech, speech recognition and music generation and ranked by stars, which makes it a quick survey of where the open-source audio stack currently stands — classic toolkits sit beside this year's model releases. Every entry lists language, stars and forks and opens a detail page with description, license, last push date and README, plus related audio projects. For anyone wiring voice into a product or processing recordings at scale, the activity dates on those pages matter as much as the star counts.

Trending Audio Projects

1

huggingface / transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python★ 169,134⑂ 0
View huggingface/transformers
→
2

debpalash / VoiceStudio

VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.

Python★ 112,289⑂ 0
View debpalash/VoiceStudio
→
3

RVC-Boss / GPT-SoVITS

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

Python★ 65,245⑂ 0
View RVC-Boss/GPT-SoVITS
→
4

ggml-org / whisper.cpp

Port of OpenAI's Whisper model in C/C++

C++★ 55,265⑂ 0
View ggml-org/whisper.cpp
→
5

coqui-ai / TTS

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

Python★ 46,240⑂ 0
View coqui-ai/TTS
→
6

OpenBMB / VoxCPM

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

Python★ 42,576⑂ 0
View OpenBMB/VoxCPM
→
7

2noise / ChatTTS

A generative speech model for daily dialogue.

Python★ 40,013⑂ 0
View 2noise/ChatTTS
→
8

myshell-ai / OpenVoice

Instant voice cloning by MIT and MyShell. Audio foundation model.

Python★ 38,265⑂ 0
View myshell-ai/OpenVoice
→
9

babysor / MockingBird

🚀Clone a voice in 5 seconds to generate arbitrary speech in real-time

Python★ 36,862⑂ 0
View babysor/MockingBird
→
10

SYSTRAN / faster-whisper

Faster Whisper transcription with CTranslate2

Python★ 26,817⑂ 0
View SYSTRAN/faster-whisper
→
11

mozilla / DeepSpeech

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

C++★ 26,777⑂ 0
View mozilla/DeepSpeech
→
12

m-bain / whisperX

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

Python★ 25,397⑂ 0
View m-bain/whisperX
→
13

index-tts / index-tts

An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System

Python★ 25,146⑂ 0
View index-tts/index-tts
→
14

QwenAudio / CosyVoice

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Python★ 24,430⑂ 0
View QwenAudio/CosyVoice
→
15

modelscope / FunASR

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

Python★ 21,057⑂ 0
View modelscope/FunASR
→
16

nari-labs / dia

A TTS model capable of generating ultra-realistic dialogue in one pass.

Python★ 19,409⑂ 0
View nari-labs/dia
→
17

k2-fsa / sherpa-onnx

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection.

C++★ 16,005⑂ 0
View k2-fsa/sherpa-onnx
→
18

alphacep / vosk-api

Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node

Jupyter Notebook★ 15,269⑂ 0
View alphacep/vosk-api
→
19

supertone-oss-archive / supertonic

Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.

Swift★ 13,752⑂ 0
View supertone-oss-archive/supertonic
→
20

multimodal-art-projection / YuE

YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.

Python★ 13,555⑂ 0
View multimodal-art-projection/YuE
→
21

abus-aikorea / voice-pro

Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download

Python★ 13,441⑂ 0
View abus-aikorea/voice-pro
→
22

PaddlePaddle / PaddleSpeech

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System

Python★ 12,713⑂ 0
View PaddlePaddle/PaddleSpeech
→
23

rany2 / edge-tts

Use Microsoft Edge's online text-to-speech service from Python WITHOUT needing Microsoft Edge

Python★ 12,564⑂ 0
View rany2/edge-tts
→
24

speechbrain / speechbrain

A PyTorch-based Speech Toolkit

Python★ 11,940⑂ 0
View speechbrain/speechbrain
→
25

rhasspy / piper

A fast, local neural text to speech system

C++★ 11,336⑂ 0
View rhasspy/piper
→
26

QuentinFuxa / WhisperLiveKit

Real-time, local speech-to-text with streaming ASR, speaker diarization, translation, and OpenAI/Deepgram-compatible APIs.

Python★ 11,258⑂ 0
View QuentinFuxa/WhisperLiveKit
→
27

open-mmlab / Amphion

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio

Python★ 10,344⑂ 0
View open-mmlab/Amphion
→
28

mozilla / TTS

🤖 💬 Deep learning for Text to Speech (Discussion forum: https://discourse.mozilla.org/c/tts)

Jupyter Notebook★ 10,188⑂ 0
View mozilla/TTS
→
29

espnet / espnet

End-to-End Speech Processing Toolkit

Python★ 10,020⑂ 0
View espnet/espnet
→
30

QwenAudio / SenseVoice

Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.

C★ 9,772⑂ 0
View QwenAudio/SenseVoice
→
31

Uberi / speech_recognition

Speech recognition module for Python, supporting several engines and APIs, online and offline.

Python★ 9,005⑂ 0
View Uberi/speech_recognition
→
32

netease-youdao / EmotiVoice

EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine

Python★ 8,545⑂ 0
View netease-youdao/EmotiVoice
→
33

nl8590687 / ASRT_SpeechRecognition

A Deep-Learning-Based Chinese Speech Recognition System 基于深度学习的中文语音识别系统

Python★ 8,406⑂ 0
View nl8590687/ASRT_SpeechRecognition
→
34

Neywa-Labs / mlx-audio

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

Python★ 8,285⑂ 0
View Neywa-Labs/mlx-audio
→
35

Plachtaa / VALL-E-X

An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io/vallex/

Python★ 7,907⑂ 0
View Plachtaa/VALL-E-X
→
36

jaywalnut310 / vits

VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech

Python★ 7,904⑂ 0
View jaywalnut310/vits
→
37

myshell-ai / MeloTTS

High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.

Python★ 7,722⑂ 0
View myshell-ai/MeloTTS
→
38

anomalyco / hex

Local voice dictation for mac, windows and linux

Rust★ 7,200⑂ 0
View anomalyco/hex
→
39

espeak-ng / espeak-ng

eSpeak NG is an open source speech synthesizer that supports more than hundred languages and accents.

C★ 7,041⑂ 0
View espeak-ng/espeak-ng
→
40

TalAter / annyang

💬 Speech recognition for your site

TypeScript★ 6,821⑂ 0
View TalAter/annyang
→
41

modelscope / FunClip

FunASR-powered video transcription, subtitle generation, and LLM-assisted clipping tool with a local Gradio UI.

Python★ 6,568⑂ 0
View modelscope/FunClip
→
42

argmaxinc / argmax-oss-swift

On-device Speech AI for Apple Silicon

Swift★ 6,460⑂ 0
View argmaxinc/argmax-oss-swift
→
43

flashlight / wav2letter

Facebook AI Research's Automatic Speech Recognition Toolkit

C++★ 6,444⑂ 0
View flashlight/wav2letter
→
44

yl4579 / StyleTTS2

StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models

Python★ 6,387⑂ 0
View yl4579/StyleTTS2
→
45

denizsafak / abogen

Generate audiobooks from EPUBs, PDFs and text with synchronized captions.

Python★ 6,235⑂ 0
View denizsafak/abogen
→
46

snakers4 / silero-models

Silero Models: pre-trained text-to-speech models made embarrassingly simple

Jupyter Notebook★ 6,204⑂ 0
View snakers4/silero-models
→
47

dograh-hq / dograh

Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.

Python★ 6,164⑂ 0
View dograh-hq/dograh
→
48

liuzhao1225 / YouDub-webui

Open-source AI video localization and dubbing for YouTube/Bilibili: speech recognition, subtitle translation, voice cloning, audio mixing and rendering. 开源 AI 视频翻译配音工具。

TypeScript★ 5,861⑂ 0
View liuzhao1225/YouDub-webui
→
49

remsky / Kokoro-FastAPI

Dockerized OpenAI-compatible wrapper for Kokoro-82M text-to-speech w/multiplatform CPU, AMD, NVIDIA GPU PyTorch; multi-speaker, clone-tuning, caption timestamps, SSML, websockets

Python★ 5,695⑂ 0
View remsky/Kokoro-FastAPI
→
50

MahmoudAshraf97 / whisper-diarization

Automatic Speech Recognition with Speaker Diarization based on OpenAI Whisper

Jupyter Notebook★ 5,676⑂ 0
View MahmoudAshraf97/whisper-diarization
→
51

wenet-e2e / wenet

Production First and Production Ready End-to-End Speech Recognition Toolkit

Python★ 5,257⑂ 0
View wenet-e2e/wenet
→
52

fspecii / ace-step-ui

🎵 The Ultimate Open Source Suno Alternative - Professional UI for ACE-Step 1.5 AI Music Generation. Free, local, unlimited. Stop paying for Suno!

JavaScript★ 5,231⑂ 0
View fspecii/ace-step-ui
→
53

AhmadHassan-BTed / B

An autonomous, context-aware AI desktop companion. Built with Python, featuring real-time screen vision, custom ONNX voice synthesis, active window tracking

Python★ 5,179⑂ 0
View AhmadHassan-BTed/B
→
54

Picovoice / porcupine

On-device wake word detection powered by deep learning

Python★ 5,025⑂ 0
View Picovoice/porcupine
→
55

MoonInTheRiver / DiffSinger

DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism (SVS & TTS); AAAI 2022; Official code

Python★ 4,901⑂ 0
View MoonInTheRiver/DiffSinger
→
56

jianchang512 / stt

Voice Recognition to Text Tool / 一个离线运行的本地音视频转字幕工具,输出json、srt字幕、纯文字格式

Python★ 4,852⑂ 0
View jianchang512/stt
→
57

OpenMOSS / MOSS-TTS-Nano

A 100M-parameter multilingual TTS model for real-time CPU inference, voice cloning, and 48 kHz stereo generation

Python★ 4,693⑂ 0
View OpenMOSS/MOSS-TTS-Nano
→
58

sanchit-gandhi / whisper-jax

JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.

Jupyter Notebook★ 4,678⑂ 0
View sanchit-gandhi/whisper-jax
→
59

collabora / WhisperLive

A nearly-live implementation of OpenAI's Whisper.

Python★ 4,362⑂ 0
View collabora/WhisperLive
→
60

cmusphinx / pocketsphinx

A small speech recognizer

C★ 4,356⑂ 0
View cmusphinx/pocketsphinx
→
61

OpenMOSS / MOSS-TTS

An open-source model family for long-form speech, dialogue synthesis, voice design, sound effects, and real-time streaming TTS

Python★ 4,338⑂ 0
View OpenMOSS/MOSS-TTS
→
62

0xShug0 / audio.cpp

An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance.

C++★ 4,315⑂ 0
View 0xShug0/audio.cpp
→
63

metavoiceio / metavoice-src

Foundational model for human-like, expressive TTS

Python★ 4,201⑂ 0
View metavoiceio/metavoice-src
→
64

huggingface / distil-whisper

Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.

Python★ 4,118⑂ 0
View huggingface/distil-whisper
→
65

KoljaB / RealtimeTTS

Converts text to speech in realtime

Python★ 4,060⑂ 0
View KoljaB/RealtimeTTS
→
66

IAHispano / Applio

A simple, high-quality voice conversion tool focused on ease of use and performance.

Python★ 4,026⑂ 0
View IAHispano/Applio
→
67

TensorSpeech / TensorFlowTTS

😝 TensorFlowTTS: Real-Time State-of-the-art Speech Synthesis for Tensorflow 2 (supported including English, French, Korean, Chinese, German and Easy to adapt for other languages)

Python★ 3,998⑂ 0
View TensorSpeech/TensorFlowTTS
→
68

HeartMuLa / heartlib

HeartMuLa Official Repo: The Most Powerful Open-Source Music Generation Model of 2026

Python★ 3,804⑂ 0
View HeartMuLa/heartlib
→
69

pnnbao97 / VieNeu-TTS

Vietnamese TTS with instant voice cloning • On-device • Real-time CPU inference • 48kHz audio quality • Chuyển văn bản thành giọng nói tiếng Việt • Text to speech tiếng Việt • TTS tiếng Việt

Python★ 3,443⑂ 0
View pnnbao97/VieNeu-TTS
→
70

ahmetoner / whisper-asr-webservice

OpenAI Whisper ASR Webservice API

Python★ 3,371⑂ 0
View ahmetoner/whisper-asr-webservice
→
71

rsxdalv / TTS-WebUI

A single Gradio + React WebUI with extensions for ACE-Step, OmniVoice, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice, ParlerTTS, Stable Audio, MMS, StyleTTS2, MAGNet

TypeScript★ 3,314⑂ 0
View rsxdalv/TTS-WebUI
→
72

QwenAudio / qwen-audio-agent

A realtime voice runtime that keeps Agents talking, working, and present. Real-time Voice Runtime for AI Agents

JavaScript★ 3,245⑂ 0
View QwenAudio/qwen-audio-agent
→
73

Purfview / whisper-standalone-win

Whisper & Faster-Whisper standalone executables for those who don't want to bother with Python.

★ 3,242⑂ 0
View Purfview/whisper-standalone-win
→
74

chenyme / Chenyme-AAVT

这是一个全自动(音频)视频翻译项目。利用Whisper识别声音,AI大模型翻译字幕,最后合并字幕视频,生成翻译后的视频。

Python★ 3,141⑂ 0
View chenyme/Chenyme-AAVT
→
75

HeyWillow / willow

Open source, local, and self-hosted Amazon Echo/Google Home competitive Voice Assistant alternative

C★ 3,140⑂ 0
View HeyWillow/willow
→
76

pluja / anysub

Turn audio and video into subtitles with an easy-to-use web UI. Everything runs on your own machine.

TypeScript★ 3,107⑂ 0
View pluja/anysub
→
77

AutoArk / GPA

[AutoArk] GPA (General Purpose Audio) can do ASR, TTS and voice conversion with one tiny model!

Python★ 3,055⑂ 0
View AutoArk/GPA
→
78

enhuiz / vall-e

An unofficial PyTorch implementation of the audio LM VALL-E

Python★ 2,968⑂ 0
View enhuiz/vall-e
→
79

readbeyond / aeneas

aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)

Python★ 2,877⑂ 0
View readbeyond/aeneas
→
80

linto-ai / whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

Python★ 2,862⑂ 0
View linto-ai/whisper-timestamped
→
81

zzw922cn / Automatic_Speech_Recognition

End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow

Python★ 2,835⑂ 0
View zzw922cn/Automatic_Speech_Recognition
→
82

Camb-ai / MARS5-TTS

MARS5 speech model (TTS) from CAMB.AI

Jupyter Notebook★ 2,813⑂ 0
View Camb-ai/MARS5-TTS
→
83

rhasspy / rhasspy

Offline private voice assistant for many human languages

Shell★ 2,753⑂ 0
View rhasspy/rhasspy
→
84

pndurette / gTTS

Python library and CLI tool to interface with Google Translate's text-to-speech API

Python★ 2,640⑂ 0
View pndurette/gTTS
→
85

digitalsamba / claude-code-video-toolkit

Make videos with Claude Code: script, AI voiceover, music, video clips and render, on open-source models that cost cents

Python★ 2,613⑂ 0
View digitalsamba/claude-code-video-toolkit
→
86

coqui-ai / STT

🐸STT - The deep learning toolkit for Speech-to-Text. Training and deploying STT models has never been so easy.

C++★ 2,604⑂ 0
View coqui-ai/STT
→
87

marytts / marytts

MARY TTS -- an open-source, multilingual text-to-speech synthesis system written in pure java

Java★ 2,581⑂ 0
View marytts/marytts
→
88

nateshmbhat / pyttsx3

Offline Text To Speech synthesis for python

Python★ 2,535⑂ 0
View nateshmbhat/pyttsx3
→
89

jik876 / hifi-gan

HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis

Python★ 2,380⑂ 0
View jik876/hifi-gan
→
90

timoncool / YuE2-Studio

Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.

TypeScript★ 2,287⑂ 0
View timoncool/YuE2-Studio
→
91

OpenMOSS / MOSS-Transcribe-Diarize

A 0.9B model for long-form transcription in 50+ languages with speaker diarization, timestamps, and acoustic event awareness

Python★ 2,281⑂ 0
View OpenMOSS/MOSS-Transcribe-Diarize
→
92

leemysw / yovoice

Open-source local AI audio & music studio for macOS & Windows. TTS, voice cloning, songs with lyrics, and multi-track scores — 100% offline, zero API fees.

TypeScript★ 2,231⑂ 0
View leemysw/yovoice
→
93

lifeiteng / vall-e

PyTorch implementation of VALL-E(Zero-Shot Text-To-Speech), Reproduced Demo https://lifeiteng.github.io/valle/index.html

Python★ 2,218⑂ 0
View lifeiteng/vall-e
→
94

DigitalPhonetics / IMS-Toucan

Controllable and fast Text-to-Speech for over 7000 languages!

Python★ 2,212⑂ 0
View DigitalPhonetics/IMS-Toucan
→
95

fatchord / WaveRNN

WaveRNN Vocoder + TTS

Python★ 2,190⑂ 0
View fatchord/WaveRNN
→
96

pannous / tensorflow-speech-recognition

🎙Speech recognition using the tensorflow deep learning framework, sequence-to-sequence neural networks

Python★ 2,171⑂ 0
View pannous/tensorflow-speech-recognition
→
97

travisvn / openai-edge-tts

Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs

Python★ 2,169⑂ 0
View travisvn/openai-edge-tts
→
98

react-native-voice / voice

🎤 React Native Voice Recognition library for iOS and Android (Online and Offline Support)

TypeScript★ 2,161⑂ 0
View react-native-voice/voice
→
99

salu133445 / musegan

An AI for Music Generation

Python★ 2,045⑂ 0
View salu133445/musegan
→
100

techjarves / Portable-Local-Studio

Portable local AI studio for Windows, Linux, and macOS. Zero-setup GUI for Image Generation, GGUF LLMs, Text to Speech & Speech to Text

JavaScript★ 2,040⑂ 0
View techjarves/Portable-Local-Studio
→

Speech AI GitHub Projects

Text-to-Speech Repositories

Audio Processing Tools

More GitHub Trending Projects

1

obra / superpowers

Shell★ 318,900⑂ 28,421▲ 1,905 stars
→
2

dream-num / univer

TypeScript★ 28,626⑂ 2,606▲ 1,828 stars
→
3

elementalsouls / Claude-BugHunter

Python★ 7,963⑂ 1,237▲ 1,094 stars
→
4

stablyai / orca

TypeScript★ 127,260⑂ 8,075▲ 1,052 stars
→
5

Tencent / LoopForge

Go★ 2,696⑂ 396▲ 1,020 stars
→
6

alibaba / open-code-review

Go★ 53,324⑂ 4,381▲ 951 stars
→

Related GitHub Trending Lists