fatchord/WaveRNN

★ 2,190⑂ 685

WaveRNN Vocoder + TTS

About fatchord/WaveRNN

fatchord/WaveRNN is an open-source project on GitHub, mainly written in Python. WaveRNN Vocoder + TTS It currently holds 2,190 stars and 685 forks with 108 open issues, and was last pushed on 2022-07-02 (repository created 2018-03-16).

Project Overview

Git Homed tracks it on the Audio Trending board and on the AI Audio Trending list.

GitHub Repository Details

Repository fatchord/WaveRNN · default branch master · size 247941 KB · watchers 85 · source: GitHub REST API and repository README

README

WaveRNN

(Update: Vanilla Tacotron One TTS system just implemented - more coming soon!)
Tacotron with WaveRNN diagrams

Pytorch implementation of Deepmind's WaveRNN model from Efficient Neural Audio Synthesis

Installation

Ensure you have:

Then install the rest with pip:

pip install -r requirements.txt

How to Use

Quick Start

If you want to use TTS functionality immediately you can simply use:

python quick_start.py

This will generate everything in the default sentences.txt file and output to a new 'quick_start' folder where you can playback the wav files and take a look at the attention plots

You can also use that script to generate custom tts sentences and/or use '-u' to generate unbatched (better audio quality):

python quick_start.py -u --input_text "What will happen if I run this command?"

Training your own Models

Attenion and Mel Training GIF

Download the LJSpeech Dataset.

Edit hparams.py, point wav_path to your dataset and run:

python preprocess.py

or use preprocess.py --path to point directly to the dataset ___

Here's my recommendation on what order to run things:

1 - Train Tacotron with:

python train_tacotron.py

2 - You can leave that finish training or at any point you can use:

python train_tacotron.py --force_gta

this will force tactron to create a GTA dataset even if it hasn't finish training.

3 - Train WaveRNN with:

python train_wavernn.py --gta

NB: You can always just run train_wavernn.py without --gta if you're not interested in TTS.

4 - Generate Sentences with both models using:

python gen_tacotron.py wavernn

this will generate default sentences. If you want generate custom sentences you can use

python gen_tacotron.py --input_text "this is whatever you want it to be" wavernn

And finally, you can always use --help on any of those scripts to see what options are available :)

Samples

Can be found here.

Pretrained Models

Currently there are two pretrained models available in the /pretrained/ folder':

Both are trained on LJSpeech

____

References

Acknowlegements

GitHub Stars & Activity

2,190Stars
685Forks
108Open issues
PythonLanguage

GitHub Popularity

GitHub stars2,190
Forks685
Open issues108
Primary languagePython
LicenseMIT
Stars gained today0
Created2018-03-16
Last pushed2022-07-02

Trending History

Trending statusnot on today's boards

Related GitHub Projects

1

huggingface / transformers

Python★ 169,134⑂ 0
→
2

debpalash / VoiceStudio

Python★ 112,289⑂ 0
→
3

RVC-Boss / GPT-SoVITS

Python★ 65,245⑂ 0
→
4

coqui-ai / TTS

Python★ 46,240⑂ 0
→
5

OpenBMB / VoxCPM

Python★ 42,576⑂ 0
→
6

2noise / ChatTTS

Python★ 40,013⑂ 0
→
7

myshell-ai / OpenVoice

Python★ 38,265⑂ 0
→
8

babysor / MockingBird

Python★ 36,862⑂ 0
→

More Trending Repositories