Foundational Models for State-of-the-Art Speech and Text Translation

Simple text to phones converter for multiple languages

A fast, local neural text to speech system

Instant voice cloning

The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audi…

StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models

EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine

vits2 backbone with bert

Open source audio annotation tool for humans

The Open Source Code of UniAudio

NISQA - Non-Intrusive Speech Quality and TTS Naturalness Assessment

语音方向实验室/公司/资源/实习等，欢迎推荐或自荐

第一个支持中英文双语语音-文本多模态对话的开源可商用对话模型。便捷的语音输入将大幅改善以文本为输入的大模型的使用体验，同时避免了基于 ASR 解决方案的繁琐流程以及可能引入的错误。

An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io

Text-to-Audio/Music Generation

Pytorch implementation of the CREPE pitch tracker

GUI for a Vocal Remover that uses Deep Neural Networks.

State-of-the-art deep learning based audio codec supporting both mono 24 kHz audio and stereo 48 kHz audio.

A repository for single- and multi-modal speaker verification, speaker recognition, and speaker diarization.

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable…

Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding

This repo is a pipeline of VITS finetuning for fast speaker adaptation TTS, and many-to-many voice conversion

Perceptual Quality Estimator for speech and audio

[CVPR 2023] DPE: Disentanglement of Pose and Expression for General Video Portrait Editing

PaddlePaddle GAN library, including lots of interesting applications like First-Order motion transfer, Wav2Lip, picture repair, image editing, photo2cartoon, image style transfer, GPEN, and so on.

Codes and Model of the paper "Text-to-Audio Generation using Instruction Tuned LLM and Latent Diffusion Model"

Praat in Python, the Pythonic way

How to use our public wav2vec2 age and gender model

MiniGPT-4: Enhancing Vision-language Understanding with Advanced Large Language Models