MuseTalk: Real-Time High Quality Lip Synchorization with Latent Space Inpainting

Stable Diffusion web UI

Code and dataset for photorealistic Codec Avatars driven from audio

AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation

带HTTP API的数字人视频播放器，使用gradio api对接Easy-Wav2Lip、Sadtalker、GeneFacePlusPlus

Grok open release

Clone a voice in 5 seconds to generate arbitrary speech in real-time

High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.

This project aim to reproducing Sora (Open AI T2V model), but we only have limited resource. We deeply wish the all open source community can contribute to this project.

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for c…

[CVPR 2024] This is the official source for our paper "SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis"

Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference,…

通过此代码可以免训练模型并通过轻量级服务器定制数字人形象

GeneFace++: Generalized and Stable Real-Time 3D Talking Face Generation; Official Code

[CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation

An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io

[CVPR 2024] MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model

Voice data <= 10 mins can also be used to train a good VC model!

Foundational Models for State-of-the-Art Speech and Text Translation

Wav2Lip UHQ extension for Automatic1111

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

Bark Voice Cloning and Voice Cloning for Chinese Speech

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

langchain-ChatGLM, local knowledge based ChatGLM with langchain ｜ 基于本地知识库的 ChatGLM 问答

🔊 Text-Prompted Generative Audio Model

SoftVC VITS Singing Voice Conversion

[ICCV'23] Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis