Digital Avatar Conversational System - Linly-Talker. 😄✨ Linly-Talker is an intelligent AI system that combines large language models (LLMs) with visual models to create a novel human-AI interaction…

MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes; NeurIPS 2024; Official code

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Multilingual Voice Understanding Model

Interface for OuteTTS models.

Fast and accurate automatic speech recognition (ASR) for edge devices

Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"

Open source inference code for Rev's model

SenseVoice-python: A enterprise-grade open source multi-language asr system from funasr opensource with onnxruntime

Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D taking face running locally across platforms

实时语音交互数字人，支持端到端语音方案（GLM-4-Voice - THG）和级联方案（ASR-LLM-TTS-THG）。可自定义形象与音色，无须训练，支持音色克隆，首包延迟低至3s。Real-time voice interactive digital human, supporting end-to-end voice solutions (GLM-4-Voice - THG) and …

Diffusion-based Portrait and Animal Animation

EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animation

This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs

本项目基于SadTalkers实现视频唇形合成的Wav2lip。通过以视频文件方式进行语音驱动生成唇形，设置面部区域可配置的增强方式进行合成唇形（人脸）区域画面增强，提高生成唇形的清晰度。使用DAIN 插帧的DL算法对生成视频进行补帧，补充帧间合成唇形的动作过渡，使合成的唇形更为流畅、真实以及自然。

Real time interactive streaming digital human

一个超轻量级、可以在移动端实时运行的数字人模型

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

[LCLR 2025 Oral] TANGO: Co-Speech Gesture Video Reenactment with Hierarchical Audio-Motion Embedding and Diffusion Interpolation

Voice activity detector (VAD) for the browser with a simple API

Fay is an open-source digital human framework integrating language models and digital characters. It offers retail, assistant, and agent versions for diverse applications like virtual shopping guid…

MuseTalk: Real-Time High Quality Lip Synchorization with Latent Space Inpainting

[CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation

📣 商用级开源语音自动识别程序库，开箱即用，全平台支持，中英文混合识别。A Cross-platform implementation of ASR inference. It's based on ONNXRuntime and FunASR. We provide a set of easier APIs to call ASR models.

A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.

每个人都能用的数字人

Awesome Digital Human

AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation

GeneFace++: Generalized and Stable Real-Time 3D Talking Face Generation; Official Code

PersonaTalk Hack