An Open-Sourced LLM-empowered Foundation TTS System

Official code of the paper: Draw an Audio: Leveraging Multi-Instruction for Video-to-Audio Synthesis.

Reverse Engineering of Supervised Semantic Speech Tokenizer (S3Tokenizer) proposed in CosyVoice

open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.

A small seq2seq punctuator tool based on DistilBERT

real time face swap and one-click video deepfake with only a single image

Multilingual Voice Understanding Model

LLM based TTS model, providing inference/training/deployment full-stack ability.

A feature-rich command-line audio/video downloader

Chinese Mandarin Grapheme-to-Phoneme Converter. 中文轉注音或拼音 (INTERSPEECH 2022)

📖 A curated list of resources dedicated to talking face.

Speech, Language, Audio, Music Processing with Large Language Model

Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models

ChatTTS is a generative speech model for daily dialogue.

This is the official repo of our work titled "The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audio".

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

Zero-Shot Speech Editing and Text-to-Speech in the Wild

Building your own video generation model like OpenAI's Sora

The Mini Sora project aims to explore the implementation path and future development direction of Sora.

This project aim to reproducing Sora (Open AI T2V model), but we only have limited resource. We deeply wish the all open source community can contribute to this project.

Deep Learning System core principles introduction.

[Arxiv] A Survey on Video Diffusion Models

(ෆ`꒳´ෆ) A Survey on Text-to-Image Generation/Synthesis.

PyTorch code and models for V-JEPA self-supervised learning from video.

Daily updated LLM papers. 每日更新 LLM 相关的论文，欢迎订阅 👏 喜欢的话动动你的小手 🌟 一个

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

Brand new TTS solution