Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

Lab Materials for MIT 6.S191: Introduction to Deep Learning

An AI for Music Generation

🧠+🎧 Build your music algorithms and AI models with the next-gen DAW 🔥

Apply diffusion models using the new Hugging Face diffusers package to synthesize music instead of images.

Resources on Music Generation with Deep Learning

MIDI / symbolic music tokenizers for Deep Learning models 🎶

a list of demo websites for automatic music generation research

AI Audio Datasets (AI-ADS) 🎵, including Speech, Music, and Sound Effects, which can provide training data for Generative AI, AIGC, AI model training, intelligent audio tool development, and audio applications.

Train an LSTM to generate piano or violin/piano music.

"Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions", ACM Multimedia 2020

Generate music from the entropy of Linux 🐧🎵

Implementation of MusicLM, a text to music model published by Google Research, with a few modifications.

OpenMusic: SOTA Text-to-music (TTM) Generation

A toolkit for symbolic music generation

A complete and open application for automatic backing tracks generation.

ICASSP 2023-2024 Papers: A complete collection of influential and exciting research papers from the ICASSP 2023-24 conferences. Explore the latest advancements in acoustics, speech and signal processing. Code included. Star the repository to support the advancement of audio and signal processing!

A paper and project list about the cutting edge Speech Synthesis, Text-to-Speech (TTS), Singing Voice Synthesis (SVS), Voice Conversion (VC), Singing Voice Conversion (SVC), and related interesting works (such as Music Synthesis, Automatic Music Transcription, Automatic MOS Prediction, SSL-based ASR...etc).

Daily tracking of awesome audio papers, including music generation, zero-shot tts, asr, audio generation

Experiment diverse Deep learning models for music generation with TensorFlow