A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

Debugging Megatron. 3D Parallelism, models, training and more!

Minimalistic large language model 3D-parallelism training

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Provides end-to-end model development pipelines for LLMs and Multimodal models that can be launched on-prem or cloud-native.

A native PyTorch Library for large model training

Go ahead and axolotl questions

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

Documentation for UPC 2023 Datathon Challenge

Audio Dataset for training CLAP and other models