Accessible large language models via k-bit quantization for PyTorch.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Intel® Extension for DeepSpeed* is an extension that brings Intel GPU (XPU) support to DeepSpeed.

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

Deep learning framework to train, deploy, and ship AI products Lightning fast.

Reference implementations of MLPerf™ training benchmarks

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

allreduce benchmark using deepspeed

Intel developer staging area for unmerged upstream patch contributions to libjpeg-turbo