🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

A pytorch quantization backend for optimum

Train transformer language models with reinforcement learning.

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

Gemma 2 optimized for your local machine.

The official Python client for the Huggingface Hub.

Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines

LLM training in simple, raw C/CUDA

Large Language Model Text Generation Inference

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

Simple, safe way to store and distribute tensors

8-bit CUDA functions for PyTorch

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Small chrome extension to open notifications

Inference code for Mistral and Mixtral hacked up into original Llama implementation

Pipeline Parallelism for PyTorch

Fast and hackable pytorch native transformer inference. Meant to be copied and modified

Utilities to use the Hugging Face hub API

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Minimalist ML framework for Rust

Public repo for HF blog posts

A fast inference library for running LLMs locally on modern consumer-class GPUs

A multi-backend utility for benchmarking Transformers and Diffusers with support for hardware specific Optimum optimizations/quantization schemas

Enabling PyTorch on XLA Devices (e.g. Google TPU)

Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

Notebooks using the Hugging Face libraries 🤗