Tensors and Dynamic neural networks in Python with strong GPU acceleration

Animation engine for explanatory math videos

The Python programming language

《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

Inference code for Llama models

openpilot is an operating system for robotics. Currently, it upgrades the driver assistance system in 275+ supported cars.

Grok open release

Making large AI models cheaper, faster and more accessible

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Official Code for DragGAN (SIGGRAPH 2023)

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

PyTorch Tutorial for Deep Learning Researchers

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

A high-throughput and memory-efficient inference and serving engine for LLMs

You like pytorch? You like micrograd? You love tinygrad! ❤️

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

Open-Sora: Democratizing Efficient Video Production for All

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Optional static typing for Python

GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Fast and memory-efficient exact attention

Python package built to ease deep learning on graph, on top of existing DL frameworks.

A framework for managing and maintaining multi-language pre-commit hooks.

Mamba SSM architecture

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference,…

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)