Implementing DeepSeek R1's GRPO algorithm from scratch

Clean, minimal, accessible reproduction of DeepSeek R1-Zero

Official repository for our work on micro-budget training of large-scale diffusion models.

NanoGPT (124M) in 3 minutes

A PyTorch native library for large-scale model training

Efficient Triton Kernels for LLM Training

A MLX port of FLUX based on the Huggingface Diffusers implementation.

Official inference repo for FLUX.1 models

the scott CPU from "But How Do It Know?" by J. Clark Scott

Run PyTorch LLMs locally on servers, desktop and mobile

Animation engine for explanatory math videos

A lightweight library for portable low-level GPU computation using WebGPU.

Simple Byte pair Encoding mechanism used for tokenization process . written purely in C

UNet diffusion model in pure CUDA

[ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling

gpt-2 from scratch in mlx

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

Implementation of Diffusion Transformer (DiT) in JAX

Implementation for MatMul-free LM.

Schedule-Free Optimization in PyTorch

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 16+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI

My favorite C programming practices.

Tile primitives for speedy kernels

A minimal GPU design in Verilog to learn how GPUs work from the ground up

lightweight, standalone C++ inference engine for Google's Gemma models.

LLM inference in C/C++

Distribute and run LLMs with a single file.

A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.