Tensors and Dynamic neural networks in Python with strong GPU acceleration

Material for gpu-mode lectures

Solve puzzles. Improve your pytorch.

A concise but complete full-attention transformer with a set of promising experimental features from various papers

Solve puzzles. Learn CUDA.

Open h.265 video codec implementation.

hpc-learning

仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理

A generative world for general-purpose robotics & embodied AI learning.

Use a 3-axis machine as a pen plotter

A generative art sketch for creating plotter art in Processing

Distributed Systems Labs and Framework

LLM101n: Let's build a Storyteller

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

📚Modern CUDA Learn Notes: 200+ Tensor/CUDA Cores Kernels🎉, HGEMM, FA2 via MMA and CuTe, 98~100% TFLOPS of cuBLAS/FA2.

The simplest, fastest repository for training/finetuning medium-sized GPTs.

LLM training in simple, raw C/CUDA

Introduction to Parallel Programming class code

LightSeq: A High Performance Library for Sequence Processing and Generation

精益副业：程序员如何优雅地做副业

利用Stable-Diffution API去除图片ai感

Computer Vision: From 3D Reconstruction to Recognition

Here is a list of 3D vision resources

Generative Agents: Interactive Simulacra of Human Behavior

AgentSims is an easy-to-use infrastructure for researchers from all disciplines to test the specific capacities they are interested in.

Official implementation of "Neuralangelo: High-Fidelity Neural Surface Reconstruction" (CVPR 2023)

Discover is a showcase of the Meta Quest Mixed Reality APIs. This project demonstrate how to use Passthrough, Spatial Anchors, Scene API, Colocation and Shared Anchors.

Source code for Nova Apple XR concept video

ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation (NeurIPS 2023 Spotlight)

The official code repository for the second edition of the O'Reilly book Generative Deep Learning: Teaching Machines to Paint, Write, Compose and Play.