Video processing in Python

VideoSys: An easy and efficient system for video generation

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

A PyTorch Native LLM Training Framework

ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Experts via Clustering

Development repository for the Triton language and compiler

该仓库主要记录 大模型（LLMs） 算法工程师相关的面试题

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

Fast and memory-efficient exact attention

Scale LLM Engine public repository

DeepSeek LLM: Let there be answers

Transformer related optimization, including BERT, GPT

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Running large language models on a single GPU for throughput-oriented scenarios.

pdf

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Sparsity-aware deep learning inference runtime for CPUs

Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language Models"

FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Text Generation Inference

A high-throughput and memory-efficient inference and serving engine for LLMs

Beringei is a high performance, in-memory storage engine for time series data.

User-friendly Desktop Client App for AI Models/LLMs (GPT, Claude, Gemini, Ollama...)

RISC Zero is a zero-knowledge verifiable general computing platform based on zk-STARKs and the RISC-V microarchitecture.

A curated list of insanely awesome libraries, packages and resources for Quants (Quantitative Finance)

Using Low-rank adaptation to quickly fine-tune diffusion models.