Scalable data pre processing and curation toolkit for LLMs

Go ahead and axolotl questions

Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

veRL: Volcano Engine Reinforcement Learning for LLM

SuperCorrect: Supervising and Correcting Language Models with Error-Driven Insights

EMNLP'2024: Knowledge Verification to Nip Hallucination in the Bud

SGLang is a fast serving framework for large language models and vision language models.

[ACL 2024]Official GitHub repo for OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems.

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

A robust web archive analytics toolkit

Let your Claude able to think

PyTorch code and models for V-JEPA self-supervised learning from video.

The Open Cookbook for Top-Tier Code Large Language Model

A Multi-subject High School Examinations Dataset for Cross-lingual and Multilingual Question Answering

🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning

Official Repository for "DrEureka: Language Model Guided Sim-To-Real Transfer" (RSS 2024)

Code release for https://kovenyu.com/WonderWorld/

ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation

具身智能入门指南

Octo is a transformer-based robot policy trained on a diverse mix of 800k robot trajectories.

DataComp for Language Models

Unsupervised Word Segmentation for Neural Machine Translation and Text Generation

Fast and customizable text tokenization library with BPE and SentencePiece support