From RAG chatbots to code assistants to complex agentic pipelines and beyond, build LLM systems that run better, faster, and cheaper with tracing, evaluations, and dashboards.

MLX: An array framework for Apple silicon

Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

A guidance language for controlling large language models.

A language for constraint-guided and efficient LLM programming.

A real world full-stack application using LlamaIndex

A framework for few-shot evaluation of language models.

A simple pip-installable Python tool to generate your own HTML citation world map from your Google Scholar ID.

Convert PDF to markdown + JSON quickly with high accuracy

A high-quality tool for convert PDF to Markdown and JSON.一站式开源高质量数据提取工具，将PDF转换成Markdown和JSON格式。

Material for gpu-mode lectures

LLM training in simple, raw C/CUDA

The quantitative performance comparison among DL compilers on CNN models.

A list of awesome compiler projects and papers for tensor computation and deep learning.

A free portable Formula Ocr tool supporting latex and mathml

Runtime memory usage analysis utilities for ML models

Awesome LLMs on Device: A Comprehensive Survey

🎨 ML Visuals contains figures and templates which you can reuse and customize to improve your scientific writing.

Automatically add a progress bar to Keynote presentations

Topological Data Analysis for Python🐍

LLM inference in C/C++

Code for the paper "Larger and more instructable language models become less reliable"

A curated list of resources for using LLMs to develop more competitive grant applications.

[EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models

Instructions on downloading and using the LibriAdapt dataset