An Earley parser engine in Rust.

The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes

Cross-specification JSON referencing (JSON Schema, OpenAPI, and the one you just made up!)

Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.

An implementation of the JSON Schema specification for Python

Empowering everyone to build reliable and efficient software.

Open source LLM UI, compatible with all local LLM providers.

A high-performance constrained decoding engine based on context free grammar in Rust

Blazingly fast LLM inference.

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

Python bindings for general-sam and some utilities

A general suffix automaton implementation in Rust with Python bindings

Formatron empowers everyone to control the format of language models' output with minimal overhead.

A fast inference library for running LLMs locally on modern consumer-class GPUs

A more Pythonic version of doxypy, a Doxygen filter for Python.

Rust bindings for the Python interpreter

GitHub Action to install and run a custom maturin command with built-in support for cross compilation

Rust crate that provides number types similar to std's NonZero* types, but that cannot hold a type's maximum value instead.

Voracious radix sort

A successor bnf parsing library of bnf parsing library, for parsing Extended Backus–Naur form context-free grammars

A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.

Implementation of the RWKV language model in pure WebGPU/Rust.

Parse BNF grammar definitions