- Houston, TX, the United States
- https://dan-wanna-m.github.io/blog/
Highlights
- Pro
Stars
The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
Cross-specification JSON referencing (JSON Schema, OpenAPI, and the one you just made up!)
Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.
An implementation of the JSON Schema specification for Python
Empowering everyone to build reliable and efficient software.
Open source LLM UI, compatible with all local LLM providers.
A high-performance constrained decoding engine based on context free grammar in Rust
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
Python bindings for general-sam and some utilities
A general suffix automaton implementation in Rust with Python bindings
Formatron empowers everyone to control the format of language models' output with minimal overhead.
A fast inference library for running LLMs locally on modern consumer-class GPUs
A more Pythonic version of doxypy, a Doxygen filter for Python.
GitHub Action to install and run a custom maturin command with built-in support for cross compilation
Rust crate that provides number types similar to std's NonZero* types, but that cannot hold a type's maximum value instead.
An implementation of `std :: hash :: Hasher` which does not hash at all.
A successor bnf parsing library of bnf parsing library, for parsing Extended Backus–Naur form context-free grammars
A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.
Implementation of the RWKV language model in pure WebGPU/Rust.