Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Croco.Cpp, in Cuda mode mainly!)

Playground for LLM Frontend for Power Users.

llama.cpp clone with additional SOTA quants and improved CPU performance

A zero dependency web UI for KoboldAI Horde

Lord of Large Language Models Web User Interface

Lord of LLMS personalities zoo

fork of AutoGGUF to automatically quant GGUF models

A zoo of applications for lollms

A fast inference library for running LLMs locally on modern consumer-class GPUs

Tensor library for machine learning

Web UI for ExLlamaV2

Adaption of KoboldCPP with the goal to add missing core features

Easily view and modify JSON datasets for large language models

An easy-to-use library for quantizing LLMs, with custom quant strategies added.