Open source alternative to Perplexity AI with ability to run locally

Translates WebAssembly modules to portable C

LM Studio CLI

LM Studio TypeScript SDK (pre-release public alpha)

VT.ai - Multimodal AI Chatbot

lightweight, standalone C++ inference engine for Google's Gemma models.

Open source codebase powering the HuggingChat app

Implementation of C++ standard libraries in C

A multimodal, function calling powered LLM webui.

tiny vision language model

Friendly Terminal Assistant for Developers

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

A free AI text generation interface based on KoboldAI

Harness LLMs with Multi-Agent Programming

After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around the ggml library, especially llama.cpp – and primarily its …

Minimalist ML framework for Rust

Fast, collaborative live terminal sharing over the web

A repository for research on medium sized language models.

An example of running local models with GGML

Python bindings for ggml

Chat with your documents offline using AI.

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web, vision.

Python bindings for llama.cpp

Inference Llama 2 in one file of pure Python

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

LLM inference in C/C++

Inference Llama 2 in one file of pure C