LLM inference in C/C++

The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.

Full featured demo application for OllamaSharp

Ollama API bindings for .NET

The Self-hosted AI Starter Kit is an open-source template that quickly sets up a local AI environment. Curated by n8n, it provides essential tools for creating secure, self-hosted AI workflows.

Mac app for Ollama

Run local LLaMA/GPT model easily and fast in C#!🤗 It's also easy to integrate LLamaSharp with semantic-kernel, unity, WPF and WebApp.

Desktop App using blazor and electron.net

The llama-recipes repository is a companion to the Llama 2 model. The repository includes scripts for fine-tuning Llama 2 on text summarisation and question answering, running inference with a fine…

Get up and running with Llama 2, Mistral, and other large language models locally.

The most no-nonsense locally hosted (or API hosted) AI code completion plugin for Visual Studio Code, like GitHub Copilot but 100% free and 100% private.

ChatGPT-Style Web UI Client for Ollama 🦙

Inference code for CodeLlama models

Code and documentation to train Stanford's Alpaca models, and generate the data.

Inference code for LLaMA models

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.