LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

The official CodeStitch Intermediate kit, featuring 11ty, Decap CMS and SASS - all set up for you! Perfect for websites of all sizes.

OCR, layout analysis, reading order, table recognition in 90+ languages

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Run safety benchmarks against AI models and view detailed reports showing how well they performed.

ReFT: Representation Finetuning for Language Models

Distribute and run LLMs with a single file.

Create Customized Software using Natural Language Idea (through LLM-powered Multi-Agent Collaboration)

Chat with your documents using local AI

DSPy: The framework for programming—not prompting—language models

Retrieval Augmented Generation (RAG) chatbot powered by Weaviate

Predict if a reservation will be canceled using robust Machine Learning pipelines with Airflow and Mlflow

Tools for merging pretrained large language models.

Label, clean and enrich text datasets with LLMs.

Finetune Llama 3.3, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 70% less memory

A fast inference library for running LLMs locally on modern consumer-class GPUs

Open-source observability for your LLM application, based on OpenTelemetry

Self-hosted AI coding assistant

Evaluation tool for LLM QA chains

Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.

Python bindings for the Transformer models implemented in C/C++ using GGML library.

This repository contains the official implementation of the research paper, "FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization" ICCV 2023

LLM inference in C/C++

Python bindings for llama.cpp

A Gradio web UI for Large Language Models with support for multiple inference backends.

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

The best Python CLI library, arguably.

Elegant, modern and asynchronous Telegram MTProto API framework in Python for users and bots

📚 A curated list of papers for Software Engineers

Visual analysis and diagnostic tools to facilitate machine learning model selection.