LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Build real-time multimodal AI applications 🤖🎙️📹

📚 Jupyter notebook tutorials for OpenVINO™

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

The official Python client for the Huggingface Hub.

Code for the paper "Language Models are Unsupervised Multitask Learners"

The repository for all Azure OpenAI Samples complementing the OpenAI cookbook.

The official Python library for the OpenAI API

LLM training in simple, raw C/CUDA

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Video+code lecture on building nanoGPT from scratch

A high-throughput and memory-efficient inference and serving engine for LLMs

Chitrarth: Bridging Vision and Language for a Billion People

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.

A Python package for generating educational content using Generative AI

Composable building blocks to build Llama Apps

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

A curated list of open-source projects related to DeepSeek Coder

DeepSeek Coder: Let the Code Write Itself

An LLM-powered customer-facing agent framework that enhances accuracy and control by following dedicated guidelines and leveraging ARQs (Attentive Reasoning Queries). This framework is designed to …