SGLang is a fast serving framework for large language models and vision language models.

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…

Learn Modern AI Assisted Python with Type Hints

A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/autogen-officehour

Tensors and Dynamic neural networks in Python with strong GPU acceleration

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (V…

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

A high-throughput and memory-efficient inference and serving engine for LLMs

🦜🔗 Build context-aware reasoning applications

Learn Agentic AI using CrewAI, LangChain, LangGraph, and Knowledge Graphs.

A list of free LLM inference resources accessible via API.

DSPy: The framework for programming—not prompting—language models

The Memory layer for AI Agents

An Open Source Machine Learning Framework for Everyone

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Langchain, Autogen, AG2, and CamelAI

LLM inference in C/C++

Graph Neural Network Library for PyTorch

Letta (formerly MemGPT) is a framework for creating LLM services with memory.

Deep Learning for humans

Scale from single vLLM instance to distributed vLLM deployment without changing any application code.

AI-Powered Photos App for the Decentralized Web 🌈💎✨

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX.

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

NVR with realtime local object detection for IP cameras

Visualizer for neural network, deep learning and machine learning models

aider is AI pair programming in your terminal

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.