An open protocol enabling communication and interoperability between opaque agentic applications.

Evaluation and Tracking for LLM Experiments

The Cloud-Native API Gateway and AI Gateway

Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understand…

Models as a Service

Build AI assistants that interact with your systems

A cat(1) clone with wings.

Provision remote development environments via Terraform

Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.

🧬 Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class testing.

Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.

LLMs on Kubernetes (repo for talk)

Source for "Neural Magic Workshop: Hands-On AI Optimization with OpenShift AI" Lab

🦉 OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation

The official Python SDK for Model Context Protocol servers and clients

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

This repository contains the OpenTelemetry Astronomy Shop, a microservice-based distributed system intended to illustrate the implementation of OpenTelemetry in a near real-world environment.

The goal of RamaLama is to make working with AI boring.

Cost-efficient and pluggable Infrastructure components for GenAI inference

Open Source real-time strategy game engine for early Westwood games such as Command & Conquer: Red Alert written in C# using SDL and OpenGL. Runs on Windows, Linux, *BSD and Mac OS X.

Command and Conquer: Red Alert

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

The LLM Evaluation Framework

Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports Open…

Generate Kubernetes architecture diagrams from Kubernetes manifest files, kustomization files, Helm charts, and actual cluster state