A flexible, high-performance serving system for machine learning models

Use Prometheus to monitor Kubernetes and applications running on Kubernetes

Code Listings for the book: Optimization Algorithms. Manning Publications, 2024.

Open deep learning compiler stack for cpu, gpu and specialized accelerators

Reference implementations of inference benchmarks

Model Server for Kepler

Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. S…

A Kubernetes Native Batch System (Project under CNCF)

Repository for out-of-tree scheduler plugins based on scheduler framework.

Repository containing up-to-date models to be used by the kepler-model-server

A QoS-based scheduling system brings optimal layout and status to workloads such as microservices, web services, big data jobs, AI jobs, etc.

TADIL: Task-agnostic Domain Incremental Learning. Continual Learning approach to infer task ID with no supervision

Production-Grade Container Scheduling and Management

Example DRA driver that developers can fork and modify to get them started writing their own.

Serve, optimize and scale PyTorch models in production

OpenMMLab Detection Toolbox and Benchmark

OpenMMLab YOLO series toolbox and benchmark. Implemented RTMDet, RTMDet-Rotated,YOLOv5, YOLOv6, YOLOv7, YOLOv8,YOLOX, PPYOLOE, etc.

OpenMMLab Model Deployment Framework

OpenMMLab Image Classification Toolbox and Benchmark

利用 ansible 自动化安装 k8s-1.18.3 集群

Device plugins for Volcano, e.g. GPU

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

NVIDIA device plugin for Kubernetes

PerfKit Benchmarker (PKB) contains a set of benchmarks to measure and compare cloud offerings. The benchmarks use default settings to reflect what most users will see. PerfKit Benchmarker is licens…

Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

Kubernetes Core Manager for NFV workloads