A high-throughput and memory-efficient inference and serving engine for LLMs

[Moved to https://github.com/kubernetes-sigs/kwok] This is a fake kubelet. that can simulate any number of nodes and maintain pods on those nodes. It is useful for test control plane.

Distributed Task Queue (development branch)

⚡ Transfer files over wifi from your computer to your mobile device by scanning a QR code without leaving the terminal.

A Go microservices framework

Setting up a distributed Kubernetes cluster along with Istio service mesh locally with Vagrant and VirtualBox, only PoC or Demo use.

q - Run SQL directly on delimited files and multi-file sqlite databases

A tool for exploring each layer in a docker image