Rust library for concurrent data access, using memory-mapped files, zero-copy deserialization, and wait-free synchronization.

Enforce the output format (JSON Schema, Regex etc) of a language model

A Virtual Machine Monitor for modern Cloud workloads. Features include CPU, memory and device hotplug, support for running Windows and Linux guests, device offload with vhost-user and a minimal com…

Spin-based synchronization primitives

A highly configurable logging framework for Rust

LLM inference in C/C++

Official inference framework for 1-bit LLMs

Home of OpenVMM and OpenHCL.

Simple, safe way to store and distribute tensors

Serverless LLM Serving for Everyone.

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

SGLang is a fast serving framework for large language models and vision language models.

QJL: 1-Bit Quantized JL transform for KV Cache Quantization with Zero Overhead

Abseil Common Libraries (C++)

A high-throughput and memory-efficient inference and serving engine for LLMs

A secure container runtime with CRI/OCI interface

The Go programming language

Application Kernel for Containers

An open and reliable container runtime

Writing an OS in Rust

A little bit about a linux kernel

A hyperparameter optimization framework

Linux kernel source tree

`std::execution`, the proposed C++ framework for asynchronous and parallel programming.

Efficient RPCs for datacenter networks

Lightweight and Parallel Deep Learning Framework

A decentralized application (Dapp) for a simple online ticket booking using Solidity and HardHat.

A tool for enriching the output of nvidia-smi.

آموزش دیزاین پترن به زبون آدمیزاد - Teaching design patterns in Persian

Extracts static code features from opencl kernels to be used for machine learning.