LLM inference in C/C++

Port of OpenAI's Whisper model in C/C++

A library for efficient similarity search and clustering of dense vectors.

OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

Powerful yet simple to use screenshot software 🖥️ 📸

Distribute and run LLMs with a single file.

MLX: An array framework for Apple silicon

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

Bullet Physics SDK: real-time collision detection and multi-physics simulation for VR, games, visual effects, robotics, machine learning etc.

Official inference framework for 1-bit LLMs

Tensor library for machine learning

Stable Diffusion and Flux in pure C/C++

Fast inference engine for Transformer models

Performance instrumentation and tracing for Android, Linux and Chrome (read-only mirror of https://android.googlesource.com/platform/external/perfetto/)

Re-Connectable secure remote shell

TeXstudio is a fully featured LaTeX editor. Our goal is to make writing LaTeX documents as easy and comfortable as possible.

C++ DataFrame for statistical, Financial, and ML analysis -- in modern C++ using native types and contiguous memory storage

nanobind: tiny and efficient C++/Python bindings

C++ Implementation of PyTorch Tutorials for Everyone

Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

The inference module for AgiBot X1.

Accelerated BLAST compatible local sequence aligner.

dcm2nii DICOM to NIfTI converter: compiled versions available from NITRC

OpenGL 4.6 on Metal

Program for the analysis and visualization of whole-slide images in digital pathology

A "large" language model running on a microcontroller

CLIP inference in plain C/C++ with no extra dependencies