An Open Source Machine Learning Framework for Everyone

LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

A library for efficient similarity search and clustering of dense vectors.

Cross-platform, customizable ML solutions for live and streaming media.

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

An open autonomous driving platform

Android real-time display control software

Distribute and run LLMs with a single file.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

An open source library for face detection in images. The face detection speed can reach 1000FPS.

Open-source simulator for autonomous driving research.

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Implementation of popular deep learning networks with TensorRT network definition API

PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）

Caffe: a fast open framework for deep learning.

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its…

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end…

黑马程序员匠心之作|C++教程从0到1入门编程

The YOLOv5 object detection android example

Real time yolox Android demo by ncnn

食铁兽 ffmpeg4/5/6入门系列教程代码

OpenPose的简单实现版本，简洁不简单，so easy. 就一个cpp

EDCC: An efficient and accurate algorithm for palmprint recognition.

Port of Facebook's LLaMA model in C/C++

Lightweight library for reading and writing .record files used by Baidu's Apollo Cyber Framework, for Python and Java. Not officially supported by Apollo Team.