LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

A library for efficient similarity search and clustering of dense vectors.

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

DuckDB is an analytical in-process SQL database management system

Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences

Distribute and run LLMs with a single file.

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

An unidentifiable mechanism that helps you bypass GFW.

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

A distributed, fast open-source graph database featuring horizontal scalability and high availability

Unsupervised text tokenizer for Neural Network-based text generation.

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports comp…

High-speed Large Language Model Serving for Local Deployment

一个支持windows/linux/mac的文本编辑器，目标是做中国人自己的编辑器，来自中国。

MariaDB server is a community developed fork of MySQL server. Started by core members of the original MySQL team, MariaDB actively works with outside developers to deliver the most featureful, stab…

Header-only C++/python library for fast approximate nearest neighbors

Non-Metric Space Library (NMSLIB): An efficient similarity search library and a toolkit for evaluation of k-NN methods for generic non-metric spaces.

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text

The most popular spellchecking library.

GraalJS – A high-performance, ECMAScript compliant, and embeddable JavaScript runtime for Java

llm deploy project based mnn. This project has merged into MNN.

TuGraph: A High Performance Graph Database.

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

OCR离线图片文字识别命令行windows程序，以JSON字符串形式输出结果，方便别的程序调用。提供各种语言API。由 PaddleOCR C++ 编译。

Pure C++ implementation of several models for real-time chatting on your computer (CPU)

Java Bindings for llama.cpp - A Port of Facebook's LLaMA model in C/C++

MySQL plugin for storing and querying vector embeddings.

Native-Like Performance for Nearest Neighbor Search in Java Applications using Hnswlib and Java Native Access