Popular repositories Loading

1. MI-optimize MI-optimize Public

   Forked from TsingmaoAI/MI-optimize

   mi-optimize is a versatile tool designed for the quantization and evaluation of large language models (LLMs). The library's seamless integration of various quantization methods and evaluation techn…

   Python 1

2. QuaRot QuaRot Public

   Forked from spcl/QuaRot

   Code for QuaRot, an end-to-end 4-bit inference of large language models.

   Python

3. fastllm fastllm Public

   Forked from ztxz16/fastllm

   纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

   C++

4. llama.cpp llama.cpp Public

   Forked from ggerganov/llama.cpp

   LLM inference in C/C++

   C++

5. T-MAC T-MAC Public

   Forked from microsoft/T-MAC

   Low-bit LLM inference on CPU with lookup table

   C++

6. tpu-mlir tpu-mlir Public

   Forked from sophgo/tpu-mlir

   Machine learning compiler based on MLIR for Sophgo TPU.

   C++