Pinned Loading

1. oobabooga/text-generation-webui oobabooga/text-generation-webui Public

   A Gradio web UI for Large Language Models with support for multiple inference backends.

   Python 42.1k 5.5k

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 36k 5.5k

3. OpenBMB/MiniCPM-o OpenBMB/MiniCPM-o Public

   MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone

   Python 18k 1.3k

4. huggingface/llm-vscode huggingface/llm-vscode Public

   LLM powered development for VSCode

   TypeScript 1.3k 133

5. mlc-ai/llm-perf-bench mlc-ai/llm-perf-bench Public

   Python 116 13

6. llm-vscode-inference-server llm-vscode-inference-server Public

   An endpoint server for efficiently serving quantized open-source LLMs for code.

   Python 54 8