A Gradio web UI for Large Language Models with support for multiple inference backends.

The Open Source Feature Store for Machine Learning

A guidance language for controlling large language models.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

🦜🔗 Build context-aware reasoning applications

Tool for chatting with your codebase and docs using OpenAI, LlamaCpp, and GPT-4-All

A RTSP audio server intended for the ESP32

Whisper realtime streaming for long speech-to-text transcription and translation

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

🔊 Text-Prompted Generative Audio Model

Bringing Characters to Life with Computer Brains in Unity

Inference code for Llama models

Large Language Model Text Generation Inference

Speech recognition

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

AirLLM 70B inference with single 4GB GPU

Public content repository for Windows Server content.

Interactively explore unstructured datasets from your dataframe.

LLM inference in C/C++

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

Example of local RAG QA with Langchain Agents

LLM Frontend for Power Users.

Faster Whisper transcription with CTranslate2

Library to interface with an instance of ChromaDB

Integrate cutting-edge LLM technology quickly and easily into your apps