20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Asynchronous HTTP client/server framework for asyncio and Python

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

A library for efficient similarity search and clustering of dense vectors.

LlamaIndex is a data framework for your LLM applications

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

FastAPI framework, high performance, easy to learn, fast to code, ready for production

Vast serverless python worker agent

Infinity is a high-throughput, low-latency REST API for serving text-embeddings, reranking models and clip

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

Async Python client for Apache Solr

Open-source vector similarity search for Postgres

A stable, fast and easy-to-use inference library with a focus on a sync-to-async API

A minimal Python package for storing and retrieving text using chunking, embeddings, and vector search.

Python script that slices audio with silence detection

Real-time Voice Activity Detection (VAD) with some example use case like simple voice bot and live transcription (realtime transcription)

A lightweight transcript editor for editing and correcting STT generated timed transcripts

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

A programming framework for agentic AI. Join our Discord: https://aka.ms/autogen-dc

Create Customized Software using Natural Language Idea (through LLM-powered Multi-Agent Collaboration)

Robust Speech Recognition via Large-Scale Weak Supervision

Hyperaudio Lite - a Super-lightweight Interactive Transcript Player

Whisper realtime streaming for long speech-to-text transcription and translation

Faster Whisper transcription with CTranslate2

TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models accessible to everyone.

llama and other large language models on iOS and MacOS offline using GGML library.

Swift library to work with llama and other large language models.