Framework to bring LLM applications to production

Hands on Applications with GPT and other Large Language Models

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Awesome series for LLMOps

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.

An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more

An awesome & curated list of best LLMOps tools for developers