Kubernetes community content

Run PyTorch LLMs locally on servers, desktop and mobile

Awesome-llm-role-playing-with-persona: a curated list of resources for large language models for role-playing with assigned personas

Unify Efficient Fine-Tuning of 100+ LLMs

A fancy self-hosted monitoring tool

🔥 The fastest and powerful Python library for Instagram Private API 2024

Whisper realtime streaming for long speech-to-text transcription and translation

Observe FastAPI app with three pillars of observability: Traces (Tempo), Metrics (Prometheus), Logs (Loki) on Grafana through OpenTelemetry and OpenMetrics.

FasAPI + Prometheus + Grafana! 🎉

AKA Line Maker 10.0 | GUI for VHS video simulator

💼 An enterprise-grade Next.js boilerplate for high-performance, maintainable apps. Packed with features like Tailwind CSS, TypeScript, ESLint, Prettier, testing tools, and more to accelerate your d…

This repository contains tutorials and examples for Triton Inference Server

PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.

Curated list of project-based tutorials

FastAPI Best Practices and Conventions we used at our startup

Build and control your own LLMs

Finetune ModelScope's Text To Video model using Diffusers 🧨

Deploy stable diffusion model with onnx/tenorrt + tritonserver

Text generator written for Stable Diffusion workflows.

Hello World project for CI/CD demo

Image to prompt with BLIP and CLIP

Cutoff - Cutting Off Prompt Effect

Quantized inference code for LLaMA models

AUTOMATIC1111 Stable Diffusion WebUI 1.5 + ChilloutMix + Kohya's Scripts

model convert extension for stable-diffusion-webui. supports convert fp16/bf16 no-ema/ema-only safetensors