Tune any FALCON in 4-bit

LLM sampling method for enforcing syntax adherence in generated output

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX.

QLoRA: Efficient Finetuning of Quantized LLMs

Curated list of useful LLM / Analytics / Datascience resources

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

An autonomous AI agent extension for Oobabooga's web ui

Supercharge Open-Source AI Models

4 bits quantization of LLaMA using GPTQ

A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

LLM as a Chatbot Service

Accessible large language models via k-bit quantization for PyTorch.

A Gradio web UI for Large Language Models with support for multiple inference backends.

Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)

Simple, hackable and fast implementation for training/finetuning medium-sized LLaMA-based models

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

Code and documentation to train Stanford's Alpaca models, and generate the data.

LLM inference in C/C++

Port of OpenAI's Whisper model in C/C++

[SIGGRAPH Asia 2022] VToonify: Controllable High-Resolution Portrait Video Style Transfer

Public Experiments

ZMK configuration repo for v2 of the Corne-ish Zen keyboard

A sample repo to develop your own custom firmware for the Corne-ish Zen

Symbol and footprint for the nice!nano

SVG and KiCad files for a squid shaped pcb badge