Starred repositories
📖A curated list of Awesome LLM/VLM Inference Papers with codes, such as FlashAttention, PagedAttention, Parallelism, etc. 🎉🎉
Multi-Scale Neural Audio Codec (SNAC) compresses audio into discrete codes at a low bitrate
open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.
Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image …
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/
Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).
Speech, Language, Audio, Music Processing with Large Language Model
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answer based on user queries.
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
The official Python library for the Google Gemini API
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
SGLang is a fast serving framework for large language models and vision language models.
Open-Sora: Democratizing Efficient Video Production for All
Agent framework and applications built upon Qwen>=2.0, featuring Function Calling, Code Interpreter, RAG, and Chrome extension.
An unnecessarily tiny implementation of GPT-2 in NumPy.