Data for the MTEB leaderboard

A library for efficient similarity search and clustering of dense vectors.

Code Examples used by the Quickstarts in the Cognitive Services Documentation

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

A framework for few-shot evaluation of autoregressive language models.

Original Implementation of Prompt Tuning from Lester, et al, 2021

Plug and play modules to boost the performances of your AI systems 🚀

Code and models for the paper "Questions Are All You Need to Train a Dense Passage Retriever (TACL 2022)"

NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applicat…

Unified Model Serving Framework 🍱

A framework for training and evaluating AI models on a variety of openly available dialogue datasets.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Collection of papers and resources for data augmentation for NLP.

Must-read papers on prompt-based tuning for pre-trained language models.

Reading Wikipedia to Answer Open-Domain Questions

KakaoBrain KoGPT (Korean Generative Pre-trained Transformer)

The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.

An open-source NLP research library, built on PyTorch.

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.)

A tool for extracting plain text from Wikipedia dumps

LM Pretraining with PyTorch/TPU

Cheat Sheets