Generative Representational Instruction Tuning

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Repo to hold code and track issues for the collection of permissively licensed data

A repository for research on medium sized language models.

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

A framework for the evaluation of autoregressive code generation language models.

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

Massive Text Embedding Benchmark - Internal Development Git

A framework for few-shot evaluation of autoregressive language models.

Toolkit for creating, sharing and using natural language prompts.

Provides a minimal implementation to extract FLAN datasets for further processing

Ongoing research training transformer language models at scale, including: BERT & GPT-2

This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”

Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

Multilingual Sentence & Image Embeddings with BERT