📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

Numbers every LLM developer should know

Official code repo for the O'Reilly Book - "Hands-On Large Language Models"

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

An index of algorithms for reinforcement learning from human feedback (rlhf))

Inference code for Llama models

Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts

SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.

My 500 LED xmas tree

Unsupervised text tokenizer focused on computational efficiency

Must-read Papers on pre-trained language models.

curated collection of papers for the nlp practitioner 📖👩‍🔬

Giant Language Model Test Room

NAACL 2019 paper: Density Matching for Bilingual Word Embedding (Zhou et al., 2019)

📖 A collection of pure bash alternatives to external processes.

learning to search in pytorch

Codebase for testing whether hidden states of neural networks encode discrete structures.

With Holoviews, your data visualizes itself.

This dataset code generates mathematical question and answer pairs, from a range of question types at roughly school-level difficulty.

arXiv LaTeX Cleaner: Easily clean the LaTeX code of your paper to submit to arXiv

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

A toolkit for evaluating the linguistic knowledge and transferability of contextual representations. Code for "Linguistic Knowledge and Transferability of Contextual Representations" (NAACL 2019).

Seamless operability between C++11 and Python

Papers from the computer science community to read and discuss.

Best practice and tips & tricks to write scientific papers in LaTeX, with figures generated in Python or Matlab.

Performs string manipulation tasks by learning from the provided example(s), instead of having to program them out explicitly.

A toolkit for processing Vietnamese texts

🤖 My collection of highly opinionated and amazing configs

A general-purpose neural semantic parser for mapping natural language queries into machine executable code