VC-FB and MC-FB algorithms from "Zero-Shot Reinforcement Learning from Low Quality Data" (NeurIPS 2024)

An easy-to-use Python framework to generate adversarial jailbreak prompts.

veRL: Volcano Engine Reinforcement Learning for LLM

This repo includes ChatGPT prompt curation to use ChatGPT and other LLM tools better.

[COLM 2024] A Survey on Deep Learning for Theorem Proving

The official implementation of Self-Play Preference Optimization (SPPO)

Deep learning for audio processing

A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.

Dateset Reset Policy Optimization

Efficient Triton Kernels for LLM Training

A library for advanced large language model reasoning

The code of paper "Toward Optimal LLM Alignments Using Two-Player Games".

[ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning

This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.

Monte Carlo tree search in JAX

Library for industrial alignment.

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)

[ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluating

Recipes to train reward model for RLHF.

Training Sparse Autoencoders on Language Models

🚀 Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton

Minimal but scalable implementation of large language models in JAX

Kolmogorov Arnold Networks

A JAX research toolkit for building, editing, and visualizing neural networks.

A simple library for scaling up JAX programs

Grok open release