サーベイした論文をissueにゆっくりまとめる。

Bringing BERT into modernity via both architecture changes and scaling

List of papers on Self-Correction of LLMs.

Finetune Llama 3.3, Mistral, Phi-4, Qwen 2.5 & Gemma LLMs 2-5x faster with 70% less memory

Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation

Minimalist ML framework for Rust

🪂 A Github Action to deploy the Jekyll site conveniently for GitHub Pages.

Exploring Japanese SimCSE

JGLUE: Japanese General Language Understanding Evaluation

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

Summarization Papers

a Hassle-Free Python Experience

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

[ICLR 2023] ReAct: Synergizing Reasoning and Acting in Language Models

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

Inference code for Llama models

[AAAI-23 Oral] Official implementation of the paper "Are Transformers Effective for Time Series Forecasting?"

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga…

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (V…

Paper List for Recommend-system PreTrained Models

Sentence Embeddings with BERT & XLNet