train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism

Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca

基于ChatGPT构建的中文self-instruct数据集

An Open-Source Framework for Prompt-Learning.

An open-source tool-augmented conversational language model from Fudan University

Example models using DeepSpeed

The release repo for "Vicuna: An Open Chatbot Impressing GPT-4"

ChatGLM-6B 指令学习|指令数据|Instruct

Finetuning ChatGLM-6B model with PEFT library

GPT2 for Chinese chitchat/用于中文闲聊的GPT2模型(实现了DialoGPT的MMI思想)

骆驼:A Chinese finetuned instruction LLaMA. Developed by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子昂 @ 商汤科技

chatglm 6b finetuning and alpaca finetuning

人工精调的中文对话数据集和一段chatglm的微调代码

chatglm多gpu用deepspeed和

⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF etc.

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

深度学习训练框架

Implementation of Chinese ChatGPT

A pupil in the computer world.(Felix Fu)

ChatGPT 中文调教指南。各种场景使用指南。学习怎么让它听你的话。

Multilingual Sentence & Image Embeddings with BERT