A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Doing simple retrieval from LLM models at various context lengths to measure accuracy

Ongoing research training transformer language models at scale, including: BERT & GPT-2

store all agent's system prompt

Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

Train transformer language models with reinforcement learning.

Awesome-LLM: a curated list of Large Language Model

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

Learning to Rank in TensorFlow

⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

中文自然语言处理数据集，平时做做实验的材料。欢迎补充提交合并。

Chinese Pre-Trained Language Models (CPM-LM) Version-I

A PyTorch-based knowledge distillation toolkit for natural language processing

PyTorch/TorchScript compiler for NVIDIA GPUs using TensorRT

Go 实现的 AC 自动机

Must-read Papers on pre-trained language models.

(Linear-chain) Conditional random field in PyTorch.

A Python scikit for building and analyzing recommender systems

刷算法全靠套路，认准 labuladong 就够了！English version supported! Crack LeetCode, not only how, but also why.

Transformers for Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI

高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型

自然语言处理，知识图谱相关语料。按照Task细分，欢迎PR。

pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation

推荐系统资料笔记收录/ Everything about Recommendation System. 专题/书籍/论文/产品

GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型

中英文敏感词、语言检测、中外手机/电话归属地/运营商查询、名字推断性别、手机号抽取、身份证抽取、邮箱抽取、中日文人名库、中文缩写库、拆字词典、词汇情感值、停用词、反动词表、暴恐词表、繁简体转换、英文模拟中文发音、汪峰歌词生成器、职业名称词库、同义词库、反义词库、否定词库、汽车品牌词库、汽车零件词库、连续英文切割、各种中文词向量、公司名字大全、古诗词库、IT词库、财经词库、成语词库、地名词库、…