Multilingual sentence alignment using sentence embeddings

Official implementations for (1) BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation and (2) Discourse Centric Evaluation of Machine Translation with a Densely Annotated P…

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.

The official Meta Llama 3 GitHub site

A series of large language models developed by Baichuan Intelligent Technology

BLEURT is a metric for Natural Language Generation based on transfer learning.

[TACL 2024] MAPS enables LLMs🤖 to mimic the human😁 translation process.

Free ChatGPT API Key，免费ChatGPT API，支持GPT4 API（免费），ChatGPT国内可用免费转发API，直连无需代理。可以搭配ChatBox等软件/插件使用，极大降低接口使用成本。国内即可无限制畅快聊天。

PyTorch native post-training library

A Neural Framework for MT Evaluation

Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons

一个基于langchain实现RAG的简单示例

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

Efficient Retrieval Augmentation and Generation Framework

State-of-the-art LLM-based translation models.

Adaptive Machine Translation with Large Language Models

Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning

Transformers 库快速入门教程

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

Must-read papers on prompt-based tuning for pre-trained language models.