New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Matching Attention #9

Open

X-fxx opened this issue Feb 5, 2025 · 0 comments

X-fxx commented Feb 5, 2025

在您的论文中提到了训练过程中会使用Matching Attention来约束相似性，但在您提供的推理代码和权重中，貌似没有看到这部分说明，请问Matching Attentinon模块是如何被添加的呢？这个模块在推理中是否有用到，如果有，是如何使用的呢？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment