Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AceGPT chat Context window is 1024 tokens? #13

Open
yasserkh2 opened this issue Mar 13, 2024 · 2 comments
Open

AceGPT chat Context window is 1024 tokens? #13

yasserkh2 opened this issue Mar 13, 2024 · 2 comments

Comments

@yasserkh2
Copy link

When using AceGPT-7B-chat and AceGPT-13B-chat models, an error occurred stating that the input must have less than 1024 tokens. The input provided had 1322 tokens. I want to clarify whether this error occurred because it was insufficient to produce just the first response. Additionally, I'm wondering if these models are designed for RAG (Retrieval-Augmented Generation) due to the context window?

@AShabana
Copy link

What was the max. size of the QnA you message ?
I wonder if the window size of 7B have the same window size of 13B !

@hhwer
Copy link
Contributor

hhwer commented Mar 14, 2024

AceGPT support 2048 tokens. And there is no special design for RAG.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants