PrivateGPT technique for better memory/attention?

[dreemur99]

I used privateGPT the other day and its attention to detail was amazing though it lacked the ability to carry a conversation (commandline-single-prompts only). Able to analyze a ton of documents but pick out only the relevant parts. Langchain and sentencetransformers, I think. Is there a way to integrate this into KoboldAI? If this could be done I believe better memory/coherent writing would be achieved.

I'd imagine it would work something like this?

1. User prompt.
2. Auto-save game
3. Ingest new portion of game in kobold-game-database - ala privategpt methods
4. user prompt again
5. new attention mechanism picks out relevant parts only (rather than just the last ~2048 tokens)
6. more relevant response
7. rinse and repeat