New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Optimize Tokenzation incluing multi-mode problems, Parser and Formula optimization #130

Open

KenelmQLH opened this issue Jun 30, 2022 · 0 comments

Collaborator

KenelmQLH commented Jun 30, 2022

Description

(A clear and concise description of what the feature is.)

Handle multi-mode problems
- AST Graph
- Image
Handle noise problems when identify $...$ in Parser （need better rules）
Handle Formula ast problems when identify $AB=BC$ and $123$ （consider preprocessing）

References

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment