New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ChatML / convert models with added/special tokens? #119

Open

DamascusGit opened this issue Dec 15, 2023 · 0 comments

DamascusGit commented Dec 15, 2023

looks like the params.json argument that's expected in the lora example doesn't support added/special tokens for the conversion script.

looking to convert nous models and would love help/advice on accommodating chatML format tokens into mlx conversion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment