Skip to content

Pull requests: simonw/ttok

New pull request New
4 Open 1 Closed
4 Open 1 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Chunksize - a simple approach to splitting
#16 opened Nov 30, 2024 by web-sst Loading…
Add new OpenAI models to README
#14 opened Oct 28, 2024 by Xceron Loading…
Support for other models via Hugging Face tokenizers enhancement New feature or request
#9 opened Sep 9, 2023 by simonw Loading…
2
Add split option to split large input into smaller parts instead of truncating
#2 opened May 18, 2023 by c4pt0r Loading…
2
ProTip! Adding no:label will show everything without a label.