This is the changelog for the open source version of tiktoken.
- Add
tiktoken.encoding_for_model
to get the encoding for a specific model - Improve portability of caching logic
- Avoid use of
blobfile
for public files - Add support for Python 3.8
- Add py.typed
- Improve the public tests
- Initial release