File Limit Request: pylate-rs-cuda - 500 MiB #6854
Description
Project URL
https://pypi.org/project/pylate-rs-cuda/
Does this project already exist?
- Yes
New Limit
500
Update issue title
- I have updated the title.
Which indexes
PyPI
About the project
I tried hard to reduce the size of my python package built on top of candle (rust). At the end I ended up deleting every cuda related files but unfortunately it did not work out of the box after deleting those files. No issue with pylate-rs-metal or pylate-rs. I only encounter issues with pylate-rs-cuda. I want to build a package that will enable anyone to spawn a ColBERT model within milliseconds.
https://github.com/lightonai/pylate-rs is a fast inference engine for https://github.com/lightonai/pylate
Reasons for the request
I don't expect my cuda wheels to increase in size in the future.
Code of Conduct
- I agree to follow the PSF Code of Conduct