Skip to content

File Limit Request: pylate-rs-cuda - 500 MiB #6854

@raphaelsty

Description

@raphaelsty

Project URL

https://pypi.org/project/pylate-rs-cuda/

Does this project already exist?

  • Yes

New Limit

500

Update issue title

  • I have updated the title.

Which indexes

PyPI

About the project

I tried hard to reduce the size of my python package built on top of candle (rust). At the end I ended up deleting every cuda related files but unfortunately it did not work out of the box after deleting those files. No issue with pylate-rs-metal or pylate-rs. I only encounter issues with pylate-rs-cuda. I want to build a package that will enable anyone to spawn a ColBERT model within milliseconds.

https://github.com/lightonai/pylate-rs is a fast inference engine for https://github.com/lightonai/pylate

Reasons for the request

I don't expect my cuda wheels to increase in size in the future.

Code of Conduct

  • I agree to follow the PSF Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions