Tags: Kaggle/docker-python
Tags
Fix libtpu version for torch and do not pre-install tensorflow-tpu on… … TPU. (#1499) We install a libtpu version compatible with both jax 0.7.2 and torch 2.8.0. Why? tunix latest -> flax 0.12 -> jax 0.7.2 -> libtpu 0.0.23, and that libtpu version causes pjrt api errors for torch 2.8.0: ``` pjrt_c_api_helpers.cc:258] Unexpected error status Unexpected PJRT_Plugin_Attributes_Args size: expe cted 32, got 24. The plugin is likely built with a later version than the framework. This plugin is built with PJRT API version 0.75. ``` * https://github.com/pytorch/xla/blob/d517649bdef6ab0519c30c704bde8779c8216502/setup.py#L111 * https://github.com/jax-ml/jax/blob/3489529b38d1f11d1e5caf4540775aadd5f2cdda/setup.py#L26 Of particular note, we no longer pre-install `tensorflow-tpu` as the newer libtpu causes issues finding the TPUs ``` external/local_xla/xla/stream_executor/tpu/tpu_platform_interface.cc:78] No TPU platform found. Platform manager status: OK ``` We also update how we install Python packages via `uv` for consistency and reproducibility. From a `requirements.in` file, we first generate a consistent dependency closure via `uv pip compile`, and then `uv pip install` the packages from the generated `requirements.txt`.
Fix libtpu version for torch and do not pre-install tensorflow-tpu on… … TPU. (#1499) We install a libtpu version compatible with both jax 0.7.2 and torch 2.8.0. Why? tunix latest -> flax 0.12 -> jax 0.7.2 -> libtpu 0.0.23, and that libtpu version causes pjrt api errors for torch 2.8.0: ``` pjrt_c_api_helpers.cc:258] Unexpected error status Unexpected PJRT_Plugin_Attributes_Args size: expe cted 32, got 24. The plugin is likely built with a later version than the framework. This plugin is built with PJRT API version 0.75. ``` * https://github.com/pytorch/xla/blob/d517649bdef6ab0519c30c704bde8779c8216502/setup.py#L111 * https://github.com/jax-ml/jax/blob/3489529b38d1f11d1e5caf4540775aadd5f2cdda/setup.py#L26 Of particular note, we no longer pre-install `tensorflow-tpu` as the newer libtpu causes issues finding the TPUs ``` external/local_xla/xla/stream_executor/tpu/tpu_platform_interface.cc:78] No TPU platform found. Platform manager status: OK ``` We also update how we install Python packages via `uv` for consistency and reproducibility. From a `requirements.in` file, we first generate a consistent dependency closure via `uv pip compile`, and then `uv pip install` the packages from the generated `requirements.txt`.
Fix libtpu version for torch and do not pre-install tensorflow-tpu on… … TPU. (#1499) We install a libtpu version compatible with both jax 0.7.2 and torch 2.8.0. Why? tunix latest -> flax 0.12 -> jax 0.7.2 -> libtpu 0.0.23, and that libtpu version causes pjrt api errors for torch 2.8.0: ``` pjrt_c_api_helpers.cc:258] Unexpected error status Unexpected PJRT_Plugin_Attributes_Args size: expe cted 32, got 24. The plugin is likely built with a later version than the framework. This plugin is built with PJRT API version 0.75. ``` * https://github.com/pytorch/xla/blob/d517649bdef6ab0519c30c704bde8779c8216502/setup.py#L111 * https://github.com/jax-ml/jax/blob/3489529b38d1f11d1e5caf4540775aadd5f2cdda/setup.py#L26 Of particular note, we no longer pre-install `tensorflow-tpu` as the newer libtpu causes issues finding the TPUs ``` external/local_xla/xla/stream_executor/tpu/tpu_platform_interface.cc:78] No TPU platform found. Platform manager status: OK ``` We also update how we install Python packages via `uv` for consistency and reproducibility. From a `requirements.in` file, we first generate a consistent dependency closure via `uv pip compile`, and then `uv pip install` the packages from the generated `requirements.txt`.
Bump Colab Base Image - July (#1490) let's bump the image, this was released a couple days ago. while we were planning a release with the prior Base image, let's save us a release and get our self to the latest
Bump Colab Base Image - July (#1490) let's bump the image, this was released a couple days ago. while we were planning a release with the prior Base image, let's save us a release and get our self to the latest
Bump Colab Base Image - July (#1490) let's bump the image, this was released a couple days ago. while we were planning a release with the prior Base image, let's save us a release and get our self to the latest
Remove setting CUDA_VERSION to empty string and deprecated apt-key (#… …1486) Remove setting CUDA_VERSION to empty string for CPU images. Remove getting deprecated apt-key.gpg key file from https://packages.cloud.google.com/
Remove setting CUDA_VERSION to empty string and deprecated apt-key (#… …1486) Remove setting CUDA_VERSION to empty string for CPU images. Remove getting deprecated apt-key.gpg key file from https://packages.cloud.google.com/
Remove setting CUDA_VERSION to empty string and deprecated apt-key (#… …1486) Remove setting CUDA_VERSION to empty string for CPU images. Remove getting deprecated apt-key.gpg key file from https://packages.cloud.google.com/
Update kaggle package (#1481) Let's make sure that we install the latest version of kaggle in our image. cc: @stevemessick
PreviousNext