-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
No information how using docker image for spyt cluster #5
Comments
@Alexvsalexvsalex
Look like there. |
@ykuc Hello. Documentation is in our main ytsaurus repository. You can find the required page here: https://github.com/ytsaurus/ytsaurus/blob/main/yt/docs/en/user-guide/data-processing/spyt/cluster/configuration.md |
@alextokarew |
[issue](ytsaurus/ytsaurus-spyt#5) --- Pull Request resolved: #879 commit_hash:f40f7c91c4ad65246325a144d2df0f1c565c8cde
[issue](ytsaurus/ytsaurus-spyt#5) --- Pull Request resolved: #879 commit_hash:f40f7c91c4ad65246325a144d2df0f1c565c8cde
We want to change Python version in spyt cluster, but on the exec nodes has only python3.8
We were advised to use a docker image.
spark-launch-yt \ --params '{operation_spec={tasks={history={docker_image="MY_DOCKER_IMAGE"};master={docker_image="MY_DOCKER_IMAGE"};workers={docker_image="MY_DOCKER_IMAGE"}}}}'
image can be like this. But it is too much for us... May be need only openjdk-11-jdk , unzip , python and spyt libs...
Could you publish base spyt docker image and add information in docs?
The text was updated successfully, but these errors were encountered: