Skip to content

Commit

Permalink
update comments
Browse files Browse the repository at this point in the history
  • Loading branch information
willhume committed Feb 15, 2024
1 parent cb69427 commit 668ca66
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions execution/engine/emr_engine.go
Original file line number Diff line number Diff line change
Expand Up @@ -181,6 +181,7 @@ func (emr *EMRExecutionEngine) generateApplicationConf(executable state.Executab

// PVC creation and use for mounting EBS volumes to jobs
// Uses the default stroage class though we could add more config here to support that too see. https://spark.apache.org/docs/latest/running-on-kubernetes.html#pvc-oriented-executor-pod-allocation
// This requires the a CSI Driver to be deployed in the cluster
"spark.kubernetes.driver.ownPersistentVolumeClaim": aws.String("true"),
"spark.kubernetes.driver.volumes.persistentVolumeClaim.spark-local-dir-shared-lib-volume.options.claimName": aws.String(pvcName),
"spark.kubernetes.driver.volumes.persistentVolumeClaim.spark-local-dir-shared-lib-volume.mount.path": aws.String("/var/lib/app/"),
Expand Down

0 comments on commit 668ca66

Please sign in to comment.