Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit History

Commits on Oct 5, 2022

• [SPARK-40635][YARN][TESTS] Fix yarn module daily test failed with hadoop2

  Show description for 5600bef
  

  LuciferYang

  authored and

  HyukjinKwon

  committed
  5600bef

Commits on Oct 4, 2022

• [SPARK-40648][YARN][TESTS] Add @ExtendedLevelDBTest to LevelDB relevant tests in the yarn module

  Show description for 633db3b
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  633db3b

Commits on Sep 29, 2022

• [SPARK-40458][K8S] Bump Kubernetes Client Version to 6.1.1

  Show description for fa88651
  

  attilapiros

  authored and

  dongjoon-hyun

  committed
  fa88651

Commits on Sep 23, 2022

• [MINOR][YARN][TESTS] Rename logConfFile in BaseYarnClusterSuite from log4j.properties to log4j2.properties

  Show description for e4252f3
  

  LuciferYang

  authored and

  HyukjinKwon

  committed
  e4252f3

Commits on Sep 21, 2022

• [SPARK-40490][YARN][TESTS] Ensure YarnShuffleIntegrationSuite tests registeredExecFile reload scenarios

  Show description for e669957
  

  LuciferYang

  authored and

  tgravescs

  committed
  e669957

Commits on Sep 16, 2022

• [SPARK-40459][K8S] recoverDiskStore should not stop by existing recomputed files

  Show description for f24bb43
  dongjoon-hyun

  committed
  f24bb43

Commits on Sep 14, 2022

• [SPARK-40423][K8S][TESTS] Add explicit YuniKorn queue submission test coverage

  Show description for 12e4852
  dongjoon-hyun

  committed
  12e4852

Commits on Sep 9, 2022

• [SPARK-38888][BUILD][CORE][YARN][DOCS] Add RocksDB support for shuffle service state store

  Show description for e83aedd
  

  LuciferYang

  authored and

  Mridul Muralidharan

  committed
  e83aedd

Commits on Sep 8, 2022

• [SPARK-39546][K8S] Support ports definition in executor pod template

  Show description for e64262f
  

  yilun.fyl

  authored and

  dongjoon-hyun

  committed
  e64262f

• [SPARK-40186][CORE][YARN] Ensure mergedShuffleCleaner have been shutdown before db close

  Show description for 0be27b6
  

  LuciferYang

  authored and

  Mridul Muralidharan

  committed
  0be27b6

• [SPARK-38909][BUILD][CORE][YARN][FOLLOWUP] Make some code cleanup related to shuffle state db

  Show description for 3566657
  

  LuciferYang

  authored and

  Mridul Muralidharan

  committed
  3566657

Commits on Sep 1, 2022

• [SPARK-40304][K8S][TESTS] Add decomTestTag to K8s Integration Test

  Show description for fd0498f
  dongjoon-hyun

  committed
  fd0498f

• [SPARK-40302][K8S][TESTS] Add YuniKornSuite

  Show description for b2e38e1
  dongjoon-hyun

  committed
  b2e38e1

Commits on Aug 30, 2022

• [SPARK-40256][BUILD][K8S] Switch base image from openjdk to eclipse-temurin

  Show description for c2d4c4e
  

  Yikun

  authored and

  gengliangwang

  committed
  c2d4c4e

Commits on Aug 22, 2022

• [SPARK-39755][K8S] Improve LocalDirsFeatureStep to randomize local directories

  Show description for 9f9af2a
  

  pralabhkumar

  authored and

  dongjoon-hyun

  committed
  9f9af2a

Commits on Aug 19, 2022

• [SPARK-40065][K8S] Mount ConfigMap on executors with non-default profile as well

  Show description for 41ca629
  

  nsuke

  authored and

  dongjoon-hyun

  committed
  41ca629

• [SPARK-38582][K8S] Add KubernetesUtils.buildEnvVars(WithFieldRef)? utility functions

  Show description for ad5f863
  

  dcoliversun

  and

  dongjoon-hyun

  committed
  ad5f863

Commits on Aug 18, 2022

• [SPARK-36462][K8S] Add the ability to selectively disable watching or polling

  Show description for 5bffb98
  

  holdenk

  authored and

  dongjoon-hyun

  committed
  5bffb98

• [SPARK-38909][CORE][YARN] Encapsulate LevelDB used to store remote/external shuffle state as DB

  Show description for 892a45f
  

  LuciferYang

  authored and

  Mridul Muralidharan

  committed
  892a45f

Commits on Aug 12, 2022

• [SPARK-38969][K8S] Fix Decom reporting

  Show description for 451ac4c
  holdenk

  committed
  451ac4c

Commits on Aug 11, 2022

• [SPARK-38921][K8S][TESTS] Use k8s-client to create queue resource in Volcano IT

  Show description for a49f66f
  

  Yikun

  authored and

  dongjoon-hyun

  committed
  a49f66f

Commits on Aug 10, 2022

• [SPARK-38503][K8S] Warn if VolcanoFeatureStep.getAdditionalPreKubernetesResources is used in executor side

  Show description for b65c8a1
  

  Yikun

  authored and

  dongjoon-hyun

  committed
  b65c8a1

• [SPARK-38910][YARN] Clean spark staging before unregister

  Show description for 2d730ab
  

  AngersZhuuuu

  authored and

  tgravescs

  committed
  2d730ab

• [SPARK-40022][YARN][TESTS] Ignore pyspark suites in YarnClusterSuite when python3 is unavailable

  Show description for 8e47244
  

  LuciferYang

  authored and

  HyukjinKwon

  committed
  8e47244

Commits on Aug 8, 2022

• [SPARK-39965][K8S] Skip PVC cleanup when driver doesn't own PVCs

  Show description for 87b312a
  

  dongjoon-hyun

  and

  pralabhkumar

  committed
  87b312a

Commits on Aug 5, 2022

• [SPARK-39987][K8S] Support PEAK_JVM_(ON|OFF)HEAP_MEMORY executor rolling policy

  Show description for 3df7124
  dongjoon-hyun

  committed
  3df7124

Commits on Jul 27, 2022

• [SPARK-39884][K8S] KubernetesExecutorBackend should handle IPv6 hostname

  Show description for 07ccaa6
  dongjoon-hyun

  committed
  07ccaa6

Commits on Jul 26, 2022

• [SPARK-33236][SHUFFLE] Enable Push-based shuffle service to store state in NM level DB for work preserving restart

  Show description for 7bb1b21
  

  zhouyejoe

  authored and

  Mridul Muralidharan

  committed
  7bb1b21

Commits on Jul 12, 2022

• Revert "[SPARK-38910][YARN] Clean spark staging before unregister"

  Show description for 9ebd7fb
  dongjoon-hyun

  committed
  9ebd7fb

• [SPARK-39711][TESTS] Remove redundant trait: BeforeAndAfterAll & BeforeAndAfterEach & Logging

  Show description for d10db29
  

  panbingkun

  authored and

  huaxingao

  committed
  d10db29

Commits on Jul 6, 2022

• [SPARK-39701][CORE][K8S][TESTS] Move withSecretFile to SparkFunSuite to reuse

  Show description for 1cf4fe5
  dongjoon-hyun

  committed
  1cf4fe5

Commits on Jul 5, 2022

• [SPARK-39688][K8S] getReusablePVCs should handle accounts with no PVC permission

  Show description for 79f133b
  dongjoon-hyun

  committed
  79f133b

• [SPARK-39062][CORE] Add stage level resource scheduling support for standalone cluster

  Show description for 5cd5935
  

  ivoson

  authored and

  Ngone51

  committed
  5cd5935

Commits on Jul 3, 2022

• [MINOR] whitespace must between Curly braces and the bodies of classes, methods

  Show description for 00d099c
  

  panbingkun

  authored and

  huaxingao

  committed
  00d099c

Commits on Jul 1, 2022

• [SPARK-39657][YARN] YARN AM client should call the non-static setTokensConf method

  Show description for 6624d91
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  6624d91

Pagination

PreviousNext