Commits

Branch selector

 master

User selector

tgravescs

Datepicker

All time

Commit History

Commits on Mar 10, 2022

• [SPARK-38379][K8S] Fix Kubernetes Client mode when mounting persistent volume with storage class

  Show description for f286416
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  f286416

Commits on Nov 5, 2021

• [SPARK-37208][YARN] Support mapping Spark gpu/fpga resource types to custom YARN resource types

  Show description for 8e6f636
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  8e6f636

Commits on Dec 2, 2020

• [SPARK-33544][SQL] Optimize size of CreateArray/CreateMap to be the size of its children

  Show description for f71f345
  

  tgravescs

  and

  HyukjinKwon

  committed
  f71f345

Commits on Nov 13, 2020

• [SPARK-33288][SPARK-32661][K8S] Stage level scheduling support for Kubernetes

  Show description for acfd846
  tgravescs

  committed
  acfd846

Commits on Oct 30, 2020

• [SPARK-32037][CORE] Rename blacklisting feature

  Show description for 72ad9dc
  tgravescs

  committed
  72ad9dc

Commits on Sep 9, 2020

• [SPARK-32823][WEB UI] Fix the master ui resources reporting

  Show description for 514bf56
  

  tgravescs

  authored and

  HyukjinKwon

  committed
  514bf56

• [SPARK-32824][CORE] Improve the error message when the user forgets the .amount in a resource config

  Show description for e8634d8
  

  tgravescs

  authored and

  HyukjinKwon

  committed
  e8634d8

Commits on Aug 25, 2020

• [SPARK-32287][TESTS][FOLLOWUP] Add debugging for flaky ExecutorAllocationManagerSuite

  Show description for 2feab4e
  

  tgravescs

  authored and

  HyukjinKwon

  committed
  2feab4e

Commits on Jul 29, 2020

• [SPARK-30322][DOCS] Add stage level scheduling docs

  Show description for e926d41
  tgravescs

  committed
  e926d41

Commits on Jul 24, 2020

• [SPARK-32287][TESTS] Flaky Test: ExecutorAllocationManagerSuite.add executors default profile

  Show description for e6ef27b
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  e6ef27b

Commits on Jun 2, 2020

• [SPARK-29150][CORE] Update RDD API for Stage level scheduling to be public

  Show description for ff4a97d
  

  tgravescs

  authored and

  HyukjinKwon

  committed
  ff4a97d

Commits on May 21, 2020

• [SPARK-29303][WEB UI] Add UI support for stage level scheduling

  Show description for b64688e
  tgravescs

  committed
  b64688e

Commits on Apr 23, 2020

• [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

  Show description for 95aec09
  

  tgravescs

  authored and

  HyukjinKwon

  committed
  95aec09

Commits on Apr 7, 2020

• [SPARK-31378][CORE] stage level scheduling dynamic allocation bug with initial num executors

  Show description for 30f1866
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  30f1866

Commits on Apr 2, 2020

• [SPARK-29153][CORE] Add ability to merge resource profiles within a stage with Stage Level Scheduling

  Show description for 55dea9b
  tgravescs

  committed
  55dea9b

Commits on Mar 26, 2020

• [SPARK-29154][CORE] Update Spark scheduler for stage level scheduling

  Show description for 474b1bb
  tgravescs

  committed
  474b1bb

Commits on Mar 9, 2020

• [SPARK-31055][DOCS] Update config docs for shuffle local host reads to have dep on external shuffle service

  Show description for e807118
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  e807118

Commits on Feb 28, 2020

• [SPARK-29149][YARN] Update YARN cluster manager For Stage Level Scheduling

  Show description for 0e2ca11
  tgravescs

  committed
  0e2ca11

• [SPARK-30987][CORE] Increase the timeout on local-cluster waitUntilExecutorsUp calls

  Show description for 6c0c41f
  

  tgravescs

  authored and

  jiangxb1987

  committed
  6c0c41f

Commits on Feb 25, 2020

• [SPARK-30942] Fix the warning for requiring cores to be limiting resources

  Show description for c46c067
  tgravescs

  committed
  c46c067

Commits on Feb 12, 2020

• [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

  Show description for 496f6ac
  tgravescs

  committed
  496f6ac

Commits on Feb 1, 2020

• [SPARK-30689][CORE][YARN] Add resource discovery plugin api to support YARN versions with resource scheduling

  Show description for 878094f
  tgravescs

  committed
  878094f

Commits on Jan 31, 2020

• [SPARK-30638][CORE][FOLLOWUP] Fix a spacing issue and use UTF-8 instead of ASCII

  Show description for ff0f636
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  ff0f636

• [SPARK-30638][CORE] Add resources allocated to PluginContext

  Show description for 3d2b8d8
  tgravescs

  committed
  3d2b8d8

Commits on Jan 29, 2020

• [SPARK-30529][CORE] Improve error messages when Executor dies before registering with driver

  Show description for e5c7f89
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  e5c7f89

Commits on Jan 17, 2020

• [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

  Show description for 6dbfa2b
  tgravescs

  committed
  6dbfa2b

Commits on Jan 10, 2020

• [SPARK-30448][CORE] accelerator aware scheduling enforce cores as limiting resource

  Show description for d6532c7
  tgravescs

  committed
  d6532c7

Commits on Jan 8, 2020

• [SPARK-30445][CORE] Accelerator aware scheduling handle setting configs to 0

  Show description for 0a72dba
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  0a72dba

Commits on Nov 25, 2019

• [SPARK-29415][CORE] Stage Level Sched: Add base ResourceProfile and Request classes

  Show description for 2d5de25
  tgravescs

  committed
  2d5de25

Commits on Nov 5, 2019

• [SPARK-29763] Fix Stage UI Page not showing all accumulators in Task Table

  Show description for 075cd55
  

  tgravescs

  authored and

  Marcelo Vanzin

  committed
  075cd55

Commits on Sep 11, 2019

• [SPARK-27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

  Show description for b425f8e
  tgravescs

  committed
  b425f8e

Commits on Sep 4, 2019

• [SPARK-27489][WEBUI] UI updates to show executor resource information

  Show description for 4c8f114
  

  tgravescs

  authored and

  gengliangwang

  committed
  4c8f114

Commits on Jul 16, 2019

• [SPARK-27959][YARN] Change YARN resource configs to use .amount

  Show description for 43d68cd
  

  tgravescs

  authored and

  Marcelo Vanzin

  committed
  43d68cd

Commits on Jul 11, 2019

• [SPARK-28234][CORE][PYTHON] Add python and JavaSparkContext support to get resources

  Show description for f84cca2
  

  tgravescs

  authored and

  HyukjinKwon

  committed
  f84cca2

Commits on Jun 6, 2019

• [SPARK-27760][CORE] Spark resources - change user resource config from .count to .amount

  Show description for d30284b
  tgravescs

  committed
  d30284b

Pagination

Previous

Next