Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Mar 11, 2022

• [SPARK-38517][INFRA] Fix PySpark documentation generation (missing ipython_genutils)

  Show description for 54abb85
  HyukjinKwon

  committed
  54abb85

• [MINOR][DOCS] Fix minor typos at nulls_option in Window Functions

  Show description for 2239e9d
  

  bfallik

  authored and

  HyukjinKwon

  committed
  2239e9d

Commits on Mar 10, 2022

• [SPARK-38513][K8S] Move custom scheduler-specific configs to under spark.kubernetes.scheduler.NAME prefix

  Show description for f852100
  

  dongjoon-hyun

  and

  Yikun

  committed
  f852100

• [SPARK-38501][SQL] Fix thriftserver test failures under ANSI mode

  Show description for 024d03e
  gengliangwang

  committed
  024d03e

• [SPARK-38451][R][TESTS] Fix make_date test case to pass with ANSI mode

  Show description for a26c01d
  

  HyukjinKwon

  authored and

  gengliangwang

  committed
  a26c01d

• [SPARK-38490][SQL][INFRA] Add Github action test job for ANSI SQL mode

  Show description for 0a4a12d
  gengliangwang

  committed
  0a4a12d

• [SPARK-38360][SQL][SS][PYTHON] Introduce a exists function for TreeNode to eliminate duplicate code patterns

  Show description for 216b972
  

  LuciferYang

  authored and

  cloud-fan

  committed
  216b972

• [SPARK-38500][INFRA] Add ASF License header to all Service Provider configuration files

  Show description for 5cbd9b4
  

  yaooqinn

  authored and

  HyukjinKwon

  committed
  5cbd9b4

• [SPARK-38481][SQL] Substitute Java overflow exception from TIMESTAMPADD by Spark exception

  Show description for 538c81b
  MaxGekk

  committed
  538c81b

• [SPARK-38489][SQL] Aggregate.groupOnly support foldable expressions

  Show description for bcf7849
  

  wangyum

  authored and

  cloud-fan

  committed
  bcf7849

• [SPARK-38499][BUILD] Upgrade Jackson to 2.13.2

  Show description for 3ab2455
  dongjoon-hyun

  committed
  3ab2455

• [SPARK-38487][PYTHON][DOC] Fix docstrings of nlargest/nsmallest of DataFrame

  Show description for c483e29
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  c483e29

• [SPARK-38453][K8S][DOCS] Add volcano section to K8s IT README.md

  Show description for e5a86a3
  

  Yikun

  authored and

  dongjoon-hyun

  committed
  e5a86a3

• [SPARK-38148][SQL] Do not add dynamic partition pruning if there exists static partition pruning

  Show description for ec544ad
  

  ulysses-you

  authored and

  cloud-fan

  committed
  ec544ad

• [SPARK-38379][K8S] Fix Kubernetes Client mode when mounting persistent volume with storage class

  Show description for f286416
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  f286416

• [SPARK-38385][SQL] Improve error messages of empty statement and <EOF> in ParseException

  Show description for 82b6194
  

  anchovYu

  authored and

  cloud-fan

  committed
  82b6194

• [SPARK-38187][K8S][TESTS] Add K8S IT for volcano minResources cpu/memory spec

  Show description for ecabfb1
  

  Yikun

  authored and

  dongjoon-hyun

  committed
  ecabfb1

• [SPARK-38355][PYTHON][TESTS] Use mkstemp instead of mktemp

  Show description for bd08e79
  

  bjornjorgensen

  authored and

  HyukjinKwon

  committed
  bd08e79

• [SPARK-38387][PYTHON] Support na_action and Series input correspondence in Series.map

  Show description for 0f4c26a
  

  xinrong-meng

  authored and

  ueshin

  committed
  0f4c26a

• [SPARK-38486][K8S][TESTS] Upgrade the minimum Minikube version to 1.18.0

  Show description for 01014aa
  dongjoon-hyun

  committed
  01014aa

Commits on Mar 9, 2022

• [SPARK-38480][K8S] Remove spark.kubernetes.job.queue in favor of spark.kubernetes.driver.podGroupTemplateFile

  Show description for 97df016
  dongjoon-hyun

  committed
  97df016

• [SPARK-36681][CORE][TEST] Enable SnappyCodec test in FileSuite

  Show description for effef84
  viirya

  committed
  effef84

• [SPARK-38354][SQL] Add hash probes metric for shuffled hash join

  Show description for 1584366
  

  c21

  authored and

  cloud-fan

  committed
  1584366

• [SPARK-37947][SQL] Extract generator from GeneratorOuter expression contained by a Generate operator

  Show description for 93a25a4
  

  bersprockets

  authored and

  cloud-fan

  committed
  93a25a4

• [SPARK-37421][PYTHON] Inline type hints for python/pyspark/mllib/evaluation.py

  Show description for 62e4c29
  

  dchvn

  authored and

  zero323

  committed
  62e4c29

• [SPARK-38437][SQL] Lenient serialization of datetime from datasource

  Show description for bd6a3b4
  MaxGekk

  committed
  bd6a3b4

• [SPARK-38458][SQL] Fix always false condition in LogDivertAppender#initLayout

  Show description for 52e7602
  

  LuciferYang

  authored and

  viirya

  committed
  52e7602

• [SPARK-38452][K8S][TESTS] Support pyDockerfile and rDockerfile in SBT K8s IT

  Show description for 66ff4b6
  

  Yikun

  authored and

  dongjoon-hyun

  committed
  66ff4b6

• [SPARK-38449][SQL] Avoid call createTable when ignoreIfExists=true and table exists

  Show description for 587ec34
  

  AngersZhuuuu

  authored and

  cloud-fan

  committed
  587ec34

• [SPARK-38455][SPARK-38187][K8S] Support driver/executor PodGroup templates

  Show description for b8c03ee
  dongjoon-hyun

  committed
  b8c03ee

• [SPARK-37600][BUILD] Upgrade to Hadoop 3.3.2

  Show description for 4da04fc
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  4da04fc

• [MINOR][PYTHON] Fix MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction

  Show description for 35c0e5c
  

  harupy

  authored and

  dongjoon-hyun

  committed
  35c0e5c

• [SPARK-38450][SQL] Fix HiveQuerySuite//PushFoldableIntoBranchesSuite/TransposeWindowSuite under ANSI mode

  Show description for f2058eb
  gengliangwang

  committed
  f2058eb

• [SPARK-38412][SS] Fix the swapped sequence of from and to in StateSchemaCompatibilityChecker

  Show description for 43c7824
  HeartSaVioR

  committed
  43c7824

• [SPARK-37865][SQL] Fix union deduplication correctness bug

  Show description for 59ce0a7
  

  karenfeng

  authored and

  cloud-fan

  committed
  59ce0a7

Pagination

PreviousNext