Commits

Branch selector

 master

User selector

HyukjinKwon

Datepicker

All time

Commit History

Commits on Dec 29, 2021

• [SPARK-37727][SQL][TESTS][FOLLOW-UP] Add test cases for logs in SparkSession.builder.getOrCreate

  Show description for 661b80d
  HyukjinKwon

  committed
  661b80d

  Copy full SHA for 661b80d

Commits on Dec 27, 2021

• [SPARK-34544][PYTHON][FOLLOW-UP] Add pandas-stubs in dev/requirement.txt

  Show description for 0ca9eb3
  HyukjinKwon

  committed
  0ca9eb3

  Copy full SHA for 0ca9eb3

• [SPARK-37741][INFRA][DOCS] Remove Jenkins badge in README.md

  Show description for 92dc84e
  HyukjinKwon

  committed
  92dc84e

  Copy full SHA for 92dc84e

Commits on Dec 24, 2021

• [SPARK-37727][SQL] Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate

  Show description for 472629a
  HyukjinKwon

  committed
  472629a

  Copy full SHA for 472629a

Commits on Dec 16, 2021

• [SPARK-37658][INFRA][PYTHON] Skip PIP packaging test in Jenkins

  Show description for 45a145e
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  45a145e

  Copy full SHA for 45a145e

• Revert "[SPARK-37483][SQL] Support push down top N to JDBC data source V2"

  Show description for 1684128
  HyukjinKwon

  committed
  1684128

  Copy full SHA for 1684128

Commits on Dec 15, 2021

• [SPARK-37638][PYTHON] Use existing active Spark session instead of SparkSession.getOrCreate in pandas API on Spark

  Show description for 988381b
  HyukjinKwon

  committed
  988381b

  Copy full SHA for 988381b

• [SPARK-37649][PYTHON] Switch default index to distributed-sequence by default in pandas API on Spark

  Show description for c1d80bf
  HyukjinKwon

  committed
  c1d80bf

  Copy full SHA for c1d80bf

Commits on Dec 13, 2021

• [SPARK-37624][PYTHON][DOCS] Suppress warnings for live pandas-on-Spark quickstart notebooks

  Show description for 195da56
  HyukjinKwon

  committed
  195da56

  Copy full SHA for 195da56

Commits on Dec 8, 2021

• [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for SQL API in PySpark

  Show description for 26f4953
  HyukjinKwon

  committed
  26f4953

  Copy full SHA for 26f4953

Commits on Dec 6, 2021

• [SPARK-37004][PYTHON] Upgrade to Py4J 0.10.9.3

  Show description for 72669b5
  HyukjinKwon

  committed
  72669b5

  Copy full SHA for 72669b5

• [SPARK-37554][BUILD] Add PyArrow, pandas and plotly to release Docker image dependencies

  Show description for 03750c0
  HyukjinKwon

  committed
  03750c0

  Copy full SHA for 03750c0

Commits on Dec 2, 2021

• [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from TimedeltaIndex

  Show description for 893feb9
  HyukjinKwon

  committed
  893feb9

  Copy full SHA for 893feb9

Commits on Nov 26, 2021

• [SPARK-37457][PYTHON] Update cloudpickle to v2.0.0

  Show description for 95fc4c5
  HyukjinKwon

  committed
  95fc4c5

  Copy full SHA for 95fc4c5

• [SPARK-37436][PYTHON] Uses Python's standard string formatter for SQL API in pandas API on Spark

  Show description for 69e1151
  HyukjinKwon

  committed
  69e1151

  Copy full SHA for 69e1151

• Revert "[SPARK-37445][BUILD] Rename the maven profile hadoop-3.2 to hadoop-3 and change GA test name to hadoop3.3"

  Show description for 444cfe6
  HyukjinKwon

  committed
  444cfe6

  Copy full SHA for 444cfe6

Commits on Nov 25, 2021

• [SPARK-32079][PYTHON] Remove namedtuple hack by replacing built-in pickle to cloudpickle

  Show description for d192d96
  HyukjinKwon

  committed
  d192d96

  Copy full SHA for d192d96

• [SPARK-37453][INFRA][SQL][TESTS] Split TPC-DS build in GitHub Actions

  Show description for 27eb687
  HyukjinKwon

  committed
  27eb687

  Copy full SHA for 27eb687

Commits on Nov 22, 2021

• Revert "[SPARK-36231][PYTHON] Support arithmetic operations of decimal(nan) series"

  Show description for 406455d
  HyukjinKwon

  committed
  406455d

  Copy full SHA for 406455d

Commits on Nov 19, 2021

• [SPARK-37384][CORE][TESTS] Increase timeout for job termination in SchedulerIntegrationSuite

  Show description for d5006ec
  HyukjinKwon

  committed
  d5006ec

  Copy full SHA for d5006ec

Commits on Nov 18, 2021

• [SPARK-37277][PYTHON][SQL] Support DayTimeIntervalType in pandas UDF and Arrow optimization

  Show description for 88e53e5
  HyukjinKwon

  committed
  88e53e5

  Copy full SHA for 88e53e5

• [SPARK-37368][SQL][TESTS] Explicit GC for TPC-DS query runs

  Show description for 99d2d57
  HyukjinKwon

  committed
  99d2d57

  Copy full SHA for 99d2d57

• [SPARK-37281][PYTHON] Support DayTimeIntervalType in Py4J

  Show description for 2cd3b1e
  HyukjinKwon

  committed
  2cd3b1e

  Copy full SHA for 2cd3b1e

• [SPARK-37308][SQL][TESTS] Partially revert SPARK-37214's test due to flakiness

  Show description for 9a7632e
  HyukjinKwon

  committed
  9a7632e

  Copy full SHA for 9a7632e

• [SPARK-37230][DOCS][PYTHON] Document DataFrame.mapInArrow in PySpark documentation

  Show description for 6450f6b
  HyukjinKwon

  committed
  6450f6b

  Copy full SHA for 6450f6b

• [SPARK-37279][PYTHON][SQL] Support DayTimeIntervalType in createDataFrame, collect and Python UDF

  Show description for e2e1e42
  HyukjinKwon

  committed
  e2e1e42

  Copy full SHA for e2e1e42

Commits on Nov 14, 2021

• [SPARK-37228][SQL][PYTHON] Implement DataFrame.mapInArrow in Python

  Show description for 775e05f
  HyukjinKwon

  committed
  775e05f

  Copy full SHA for 775e05f

Commits on Nov 12, 2021

• [MINOR][PYTHON][DOCS] Remove the reference of typeName as DDL format in documentation

  Show description for 007afbb
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  007afbb

  Copy full SHA for 007afbb

Commits on Nov 10, 2021

• [SPARK-37022][PYTHON][FOLLOW-UP] Change python/pyproject.toml to dev/pyproject.toml in reformat-python script

  Show description for e6865b3
  HyukjinKwon

  committed
  e6865b3

  Copy full SHA for e6865b3

Commits on Nov 9, 2021

• [SPARK-37257][PYTHON] Update setup.py for Python 3.10

  Show description for 06175c0
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  06175c0

  Copy full SHA for 06175c0

• Revert "[SPARK-36998][CORE] Handle concurrent eviction of same application in SHS"

  Show description for 0d7244c
  HyukjinKwon

  committed
  0d7244c

  Copy full SHA for 0d7244c

Commits on Nov 5, 2021

• [SPARK-36989][TESTS][PYTHON][FOLLOW-UP] Move pyproject.toml from python to dev directory

  Show description for d7a608d
  HyukjinKwon

  committed
  d7a608d

  Copy full SHA for d7a608d

Commits on Nov 3, 2021

• [MINOR][PYTHON][DOCS] Fix broken link in legacy Apache Arrow in PySpark page

  Show description for ab7e503
  

  HyukjinKwon

  authored and

  sarutak

  committed
  ab7e503

  Copy full SHA for ab7e503

Commits on Oct 29, 2021

• [SPARK-37134][PYTHON][DOCS] Clarify the options in "Using PySpark Native Features"

  Show description for f258d30
  HyukjinKwon

  committed
  f258d30

  Copy full SHA for f258d30

Commits on Oct 27, 2021

• Revert "[SPARK-35437][SQL] Use expressions to filter Hive partitions at client side"

  Show description for fb9d6ae
  HyukjinKwon

  committed
  fb9d6ae

  Copy full SHA for fb9d6ae

Pagination

Previous

Next