Commits

Branch selector

 master

User selector

HyukjinKwon

Datepicker

All time

Commit History

Commits on Oct 4, 2024

• [SPARK-49870][PYTHON] Add Python 3.13 support in Spark Classic

  Show description for de9b9c8
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  de9b9c8

  Copy full SHA for de9b9c8

• [MINOR][PYTHON][TESTS] Skip test_artifact if grpc isn't installed

  Show description for 98da5e1
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  98da5e1

  Copy full SHA for 98da5e1

• [SPARK-49869][INFRA] Add NumPy in Python 3.13 image

  Show description for a38505c
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  a38505c

  Copy full SHA for a38505c

Commits on Sep 26, 2024

• [SPARK-49609][PYTHON][TESTS][FOLLOW-UP] Avoid import connect modules when connect dependencies not installed

  Show description for c0984e7
  HyukjinKwon

  committed
  c0984e7

  Copy full SHA for c0984e7

Commits on Sep 25, 2024

• [SPARK-49775][SQL][FOLLOW-UP] Use SortedSet instead of Array with sorting

  Show description for 09209f0
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  09209f0

  Copy full SHA for 09209f0

• [SPARK-49609][PYTHON][TESTS][FOLLOW-UP] Skip Spark Connect tests if dependencies are not found

  Show description for 46c5acc
  

  HyukjinKwon

  authored and

  itholic

  committed
  46c5acc

  Copy full SHA for 46c5acc

Commits on Sep 21, 2024

• [SPARK-48782][SQL][TESTS][FOLLOW-UP] Enable ANSI for malformed input test in ProcedureSuite

  Show description for 0b05b1a
  

  HyukjinKwon

  authored and

  MaxGekk

  committed
  0b05b1a

  Copy full SHA for 0b05b1a

Commits on Sep 19, 2024

• Revert "[SPARK-49422][CONNECT][SQL] Add groupByKey to sql/api"

  Show description for f3c8d26
  HyukjinKwon

  committed
  f3c8d26

  Copy full SHA for f3c8d26

• Revert "[SPARK-49495][DOCS] Document and Feature Preview on the master branch via Live GitHub Pages Updates"

  Show description for 8861f0f
  HyukjinKwon

  committed
  8861f0f

  Copy full SHA for 8861f0f

• Revert "[SPARK-49495][DOCS][FOLLOWUP] Fix Pandoc installation for GitHub Pages publication action"

  Show description for 3763827
  HyukjinKwon

  committed
  3763827

  Copy full SHA for 3763827

• Revert "[SPARK-49495][DOCS][FOLLOWUP] Enable GitHub Pages settings via .asf.yml"

  Show description for 58d73fe
  HyukjinKwon

  committed
  58d73fe

  Copy full SHA for 58d73fe

Commits on Sep 10, 2024

• [SPARK-49576][INFRA] Upload Python logs in CI

  Show description for f5d1f35
  HyukjinKwon

  committed
  f5d1f35

  Copy full SHA for f5d1f35

Commits on Sep 6, 2024

• [SPARK-49511][SQL][FOLLOW-UP] Fix @see links to recover Scaladoc build

  Show description for 002bf87
  HyukjinKwon

  committed
  002bf87

  Copy full SHA for 002bf87

Commits on Sep 5, 2024

• [SPARK-48493][PYTHON][FOLLOW-UP] Fix documentation for Arrow batch support in Python Data Source

  Show description for f7292cb
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  f7292cb

  Copy full SHA for f7292cb

Commits on Sep 4, 2024

• [SPARK-48960][CONNECT] Makes spark-submit works with Spark connect

  Show description for 3e22c47
  HyukjinKwon

  committed
  3e22c47

  Copy full SHA for 3e22c47

Commits on Sep 3, 2024

• [SPARK-49347][R][FOLLOW-UP] Use dedicated environment variable for SparkR deprecation warning

  Show description for 2a6080c
  HyukjinKwon

  committed
  2a6080c

  Copy full SHA for 2a6080c

Commits on Aug 28, 2024

• [SPARK-49402][PYTHON][FOLLOW-UP] Manually load ~/.profile in Spark Connect notebook

  Show description for 1c9cde5
  HyukjinKwon

  committed
  1c9cde5

  Copy full SHA for 1c9cde5

Commits on Aug 27, 2024

• [SPARK-49402][PYTHON] Fix Binder integration in PySpark documentation

  Show description for 9fc1e05
  HyukjinKwon

  committed
  9fc1e05

  Copy full SHA for 9fc1e05

• [SPARK-49347][R][FOLLOW-UP] Set SPARK_TESTING in Windows build

  Show description for f7bb15c
  HyukjinKwon

  committed
  f7bb15c

  Copy full SHA for f7bb15c

Commits on Aug 26, 2024

• [SPARK-49347][R] Deprecate SparkR

  Show description for d429653
  HyukjinKwon

  committed
  d429653

  Copy full SHA for d429653

Commits on Aug 22, 2024

• [SPARK-49345][CONNECT] Make sure using the current running Spark Session

  Show description for 4ceacbe
  HyukjinKwon

  committed
  4ceacbe

  Copy full SHA for 4ceacbe

Commits on Aug 19, 2024

• [SPARK-49263][CONNECT] Spark Connect python client: Consistently handle boolean Dataframe reader options

  Show description for a6a62e5
  HyukjinKwon

  committed
  a6a62e5

  Copy full SHA for a6a62e5

Commits on Aug 16, 2024

• [MINOR][DOCS] Use SparkSession.builder.getOrCreate() over the deprecated build()

  Show description for 29b1381
  HyukjinKwon

  committed
  29b1381

  Copy full SHA for 29b1381

Commits on Aug 14, 2024

• [MINOR][DOCS] Explicitly mention RDD/SparkContext are unsupported in Spark Connect

  Show description for 3632732
  HyukjinKwon

  committed
  3632732

  Copy full SHA for 3632732

Commits on Aug 12, 2024

• [SPARK-49195][CONNECT] Embed script level parsing logic into SparkSubmitCommandBuilder

  Show description for 1113029
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  1113029

  Copy full SHA for 1113029

• [SPARK-49198][CONNECT] Prune more jars required for Spark Connect shell

  Show description for 436a6d1
  HyukjinKwon

  committed
  436a6d1

  Copy full SHA for 436a6d1

• [SPARK-49173][CONNECT] Change Spark Connect shell prompt from @ to scala>

  Show description for 37ef6a3
  HyukjinKwon

  committed
  37ef6a3

  Copy full SHA for 37ef6a3

Commits on Aug 11, 2024

• [SPARK-49171][CONNECT][DOCS] Update Spark Shell with Spark Connect

  Show description for d1af1f5
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  d1af1f5

  Copy full SHA for d1af1f5

• [SPARK-48936][CONNECT][FOLLOW-UP] Makes spark-shell with Spark connect work with SPARK_REMOTE environment variable

  Show description for 6e3b384
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  6e3b384

  Copy full SHA for 6e3b384

• [SPARK-48936][CONNECT] Makes spark-shell works with Spark connect

  Show description for dee53bb
  HyukjinKwon

  committed
  dee53bb

  Copy full SHA for dee53bb

Commits on Aug 6, 2024

• Revert "[MINOR][SQL] Remove orphans in ProtoToParsedPlanTestSuite and PlanGenerationTestSuite"

  Show description for da5912a
  HyukjinKwon

  committed
  da5912a

  Copy full SHA for da5912a

Commits on Aug 5, 2024

• [MINOR][SQL] Remove orphans in ProtoToParsedPlanTestSuite and PlanGenerationTestSuite

  Show description for d431d40
  HyukjinKwon

  committed
  d431d40

  Copy full SHA for d431d40

• [SPARK-48763][TESTS][FOLLOW-UP] Update project location in PlanGenerationTestSuite

  Show description for f1f686d
  HyukjinKwon

  committed
  f1f686d

  Copy full SHA for f1f686d

Commits on Aug 2, 2024

• [SPARK-48763][CONNECT][BUILD][FOLLOW-UP] Move Spark Connect common/server into sql directory

  Show description for c248b06
  HyukjinKwon

  committed
  c248b06

  Copy full SHA for c248b06

Commits on Jul 16, 2024

• [SPARK-48883][ML][R] Replace RDD read / write API invocation with Dataframe read / write API

  Show description for c0f6db8
  HyukjinKwon

  committed
  c0f6db8

  Copy full SHA for c0f6db8

Pagination

Previous

Next