Commits

Branch selector

 master

User selector

asl3

Datepicker

All time

Commit History

Commits on Jan 10, 2025

• [SPARK-50786][SQL] Remove removeWhitespace helper for DESCRIBE TABLE

  Show description for 3a84dfc
  

  asl3

  authored and

  dongjoon-hyun

  committed
  3a84dfc

  Copy full SHA for 3a84dfc

Commits on Jan 7, 2025

• [SPARK-50541] Describe Table As JSON

  Show description for 36d23ef
  

  asl3

  authored and

  cloud-fan

  committed
  36d23ef

  Copy full SHA for 36d23ef

Commits on Dec 28, 2024

• [SPARK-50690][SQL] Fix discrepancy in DESCRIBE TABLE view query output columns quoting

  Show description for c1e51f2
  

  asl3

  authored and

  HyukjinKwon

  committed
  c1e51f2

  Copy full SHA for c1e51f2

Commits on Aug 7, 2024

• [MINOR][SQL] Add parquet nanosAsLong behavior change to 3.2 migration guide

  Show description for 46acdf4
  

  asl3

  authored and

  HyukjinKwon

  committed
  46acdf4

  Copy full SHA for 46acdf4

Commits on Jul 30, 2024

• [SPARK-48740][SQL] Catch missing window specification error early

  Show description for 0b48d3f
  

  asl3

  and

  gengliangwang

  committed
  0b48d3f

  Copy full SHA for 0b48d3f

Commits on Jul 20, 2024

• [SPARK-48592][INFRA] Add structured logging style script and GitHub workflow

  Show description for 41f67dd
  

  asl3

  authored and

  gengliangwang

  committed
  41f67dd

  Copy full SHA for 41f67dd

Commits on Jul 18, 2024

• [SPARK-48623][CORE] Migrate FileAppender logs to structured logging

  Show description for 3831d1d
  

  asl3

  authored and

  gengliangwang

  committed
  3831d1d

  Copy full SHA for 3831d1d

Commits on Jul 11, 2024

• [SPARK-48623][CORE] Structured logging migrations [Part 3]

  Show description for 71cf25e
  

  asl3

  and

  gengliangwang

  committed
  71cf25e

  Copy full SHA for 71cf25e

Commits on Jul 9, 2024

• [SPARK-48623][CORE] Structured logging migrations [Part 2]

  Show description for 75709f5
  

  asl3

  authored and

  gengliangwang

  committed
  75709f5

  Copy full SHA for 75709f5

Commits on Jul 2, 2024

• [SPARK-48759][SQL] Add migration doc for CREATE TABLE AS SELECT behavior change behavior change since Spark 3.4

  Show description for 8a5f4e0
  

  asl3

  authored and

  cloud-fan

  committed
  8a5f4e0

  Copy full SHA for 8a5f4e0

Commits on Jun 19, 2024

• [SPARK-48623][CORE] Structured Logging Migrations

  Show description for b0e2cb5
  

  asl3

  authored and

  gengliangwang

  committed
  b0e2cb5

  Copy full SHA for b0e2cb5

Commits on Jan 30, 2024

• [SPARK-46910][PYTHON] Eliminate JDK Requirement in PySpark Installation

  Show description for 83fad32
  

  asl3

  and

  HyukjinKwon

  committed
  83fad32

  Copy full SHA for 83fad32

Commits on Oct 31, 2023

• [SPARK-45729][PYTHON][DOCS] Fix PySpark testing guide links

  Show description for 2fd1f10
  

  asl3

  authored and

  HyukjinKwon

  committed
  2fd1f10

  Copy full SHA for 2fd1f10

Commits on Aug 8, 2023

• [SPARK-44665][PYTHON] Add support for pandas DataFrame assertDataFrameEqual

  Show description for 69bd835
  

  asl3

  authored and

  HyukjinKwon

  committed
  69bd835

  Copy full SHA for 69bd835

Commits on Aug 7, 2023

• [SPARK-44682][PS] Make pandas error class message_parameters strings

  Show description for df8e52d
  

  asl3

  authored and

  HyukjinKwon

  committed
  df8e52d

  Copy full SHA for df8e52d

Commits on Aug 6, 2023

• [SPARK-44629][PYTHON][DOCS] Publish PySpark Test Guidelines webpage

  Show description for a640373
  

  asl3

  authored and

  HyukjinKwon

  committed
  a640373

  Copy full SHA for a640373

Commits on Aug 3, 2023

• [SPARK-44652] Raise error when only one df is None

  Show description for 16b031e
  

  asl3

  authored and

  HyukjinKwon

  committed
  16b031e

  Copy full SHA for 16b031e

• [SPARK-44645][PYTHON][DOCS] Update assertDataFrameEqual docs error example output

  Show description for 445e3c3
  

  asl3

  authored and

  HyukjinKwon

  committed
  445e3c3

  Copy full SHA for 445e3c3

Commits on Aug 1, 2023

• [SPARK-44218][PYTHON] Customize diff log in assertDataFrameEqual error message format

  Show description for 4f66f09
  

  asl3

  authored and

  HyukjinKwon

  committed
  4f66f09

  Copy full SHA for 4f66f09

• [SPARK-44617] Support comparison between lists of Rows

  Show description for eb4152d
  

  asl3

  authored and

  HyukjinKwon

  committed
  eb4152d

  Copy full SHA for eb4152d

Commits on Jul 31, 2023

• [SPARK-44603] Add pyspark.testing to setup.py

  Show description for 1380a3d
  

  asl3

  authored and

  ueshin

  committed
  1380a3d

  Copy full SHA for 1380a3d

• [SPARK-44597][PYTHON][TESTS] Migrate test_sql assert_eq to use assertDataFrameEqual

  Show description for 9f03f43
  

  asl3

  authored and

  HyukjinKwon

  committed
  9f03f43

  Copy full SHA for 9f03f43

Commits on Jul 30, 2023

• [SPARK-44596] Fix pandas-on-Spark type checks for assertDataFrameEqual

  Show description for a76ee11
  

  asl3

  authored and

  HyukjinKwon

  committed
  a76ee11

  Copy full SHA for a76ee11

Commits on Jul 28, 2023

• [SPARK-44548][PYTHON] Add support for pandas-on-Spark DataFrame assertDataFrameEqual

  Show description for 7c1ad5b
  

  asl3

  authored and

  HyukjinKwon

  committed
  7c1ad5b

  Copy full SHA for 7c1ad5b

Commits on Jul 17, 2023

• [SPARK-44413][PYTHON] Clarify error for unsupported arg data type in assertDataFrameEqual

  Show description for d574dbc
  

  asl3

  authored and

  HyukjinKwon

  committed
  d574dbc

  Copy full SHA for d574dbc

• [SPARK-44453][PYTHON] Use difflib to display errors in assertDataFrameEqual

  Show description for aa68810
  

  asl3

  authored and

  HyukjinKwon

  committed
  aa68810

  Copy full SHA for aa68810

• [SPARK-44446][PYTHON] Add checks for expected list type special cases

  Show description for e578d46
  

  asl3

  authored and

  xinrong-meng

  committed
  e578d46

  Copy full SHA for e578d46

Commits on Jul 16, 2023

• [SPARK-44216][PYTHON] Make assertSchemaEqual API public

  Show description for a00a32a
  

  asl3

  authored and

  HyukjinKwon

  committed
  a00a32a

  Copy full SHA for a00a32a

Commits on Jul 14, 2023

• [SPARK-44217][PYTHON] Allow custom precision for fp approx equality

  Show description for 1b8e9c6
  

  asl3

  authored and

  HyukjinKwon

  committed
  1b8e9c6

  Copy full SHA for 1b8e9c6

Commits on Jul 13, 2023

• [SPARK-44364] [PYTHON] Add support for List[Row] data type for expected

  Show description for 61030de
  

  asl3

  authored and

  HyukjinKwon

  committed
  61030de

  Copy full SHA for 61030de

• [MINOR][PYTHON] Fix PySpark error class get_error_message

  Show description for f4aa798
  

  asl3

  authored and

  HyukjinKwon

  committed
  f4aa798

  Copy full SHA for f4aa798

• [SPARK-44397][PYTHON] Expose assertDataFrameEqual in pyspark.testing.utils

  Show description for e8ba0d4
  

  asl3

  authored and

  zhengruifeng

  committed
  e8ba0d4

  Copy full SHA for e8ba0d4

Commits on Jul 11, 2023

• [SPARK-44357][PYTHON] Add pyspark_testing module for GHA tests

  Show description for c3bfc34
  

  asl3

  authored and

  HyukjinKwon

  committed
  c3bfc34

  Copy full SHA for c3bfc34

• [SPARK-44363][PYTHON] Display percent of unequal rows in DataFrame comparison

  Show description for 9accb5c
  

  asl3

  authored and

  HyukjinKwon

  committed
  9accb5c

  Copy full SHA for 9accb5c

Commits on Jul 8, 2023

• [SPARK-44061][PYTHON] Add assertDataFrameEqual util function

  Show description for e4a356a
  

  asl3

  authored and

  HyukjinKwon

  committed
  e4a356a

  Copy full SHA for e4a356a

Pagination

Previous

Next