Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit History

Commits on Mar 27, 2023

• [SPARK-42896][SQL][PYTHON] Make mapInPandas / mapInArrow support barrier mode execution

  Show description for 06bf544
  WeichenXu123

  committed
  06bf544

  Copy full SHA for 06bf544

• [SPARK-42920][CONNECT][PYTHON] Enable tests for UDF with UDT

  Show description for 80f8664
  

  ueshin

  authored and

  HyukjinKwon

  committed
  80f8664

  Copy full SHA for 80f8664

• [SPARK-42914][PYTHON] Reuse transformUnregisteredFunction for DistributedSequenceID

  Show description for 10cf850
  

  itholic

  authored and

  HyukjinKwon

  committed
  10cf850

  Copy full SHA for 10cf850

Commits on Mar 24, 2023

• [SPARK-42911][PYTHON] Introduce more basic exceptions

  Show description for fa9b6c3
  

  ueshin

  authored and

  HyukjinKwon

  committed
  fa9b6c3

  Copy full SHA for fa9b6c3

Commits on Mar 23, 2023

• [SPARK-42903][PYTHON][DOCS] Avoid documenting None as as a return value in docstring

  Show description for ece156f
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  ece156f

  Copy full SHA for ece156f

• [SPARK-42900][CONNECT][PYTHON] Fix createDataFrame to respect inference and column names

  Show description for 39e87d6
  

  ueshin

  authored and

  zhengruifeng

  committed
  39e87d6

  Copy full SHA for 39e87d6

• [SPARK-42903][PYTHON][DOCS] Avoid documenting None as as a return value in docstring

  Show description for 07301b4
  HyukjinKwon

  committed
  07301b4

  Copy full SHA for 07301b4

• [SPARK-42878][CONNECT] The table API in DataFrameReader could also accept options

  Show description for 0e29c8d
  

  amaliujia

  authored and

  HyukjinKwon

  committed
  0e29c8d

  Copy full SHA for 0e29c8d

• [SPARK-42901][CONNECT][PYTHON] Move StorageLevel into a separate file to avoid potential file recursively imports

  Show description for 88cc239
  

  LuciferYang

  authored and

  HyukjinKwon

  committed
  88cc239

  Copy full SHA for 88cc239

• [SPARK-42891][CONNECT][PYTHON] Implement CoGrouped Map API

  Show description for 1fbc794
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  1fbc794

  Copy full SHA for 1fbc794

Commits on Mar 22, 2023

• [SPARK-41233][CONNECT][PYTHON] Add array_prepend to Spark Connect Python client

  Show description for c75b689
  

  ueshin

  authored and

  HyukjinKwon

  committed
  c75b689

  Copy full SHA for c75b689

• [MINOR][DOCS] Fix typos

  Show description for 7f45285
  

  sudoliyang

  authored and

  HyukjinKwon

  committed
  7f45285

  Copy full SHA for 7f45285

• [SPARK-42889][CONNECT][PYTHON] Implement cache, persist, unpersist, and storageLevel

  Show description for b4f0224
  

  ueshin

  authored and

  HyukjinKwon

  committed
  b4f0224

  Copy full SHA for b4f0224

• [SPARK-42816][CONNECT] Support Max Message size up to 128MB

  Show description for da19e0d
  

  grundprinzip

  authored and

  dongjoon-hyun

  committed
  da19e0d

  Copy full SHA for da19e0d

• [SPARK-42662][CONNECT][PS] Add proto message for pandas API on Spark default index

  Show description for 2c962a8
  

  itholic

  authored and

  HyukjinKwon

  committed
  2c962a8

  Copy full SHA for 2c962a8

• [MINOR][DOCS] Remove SparkSession constructor invocation in the example

  Show description for 54afa2b
  HyukjinKwon

  committed
  54afa2b

  Copy full SHA for 54afa2b

Commits on Mar 21, 2023

• [SPARK-42875][CONNECT][PYTHON] Fix toPandas to handle timezone and map types properly

  Show description for 6103512
  

  ueshin

  authored and

  zhengruifeng

  committed
  6103512

  Copy full SHA for 6103512

Commits on Mar 20, 2023

• [SPARK-42340][CONNECT][PYTHON] Implement Grouped Map API

  Show description for fee47c7
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  fee47c7

  Copy full SHA for fee47c7

• [SPARK-41233][SQL][PYTHON] Add array_prepend function

  Show description for 1e7e47d
  

  navinvishy

  authored and

  zhengruifeng

  committed
  1e7e47d

  Copy full SHA for 1e7e47d

• [SPARK-42247][CONNECT][PYTHON] Fix UserDefinedFunction to have returnType

  Show description for 708bda3
  

  ueshin

  and

  HyukjinKwon

  committed
  708bda3

  Copy full SHA for 708bda3

• [SPARK-41818][SPARK-41843][CONNECT][PYTHON][TESTS] Enable more parity tests

  Show description for e911c5e
  

  ueshin

  authored and

  HyukjinKwon

  committed
  e911c5e

  Copy full SHA for e911c5e

• [SPARK-42848][CONNECT][PYTHON] Implement DataFrame.registerTempTable

  Show description for 71ea390
  

  ueshin

  authored and

  HyukjinKwon

  committed
  71ea390

  Copy full SHA for 71ea390

• [SPARK-42020][CONNECT][PYTHON] Support UserDefinedType in Spark Connect

  Show description for dc6cf74
  

  ueshin

  authored and

  HyukjinKwon

  committed
  dc6cf74

  Copy full SHA for dc6cf74

Commits on Mar 17, 2023

• [SPARK-42824][CONNECT][PYTHON] Provide a clear error message for unsupported JVM attributes

  Show description for deac481
  

  itholic

  authored and

  HyukjinKwon

  committed
  deac481

  Copy full SHA for deac481

• [SPARK-42826][PS][DOCS] Add migration notes for update to supported pandas version

  Show description for 1b40565
  

  itholic

  authored and

  HyukjinKwon

  committed
  1b40565

  Copy full SHA for 1b40565

Commits on Mar 16, 2023

• Revert "[SPARK-41233][SQL][PYTHON] Add array_prepend function"

  Show description for baf9020
  HyukjinKwon

  committed
  baf9020

  Copy full SHA for baf9020

• [SPARK-41233][SQL][PYTHON] Add array_prepend function

  Show description for 3dd6296
  

  navinvishy

  authored and

  zhengruifeng

  committed
  3dd6296

  Copy full SHA for 3dd6296

• [SPARK-42800][CONNECT][PYTHON][ML] Implement ml function {array_to_vector, vector_to_array}

  Show description for 3c7ef7d
  zhengruifeng

  committed
  3c7ef7d

  Copy full SHA for 3c7ef7d

• [SPARK-42812][CONNECT] Add client_type to AddArtifactsRequest protobuf message

  Show description for 43b6463
  

  vicennial

  authored and

  HyukjinKwon

  committed
  43b6463

  Copy full SHA for 43b6463

• [SPARK-42818][CONNECT][PYTHON][FOLLOWUP] Add versionchanged

  Show description for 23eaa38
  

  ueshin

  authored and

  zhengruifeng

  committed
  23eaa38

  Copy full SHA for 23eaa38

• [SPARK-42818][CONNECT][PYTHON] Implement DataFrameReader/Writer.jdbc

  Show description for 8b2f28b
  

  ueshin

  authored and

  HyukjinKwon

  committed
  8b2f28b

  Copy full SHA for 8b2f28b

Commits on Mar 15, 2023

• [MINOR][PYTHON] Change TypeVar to private symbols

  Show description for 6d3587a
  

  MaicoTimmerman

  authored and

  HyukjinKwon

  committed
  6d3587a

  Copy full SHA for 6d3587a

• [SPARK-42765][CONNECT][PYTHON] Enable importing pandas_udf from pyspark.sql.connect.functions

  Show description for 149e020
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  149e020

  Copy full SHA for 149e020

Commits on Mar 14, 2023

• [SPARK-42752][PYSPARK][SQL] Make PySpark exceptions printable during initialization

  Show description for b2a7f14
  

  gerashegalov

  authored and

  srowen

  committed
  b2a7f14

  Copy full SHA for b2a7f14

• [SPARK-42732][PYSPARK][CONNECT] Support spark connect session getActiveSession method

  Show description for 753864f
  WeichenXu123

  committed
  753864f

  Copy full SHA for 753864f

Pagination

Previous

Next