Commits

Branch selector

 master

User selector

WweiL

Datepicker

All time

Commit History

Commits on Jan 9, 2025

• [SPARK-49883][SS][TESTS][FOLLOWUP] RocksDB Fault Tolerance Test

  Show description for a229917
  

  WweiL

  authored and

  HeartSaVioR

  committed
  a229917

  Copy full SHA for a229917

Commits on Dec 27, 2024

• [SPARK-50622][SS][MINOR] RocksDB Refactor

  Show description for 783b3e3
  

  WweiL

  authored and

  HeartSaVioR

  committed
  783b3e3

  Copy full SHA for 783b3e3

Commits on Dec 25, 2024

• [SPARK-50360][SS][FOLLOWUP][TESTS] Changelog reader test improvements

  Show description for 112276d
  

  WweiL

  authored and

  HeartSaVioR

  committed
  112276d

  Copy full SHA for 112276d

Commits on Dec 16, 2024

• [SPARK-49461][SS][TESTS][FOLLOWUP] Move related resource files to correct place

  Show description for a6f82c6
  

  WweiL

  authored and

  HeartSaVioR

  committed
  a6f82c6

  Copy full SHA for a6f82c6

Commits on Dec 14, 2024

• [SPARK-50565][SS][TESTS] Add transformWithState correctness test

  Show description for f8de6c7
  

  WweiL

  authored and

  HeartSaVioR

  committed
  f8de6c7

  Copy full SHA for f8de6c7

Commits on Dec 13, 2024

• [SPARK-50566][MINOR][SS] Fix code style violation for RocksDB file

  Show description for 885915f
  

  WweiL

  authored and

  HeartSaVioR

  committed
  885915f

  Copy full SHA for 885915f

• [SPARK-49883][SS] State Store Checkpoint Structure V2 Integration with RocksDB and RocksDBFileManager

  Show description for 429402b
  

  WweiL

  authored and

  HeartSaVioR

  committed
  429402b

  Copy full SHA for 429402b

Commits on Dec 9, 2024

• [SPARK-49461][SS][TESTS][FOLLOWUP] Add compatibility test for new commit log

  Show description for 290b4b3
  

  WweiL

  authored and

  HeartSaVioR

  committed
  290b4b3

  Copy full SHA for 290b4b3

Commits on Dec 5, 2024

• [SPARK-50339][SPARK-50360][SS] Enable changelog to store lineage information

  Show description for af4f37c
  

  WweiL

  authored and

  HeartSaVioR

  committed
  af4f37c

  Copy full SHA for af4f37c

Commits on Oct 22, 2024

• [SPARK-49461][SS] Persistent Checkpoint ID to commit logs and read it back

  Show description for aaa7044
  

  WweiL

  authored and

  HeartSaVioR

  committed
  aaa7044

  Copy full SHA for aaa7044

Commits on Oct 3, 2024

• [SPARK-49824][SS][CONNECT] Improve logging in SparkConnectStreamingQueryCache

  Show description for 29312bc
  

  WweiL

  authored and

  HyukjinKwon

  committed
  29312bc

  Copy full SHA for 29312bc

Commits on Sep 9, 2024

• [SPARK-49551][SS] Improve RocksDB log for replayChangelog

  Show description for 14e4908
  

  WweiL

  authored and

  HeartSaVioR

  committed
  14e4908

  Copy full SHA for 14e4908

Commits on Sep 6, 2024

• [SPARK-49525][SS][CONNECT] Minor log improvement to Server Side Streaming Query ListenerBus Listener

  Show description for 9269a0b
  

  WweiL

  authored and

  HyukjinKwon

  committed
  9269a0b

  Copy full SHA for 9269a0b

Commits on Sep 5, 2024

• [SPARK-49523][CONNECT] Increase maximum wait time for connect server to come up for testing

  Show description for 182353d
  

  WweiL

  authored and

  hvanhovell

  committed
  182353d

  Copy full SHA for 182353d

Commits on Aug 30, 2024

• [SPARK-48482][PYTHON][FOLLOWUP] Revert dropDuplicates and dropDuplicatesWIthinWatermark should accept variable length args

  Show description for ebe635e
  

  WweiL

  authored and

  HyukjinKwon

  committed
  ebe635e

  Copy full SHA for ebe635e

Commits on Aug 3, 2024

• [SPARK-48480][SS][CONNECT] StreamingQueryListener should not be affected by spark.interrupt()

  Show description for aaf602a
  

  WweiL

  authored and

  HyukjinKwon

  committed
  aaf602a

  Copy full SHA for aaf602a

Commits on Jul 24, 2024

• [SPARK-48567][SS][FOLLOWUP] StreamingQuery.lastProgress should return the actual StreamingQueryProgress

  Show description for 22eb6c4
  

  WweiL

  authored and

  HyukjinKwon

  committed
  22eb6c4

  Copy full SHA for 22eb6c4

Commits on Jul 18, 2024

• [SPARK-48890][CORE][SS] Add Structured Streaming related fields to log4j ThreadContext

  Show description for 723c1c5
  

  WweiL

  authored and

  gengliangwang

  committed
  723c1c5

  Copy full SHA for 723c1c5

Commits on Jul 11, 2024

• [SPARK-48717][FOLLOWUP][PYTHON][SS] Catch Cancelled Job Group wrapped by Py4JJavaError in StreamExecution

  Show description for 52958d9
  

  WweiL

  authored and

  HyukjinKwon

  committed
  52958d9

  Copy full SHA for 52958d9

Commits on Jul 9, 2024

• [SPARK-48743][SQL][SS] MergingSessionIterator should better handle when getStruct returns null

  Show description for 18f2450
  

  WweiL

  authored and

  HyukjinKwon

  committed
  18f2450

  Copy full SHA for 18f2450

Commits on Jul 8, 2024

• [SPARK-48800][CONNECT][SS] Deflake ClientStreamingQuerySuite

  Show description for 2606f38
  

  WweiL

  authored and

  HeartSaVioR

  committed
  2606f38

  Copy full SHA for 2606f38

Commits on Jun 27, 2024

• [SPARK-48717][PYTHON][SS] Catch ForeachBatch py4j InterruptedException better in classic PySpark

  Show description for 1581264
  

  WweiL

  authored and

  HyukjinKwon

  committed
  1581264

  Copy full SHA for 1581264

Commits on Jun 17, 2024

• [SPARK-48567][SS] StreamingQuery.lastProgress should return the actual StreamingQueryProgress

  Show description for 042804a
  

  WweiL

  authored and

  HyukjinKwon

  committed
  042804a

  Copy full SHA for 042804a

Commits on Jun 10, 2024

• [SPARK-48569][SS][CONNECT] Handle edge cases in query.name

  Show description for ec6db63
  

  WweiL

  authored and

  HyukjinKwon

  committed
  ec6db63

  Copy full SHA for ec6db63

Commits on Jun 7, 2024

• [SPARK-42944][FOLLOWUP][SS][CONNECT] Reenable ApplyInPandasWithState tests

  Show description for 9de0a2e
  

  WweiL

  authored and

  HyukjinKwon

  committed
  9de0a2e

  Copy full SHA for 9de0a2e

Commits on Jun 4, 2024

• [SPARK-48482][PYTHON] dropDuplicates and dropDuplicatesWIthinWatermark should accept variable length args

  Show description for 560c083
  

  WweiL

  authored and

  HyukjinKwon

  committed
  560c083

  Copy full SHA for 560c083

Commits on May 7, 2024

• [SPARK-48147][SS][CONNECT] Remove client side listeners when local Spark session is deleted

  Show description for 0862f69
  

  WweiL

  authored and

  HyukjinKwon

  committed
  0862f69

  Copy full SHA for 0862f69

Commits on May 3, 2024

• [SPARK-43046][FOLLOWUP][SS][CONNECT] Remove not used line in deduplicateWithinWatermark

  Show description for f450272
  

  WweiL

  authored and

  HyukjinKwon

  committed
  f450272

  Copy full SHA for f450272

Commits on Apr 29, 2024

• [SPARK-47292][SS] safeMapToJValue should consider null typed values

  Show description for 8c446f3
  

  WweiL

  authored and

  HyukjinKwon

  committed
  8c446f3

  Copy full SHA for 8c446f3

Commits on Apr 28, 2024

• [SPARK-48002][PYTHON][SS] Add test for observed metrics in PySpark StreamingQueryListener

  Show description for a80579b
  

  WweiL

  authored and

  HyukjinKwon

  committed
  a80579b

  Copy full SHA for a80579b

Commits on Apr 25, 2024

• [SPARK-47962][PYTHON][DOCS] PySpark Dataframe doc test improvement

  Show description for ea37c86
  

  WweiL

  authored and

  HyukjinKwon

  committed
  ea37c86

  Copy full SHA for ea37c86

Commits on Apr 18, 2024

• [SPARK-44461][FOLLOWUP][SS][CONNECT] Remove unneeded TODOs

  Show description for d09230b
  

  WweiL

  authored and

  HyukjinKwon

  committed
  d09230b

  Copy full SHA for d09230b

Commits on Apr 16, 2024

• [SPARK-47877][SS][CONNECT] Speed up test_parity_listener

  Show description for 86837d3
  

  WweiL

  authored and

  HyukjinKwon

  committed
  86837d3

  Copy full SHA for 86837d3

• [SPARK-47233][CONNECT][SS][2/2] Client & Server logic for Client side streaming query listener

  Show description for 51d3efc
  

  WweiL

  authored and

  HyukjinKwon

  committed
  51d3efc

  Copy full SHA for 51d3efc

Commits on Apr 12, 2024

• [SPARK-47174][CONNECT][SS][1/2] Server side SparkConnectListenerBusListener for Client side streaming query listener

  Show description for f086c23
  

  WweiL

  authored and

  HyukjinKwon

  committed
  f086c23

  Copy full SHA for f086c23

Pagination

Previous

Next