Commits

Branch selector

 master

User selector

tdas

Datepicker

All time

Commit History

Commits on Aug 22, 2018

• [SPARK-25184][SS] Fixed race condition in StreamExecution that caused flaky test in FlatMapGroupsWithState

  Show description for 3106324
  tdas

  committed
  3106324

  Copy full SHA for 3106324

• [MINOR] Added import to fix compilation

  Show description for a998e9d
  tdas

  committed
  a998e9d

  Copy full SHA for a998e9d

Commits on Jul 23, 2018

• [SPARK-24699][SS] Make watermarks work with Trigger.Once by saving updated watermark to commit log

  Show description for 61f0ca4
  tdas

  committed
  61f0ca4

  Copy full SHA for 61f0ca4

Commits on Jul 19, 2018

• [SPARK-22187][SS] Update unsaferow format for saved state in flatMapGroupsWithState to allow timeouts with deleted state

  Show description for b3d88ac
  tdas

  committed
  b3d88ac

  Copy full SHA for b3d88ac

Commits on Jul 11, 2018

• [SPARK-24697][SS] Fix the reported start offsets in streaming query progress

  Show description for ff7f6ef
  tdas

  committed
  ff7f6ef

  Copy full SHA for ff7f6ef

• [SPARK-24730][SS] Add policy to choose max as global watermark when streaming query has multiple watermarks

  Show description for 6078b89
  tdas

  committed
  6078b89

  Copy full SHA for 6078b89

Commits on Jun 19, 2018

• [SPARK-24565][SS] Add API for in Structured Streaming for exposing output rows of each microbatch as a DataFrame

  Show description for 2cb9763
  

  tdas

  authored and

  zsxwing

  committed
  2cb9763

  Copy full SHA for 2cb9763

Commits on Jun 15, 2018

• [SPARK-24396][SS][PYSPARK] Add Structured Streaming ForeachWriter for python

  Show description for b5ccf0d
  tdas

  committed
  b5ccf0d

  Copy full SHA for b5ccf0d

Commits on Jun 5, 2018

• [SPARK-24453][SS] Fix error recovering from the failure in a no-data batch

  Show description for 2c2a86b
  tdas

  committed
  2c2a86b

  Copy full SHA for 2c2a86b

Commits on May 31, 2018

• [SPARK-24397][PYSPARK] Added TaskContext.getLocalProperty(key) in Python

  Show description for 223df5d
  tdas

  committed
  223df5d

  Copy full SHA for 223df5d

Commits on May 18, 2018

• [SPARK-24159][SS] Enable no-data micro batches for streaming mapGroupswithState

  Show description for 807ba44
  

  tdas

  authored and

  zsxwing

  committed
  807ba44

  Copy full SHA for 807ba44

Commits on May 16, 2018

• [SPARK-24158][SS] Enable no-data batches for streaming joins

  Show description for 991726f
  tdas

  committed
  991726f

  Copy full SHA for 991726f

Commits on May 4, 2018

• [SPARK-24157][SS] Enabled no-data batches in MicroBatchExecution for streaming aggregation and deduplication.

  Show description for 47b5b68
  tdas

  committed
  47b5b68

  Copy full SHA for 47b5b68

Commits on Apr 26, 2018

• [SPARK-24094][SS][MINOR] Change description strings of v2 streaming sources to reflect the change

  Show description for d1eb8d3
  tdas

  committed
  d1eb8d3

  Copy full SHA for d1eb8d3

Commits on Apr 25, 2018

• [SPARK-24050][SS] Calculate input / processing rates correctly for DataSourceV2 streaming sources

  Show description for 396938e
  tdas

  committed
  396938e

  Copy full SHA for 396938e

Commits on Apr 24, 2018

• [SPARK-24056][SS] Make consumer creation lazy in Kafka source for Structured streaming

  Show description for 7b1e652
  tdas

  committed
  7b1e652

  Copy full SHA for 7b1e652

Commits on Apr 23, 2018

• [SPARK-23004][SS] Ensure StateStore.commit is called only once in a streaming aggregation task

  Show description for 770add8
  tdas

  committed
  770add8

  Copy full SHA for 770add8

Commits on Apr 13, 2018

• [SPARK-23966][SS] Refactoring all checkpoint file writing logic in a common CheckpointFileManager interface

  Show description for cbb41a0
  tdas

  committed
  cbb41a0

  Copy full SHA for cbb41a0

Commits on Mar 30, 2018

• [SPARK-23827][SS] StreamingJoinExec should ensure that input data is partitioned into specific number of partitions

  Show description for 15298b9
  tdas

  committed
  15298b9

  Copy full SHA for 15298b9

Commits on Mar 16, 2018

• [SPARK-23623][SS] Avoid concurrent use of cached consumers in CachedKafkaConsumer

  Show description for bd201bf
  

  tdas

  authored and

  zsxwing

  committed
  bd201bf

  Copy full SHA for bd201bf

Commits on Mar 3, 2018

• [SPARK-23541][SS] Allow Kafka source to read data with greater parallelism than the number of topic-partitions

  Show description for 486f99e
  tdas

  committed
  486f99e

  Copy full SHA for 486f99e

Commits on Feb 23, 2018

• [SPARK-23408][SS] Synchronize successive AddData actions in Streaming*JoinSuite

  Show description for 855ce13
  tdas

  committed
  855ce13

  Copy full SHA for 855ce13

Commits on Feb 21, 2018

• [SPARK-23484][SS] Fix possible race condition in KafkaContinuousReader

  Show description for 3fd0ccb
  tdas

  committed
  3fd0ccb

  Copy full SHA for 3fd0ccb

• [SPARK-23454][SS][DOCS] Added trigger information to the Structured Streaming programming guide

  Show description for 601d653
  tdas

  committed
  601d653

  Copy full SHA for 601d653

Commits on Feb 16, 2018

• [SPARK-23362][SS] Migrate Kafka Microbatch source to v2

  Show description for 0a73aa3
  tdas

  committed
  0a73aa3

  Copy full SHA for 0a73aa3

Commits on Feb 14, 2018

• [SPARK-23406][SS] Enable stream-stream self-joins

  Show description for 658d9d9
  tdas

  committed
  658d9d9

  Copy full SHA for 658d9d9

Commits on Feb 7, 2018

• [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 APIs

  Show description for 30295bf
  tdas

  committed
  30295bf

  Copy full SHA for 30295bf

Commits on Feb 3, 2018

• [SPARK-23064][SS][DOCS] Stream-stream joins Documentation - follow up

  Show description for eaf35de
  tdas

  committed
  eaf35de

  Copy full SHA for eaf35de

Commits on Jan 24, 2018

• [SPARK-23197][DSTREAMS] Increased timeouts to resolve flakiness

  Show description for 15adcc8
  tdas

  committed
  15adcc8

  Copy full SHA for 15adcc8

Commits on Jan 19, 2018

• [SPARK-23142][SS][DOCS] Added docs for continuous processing

  Show description for 4cd2ecc
  tdas

  committed
  4cd2ecc

  Copy full SHA for 4cd2ecc

Commits on Jan 18, 2018

• [SPARK-23144][SS] Added console sink for continuous processing

  Show description for bf34d66
  tdas

  committed
  bf34d66

  Copy full SHA for bf34d66

• [SPARK-23143][SS][PYTHON] Added python API for setting continuous trigger

  Show description for 2d41f04
  tdas

  committed
  2d41f04

  Copy full SHA for 2d41f04

• [SPARK-23064][DOCS][SS] Added documentation for stream-stream joins

  Show description for 1002bd6
  

  tdas

  authored and

  zsxwing

  committed
  1002bd6

  Copy full SHA for 1002bd6

• [SPARK-23119][SS] Minor fixes to V2 streaming APIs

  Show description for bac0d66
  

  tdas

  authored and

  zsxwing

  committed
  bac0d66

  Copy full SHA for bac0d66

Commits on Dec 8, 2017

• [SPARK-22187][SS][REVERT] Revert change in state row format for mapGroupsWithState

  Show description for b11869b
  

  tdas

  authored and

  zsxwing

  committed
  b11869b

  Copy full SHA for b11869b

Pagination

Previous

Next