Commits

Branch selector

 master

User selector

tdas

Datepicker

All time

Commit History

Commits on Oct 21, 2016

• [SPARK-17926][SQL][STREAMING] Added json for statuses

  Show description for 7a531e3
  

  tdas

  authored and

  yhuai

  committed
  7a531e3

  Copy full SHA for 7a531e3

Commits on Oct 19, 2016

• [SPARK-17731][SQL][STREAMING][FOLLOWUP] Refactored StreamingQueryListener APIs

  Show description for 941b3f9
  tdas

  committed
  941b3f9

  Copy full SHA for 941b3f9

Commits on Oct 18, 2016

• [SQL][STREAMING][TEST] Follow up to remove Option.contains for Scala 2.10 compatibility

  Show description for a9e79a4
  tdas

  committed
  a9e79a4

  Copy full SHA for a9e79a4

Commits on Oct 14, 2016

• [TEST] Ignore flaky test in StreamingQueryListenerSuite

  Show description for 05800b4
  tdas

  committed
  05800b4

  Copy full SHA for 05800b4

Commits on Oct 13, 2016

• [SPARK-17731][SQL][STREAMING] Metrics for structured streaming

  Show description for 7106866
  tdas

  committed
  7106866

  Copy full SHA for 7106866

Commits on Sep 7, 2016

• [SPARK-17372][SQL][STREAMING] Avoid serialization issues by using Arrays to save file names in FileStreamSource

  Show description for eb1ab88
  tdas

  committed
  eb1ab88

  Copy full SHA for eb1ab88

Commits on Aug 17, 2016

• [SPARK-17096][SQL][STREAMING] Improve exception string reported through the StreamingQueryListener

  Show description for d60af8f
  tdas

  committed
  d60af8f

  Copy full SHA for d60af8f

Commits on Aug 8, 2016

• [SPARK-16953] Make requestTotalExecutors public Developer API to be consistent with requestExecutors/killExecutors

  Show description for 8650239
  tdas

  committed
  8650239

  Copy full SHA for 8650239

Commits on Jul 30, 2016

• [SPARK-16748][SQL] SparkExceptions during planning should not wrapped in TreeNodeException

  Show description for bbc2475
  

  tdas

  authored and

  yhuai

  committed
  bbc2475

  Copy full SHA for bbc2475

Commits on Jul 26, 2016

• [TEST][STREAMING] Fix flaky Kafka rate controlling test

  Show description for 03c2743
  tdas

  committed
  03c2743

  Copy full SHA for 03c2743

Commits on Jul 25, 2016

• [SPARK-14131][STREAMING] SQL Improved fix for avoiding potential deadlocks in HDFSMetadataLog

  Show description for c979c8b
  tdas

  committed
  c979c8b

  Copy full SHA for c979c8b

Commits on Jul 12, 2016

• [SPARK-16430][SQL][STREAMING] Fixed bug in the maxFilesPerTrigger in FileStreamSource

  Show description for e50efd5
  tdas

  committed
  e50efd5

  Copy full SHA for e50efd5

Commits on Jul 8, 2016

• [SPARK-16430][SQL][STREAMING] Add option maxFilesPerTrigger

  Show description for 5bce458
  tdas

  committed
  5bce458

  Copy full SHA for 5bce458

Commits on Jun 30, 2016

• [SPARK-16256][DOCS] Fix window operation diagram

  Show description for 5d00a7b
  tdas

  committed
  5d00a7b

  Copy full SHA for 5d00a7b

• [SPARK-12177][TEST] Removed test to avoid compilation issue in scala 2.10

  Show description for de8ab31
  

  tdas

  authored and

  liancheng

  committed
  de8ab31

  Copy full SHA for de8ab31

• [SPARK-16256][DOCS] Minor fixes on the Structured Streaming Programming Guide

  Show description for 2c3d961
  tdas

  committed
  2c3d961

  Copy full SHA for 2c3d961

Commits on Jun 29, 2016

• [SPARK-16256][SQL][STREAMING] Added Structured Streaming Programming Guide

  Show description for 64132a1
  tdas

  committed
  64132a1

  Copy full SHA for 64132a1

• [SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writer from pyspark.sql to pyspark.sql.streaming

  Show description for f454a7f
  

  tdas

  authored and

  zsxwing

  committed
  f454a7f

  Copy full SHA for f454a7f

Commits on Jun 20, 2016

• [SPARK-15982][SPARK-16009][SPARK-16007][SQL] Harmonize the behavior of DataFrameReader.text/csv/json/parquet/orc

  Show description for b99129c
  

  tdas

  authored and

  zsxwing

  committed
  b99129c

  Copy full SHA for b99129c

Commits on Jun 16, 2016

• [SPARK-15981][SQL][STREAMING] Fixed bug and added tests in DataStreamReader Python API

  Show description for 084dca7
  

  tdas

  authored and

  zsxwing

  committed
  084dca7

  Copy full SHA for 084dca7

Commits on Jun 15, 2016

• [SPARK-15953][WIP][STREAMING] Renamed ContinuousQuery to StreamingQuery

  Show description for 9a50719
  

  tdas

  authored and

  zsxwing

  committed
  9a50719

  Copy full SHA for 9a50719

• [SPARK-15933][SQL][STREAMING] Refactored DF reader-writer to use readStream and writeStream for streaming DFs

  Show description for 214adb1
  tdas

  committed
  214adb1

  Copy full SHA for 214adb1

Commits on Jun 13, 2016

• [SPARK-15889][SQL][STREAMING] Add a unique id to ContinuousQuery

  Show description for c654ae2
  

  tdas

  authored and

  zsxwing

  committed
  c654ae2

  Copy full SHA for c654ae2

• [HOTFIX][MINOR][SQL] Revert " Standardize 'continuous queries' to 'streaming D…

  Show description for a6a18a4
  tdas

  committed
  a6a18a4

  Copy full SHA for a6a18a4

Commits on Jun 10, 2016

• [SPARK-15812][SQ][STREAMING] Added support for sorting after streaming aggregation with complete mode

  Show description for abdb5d4
  tdas

  committed
  abdb5d4

  Copy full SHA for abdb5d4

Commits on May 31, 2016

• [SPARK-15517][SQL][STREAMING] Add support for complete output mode in Structure Streaming

  Show description for 90b1143
  

  tdas

  authored and

  marmbrus

  committed
  90b1143

  Copy full SHA for 90b1143

Commits on May 24, 2016

• [SPARK-15458][SQL][STREAMING] Disable schema inference for streaming datasets on file streams

  Show description for e631b81
  tdas

  committed
  e631b81

  Copy full SHA for e631b81

Commits on May 22, 2016

• [SPARK-15428][SQL] Disable multiple streaming aggregations

  Show description for 1ffa608
  tdas

  committed
  1ffa608

  Copy full SHA for 1ffa608

Commits on May 11, 2016

• [SPARK-15248][SQL] Make MetastoreFileCatalog consider directories from partition specs of a partitioned metastore table

  Show description for 81c68ec
  

  tdas

  authored and

  yhuai

  committed
  81c68ec

  Copy full SHA for 81c68ec

Commits on May 10, 2016

• [SPARK-14837][SQL][STREAMING] Added support in file stream source for reading new files added to subdirs

  Show description for d9ca9fd
  

  tdas

  authored and

  yhuai

  committed
  d9ca9fd

  Copy full SHA for d9ca9fd

Commits on May 6, 2016

• [SPARK-14997][SQL] Fixed FileCatalog to return correct set of files when there is no partitioning scheme in the given paths

  Show description for f7b7ef4
  

  tdas

  authored and

  yhuai

  committed
  f7b7ef4

  Copy full SHA for f7b7ef4

Commits on May 5, 2016

• [SPARK-15131][SQL] Shutdown StateStore management thread when SparkContext has been shutdown

  Show description for bde27b8
  

  tdas

  authored and

  zsxwing

  committed
  bde27b8

  Copy full SHA for bde27b8

Commits on May 4, 2016

• [SPARK-15103][SQL] Refactored FileCatalog class to allow StreamFileCatalog to infer partitioning

  Show description for 0fd3a47
  tdas

  committed
  0fd3a47

  Copy full SHA for 0fd3a47

Commits on May 3, 2016

• [SPARK-14716][SQL] Added support for partitioning in FileStreamSink

  Show description for 4ad492c
  tdas

  committed
  4ad492c

  Copy full SHA for 4ad492c

Commits on Apr 28, 2016

• [SPARK-14970][SQL] Prevent DataSource from enumerates all files in a directory if there is user specified schema

  Show description for 0ee5419
  

  tdas

  authored and

  marmbrus

  committed
  0ee5419

  Copy full SHA for 0ee5419

Pagination

Previous

Next