Skip to content

leedon/streamingpro

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

48 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

StreamingPro

If github is too slow to view ,please click me

StreamingPro is not a complete application, but rather a code library and API that can easily be used to build your streaming application which may run on Spark Streaming.

StreamingPro also make it possible that all you should do to build streaming program is assembling components(eg. SQL Component) in configuration file. Of source , if you are a geek who like do every thing by programing,we also encourage you use API provided by StreamingPro which is more easy to use then original API designed by Spark/Storm.

Features

  • Pure spark streaming program (Storm/Spark in future)
  • No need of coding, only declarative workflows
  • SQL-Oriented workflows support
  • Data continuously streamed in & processed in near real-time
  • dynamically CURD of workflows at runtime via Rest API (in single instance or multiple instances)
  • Flexible workflows (input, output, parsers, etc...)
  • High performance
  • Scalable

Documents

Architecture

If no picture show,please click me

Declarative workflows

If no picture show,please click me

Implementation

If no picture show,please click me

About

Build Spark Streaming Application by SQL

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Scala 76.7%
  • Java 23.3%