Skip to content

Files

Latest commit

 

History

History
35 lines (20 loc) · 945 Bytes

File metadata and controls

35 lines (20 loc) · 945 Bytes

sparkstreaming-algebird-algorithms-demo

Install the followings:

Buiding source jar

sbt package

Starting Kafka Zookeeper:

./bin/zookeeper-server-start.sh config/zookeeper.properties

Starting Kafka Server:

./bin/kafka-server-start.sh config/server.properties

Starting Kafka Producer

sbt "run-main io.traintracks.demo.spark.streaming.algebird.KafkaLogProducer"

Starting SparkMeetupDemo

Our SparkMeetupDemo will run the HyperLogLog algorithm and Count-Min Sketch both in one pass with Spark Streaming. It'll receive messages from Kafka's topic called sparkmeetup

sbt "run-main io.traintracks.demo.spark.streaming.algebird.SparkMeetupDemo" > SparkMeetupDemo.log

View the result

tail -f SparkMeetupDemo.log