You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/big-data-cluster/spark-streaming-guide.md
+7-7Lines changed: 7 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,5 @@
1
1
---
2
-
title: SQL Server Big Data Clusters Spark Streaming Guide
2
+
title: SQL Server Big Data Clusters Spark streaming guide
3
3
titleSuffix: SQL Server Big Data Clusters
4
4
description: This guide covers streaming use cases and how to implement it using SQL Server Big Data Clusters capabilities.
5
5
author: dacoelho
@@ -12,11 +12,11 @@ ms.prod: sql
12
12
ms.technology: big-data-cluster
13
13
---
14
14
15
-
# SQL Server Big Data Clusters Spark Streaming Guide
15
+
# SQL Server Big Data Clusters Spark streaming guide
16
16
17
17
[!INCLUDE[SQL Server 2019](../includes/applies-to-version/sqlserver2019.md)]
18
18
19
-
This guide covers streaming use cases and how to implement it using SQL Server Big Data Clusters Spark.
19
+
This guide covers streaming use cases and how to implement it using SQL Server Big Data Clusters Spark.
20
20
21
21
In this guide, you'll learn how to:
22
22
@@ -34,9 +34,9 @@ In this guide, you'll learn how to:
34
34
This guide assumes good level of understanding of streaming technology concepts and architectures.
35
35
The following articles provide excellent conceptual baselines:
36
36
37
-
*[Data Architecture Guide - Real time processing](https://docs.microsoft.com/azure/architecture/data-guide/big-data/real-time-processing)
38
-
*[Use Azure Event Hubs from Apache Kafka applications](https://docs.microsoft.com/azure/event-hubs/event-hubs-for-kafka-ecosystem-overview)
39
-
*[Data Architecture Guide - Choosing a real-time message ingestion technology in Azure](https://docs.microsoft.com/azure/architecture/data-guide/technology-choices/real-time-ingestion)
37
+
*[Data Architecture Guide - Real time processing](/azure/architecture/data-guide/big-data/real-time-processing)
38
+
*[Use Azure Event Hubs from Apache Kafka applications](/azure/event-hubs/event-hubs-for-kafka-ecosystem-overview)
39
+
*[Data Architecture Guide - Choosing a real-time message ingestion technology in Azure](/azure/architecture/data-guide/technology-choices/real-time-ingestion)
40
40
41
41
### Apache Kafka and Azure Event Hub conceptual mapping
42
42
@@ -50,7 +50,7 @@ The following articles provide excellent conceptual baselines:
50
50
51
51
### Reproducibility
52
52
53
-
This guide leverages the producer application provided by the [Quickstart: Data streaming with Event Hubs using the Kafka protocol](https://docs.microsoft.com/azure/event-hubs/event-hubs-quickstart-kafka-enabled-event-hubs). Furthermore, there are sample applications in many programming languages on [Azure Event Hubs for Apache Kafka GitHub](https://github.com/Azure/azure-event-hubs-for-kafka) page to help you jumpstart streaming scenarios.
53
+
This guide leverages the producer application provided by the [Quickstart: Data streaming with Event Hubs using the Kafka protocol](/azure/event-hubs/event-hubs-quickstart-kafka-enabled-event-hubs). Furthermore, there are sample applications in many programming languages on [Azure Event Hubs for Apache Kafka GitHub](https://github.com/Azure/azure-event-hubs-for-kafka) page to help you jumpstart streaming scenarios.
54
54
55
55
Here is a modified `producer.py` that streams simulated sensor JSON data into Streaming engine using a Kafka compatible client. It is important to notice that Azure Event Hubs is Kafka protocol compatible. Follow the setup instructions in the [GitHub repository](https://github.com/Azure/azure-event-hubs-for-kafka/tree/master/quickstart/python) to get the sample to work for you. The `conf` dictionary is where all connection information takes place and your mileage may vary depending on your environment. Make sure you replace at least `bootstrap.servers` and `sasl.password` as it is the most relevant configuration in the code sample bellow.
0 commit comments