Introduction

Apache Spark is an open source parallel processing framework for large-scale data processing and analytics. Spark has become popular in "big data" processing scenarios, and is available in multiple platform implementations; including Azure HDInsight, Azure Synapse Analytics, and Microsoft Fabric.

This lab helps with basic understanding of Spark concepts including loading data to dataframe, querying data and applying simple transformations.

Contents

• Task 1: Fabric Workspace and Lakehouse creation
• Task 2: Upload File To Lakehouse
• Task 3: Create Spark Pool
• Task 4: Create Notebook And Run Code
• Task 5: Work With Tables And SQL
• Task 6: Visualize Data In A Spark Notebook