Databricks
The Security Reference Architecture (SRA) implements typical security features as Terraform Templates that are deployed by most high-security organizations, and enforces controls for the largest ri…
Set of Terraform automation templates and quickstart demos to jumpstart the design of a Lakehouse on Databricks. This project has incorporated best practices across the industries we work with to d…
Welcome to the Continuous Cloud Optimization Power BI Dashboard GitHub Project. In this repository you will find all the guidance and files needed to deploy the Dashboard in your environment to tak…
DataOps for the Modern Data Warehouse on Microsoft Azure. https://aka.ms/mdw-dataops.
Databricks SQL Connector for Python
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Custom Contoso database generator V2
Data for custom Contoso database generator V2
Apache Spark Connector for Azure Cosmos DB
Databricks Implementation of the TPC-DI Specification using Traditional Notebooks and/or Delta Live Tables
An example showing how to apply software engineering best practices to Databricks notebooks.
Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
Stream protobuf messages into Databricks DLT and handle evolution of the schema with the help of the Confluent schema registry
Dbdemos notebook source as packaged in dbdemos toolkit
Example demonstrating a strategy for schema evolution of the state store schema.
Use Spark to demux a stream of protobuf into multiple destination tables
An end-to-end example to demonstrate how to use Databricks DLT pipelines.
This repo contains a spark standalone cluster on docker for anyone who wants to play with PySpark by submitting their applications.
Python Client for Copilot (formerly named Bing Chat), also known as Sydney.
Sample Databricks project with usage of dbconnect, supporting unit tests, code formatting, linting, static type checking, and wheel file package creation