A collection of open source Apache 2.0 Kafka Connector maintained by Lenses.io.

Avro SerDe for Apache Spark structured APIs.

Scala JSON Schema

Additional accompaniment to Functional and Reactive Domain Modeling

Visualize column-level data lineage in Spark SQL

Scala ADT support for Apache Flink

Extensible streaming ingestion pipeline on top of Apache Spark

Spark on Kubernetes using Helm

A comprehensive guide to implementing real-time change data capture from MySQL using Debezium, Confluent Schema Registry, Spark Structured Streaming, and Apache Iceberg