This is a repo with links to everything you'd ever want to learn about data engineering

Code for the paper "Visual Anagrams: Generating Multi-View Optical Illusions with Diffusion Models"

A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.

This project implements an ELT (Extract - Load - Transform) data pipeline with the goodreads dataset, using dagster (orchestration), spark (calculation) and dbt (transformation)