Roadmap to becoming a data engineer in 2021

Airflow Executor for both AWS ECS & AWS Fargate

Apache Airflow integration for dbt

Cloudformation templates for deploying Airflow in ECS

Run Airflow in AWS ECS(Elastic Container Service) using Fargate tasks

dbt adapter for Athena

dbt macros to stage external sources

dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks

Terraform module to create AWS Redshift resources 🇺🇦

🎸 🎶 A music downloader that understands your metadata needs.

Podcast website

Metrics for airflow

This is a repo to house rejection letter templates for Amazon recruiters maintained by members of NYC-DSA Tech Action, Tech Workers Coalition NYC, and Coworker.org.

Police oversight and accountability through public data 👮

A helper tool for dbt development and data warehouse management.

Provider for AWS Redshift entities, eg Users, Groups, Permissions, Schemas, Databases

Curated list of resources about Apache Airflow

python library to simplify working with jsonlines and ndjson data

A GPU-powered real-time analytics storage and query engine.

A leiningen plugin that lets you share tools.deps.alpha dependencies in your leiningen project

Maxwell's daemon, a mysql-to-json kafka producer

☄️ Python's nested data operator (and CLI), for all your declarative restructuring needs. Got data? Glom it! ☄️

Schema.org - schemas and supporting software

Python Stream Processing

A non-validating SQL parser module for Python

A pre-commit hook to check your Python dependencies against safety-db

Makes your SQL readable.

Console util for formatting SQL using lib https://github.com/zeroturnaround/sql-formatter

AI Atelier notebooks, lessons, and tutorials

Manage a Postgres cluster's roles, role memberships, schema ownership, and privileges