Implementing data pipeline using AWS services for airlines data

PySpark studies.

Airflow basics tutorial

Understand the entire Snowflake workflow from end-to end

This repo has all the hands on notes about snowflake.

😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS

End to end data engineering project with kafka, airflow, spark, postgres and docker.

My self-learning about Apache Airflow

ETL process workflow using Airflow.

Stock market API ETL automation using Apache-Airflow.

PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster

Notes talking about the design and implementation of Apache Spark

This repository is for archiving all the code files and dependencies requirements for my learning Apache Airflow.

This repository is for archiving all the code files and dependencies requirements for my learning Apache Spark with Python.

Lists of company wise questions available on leetcode premium. Every csv file in the companies directory corresponds to a list of questions on leetcode for a specific company based on the leetcode …

DataPipeline with Airflow UI

Data Pipeline Project.

This project aims to securely manage, streamline, and perform analysis on the structured and semi-structured YouTube videos data based on the video categories and the trending metrics.

Gans is a startup developing an e-scooter-sharing system. The company wants to anticipate as much as possible scooter movements.

Data Fellowship 9 Final Project - Bank Marketing Campaign Data Pipeline

Repository for building a corporate data pipeline jupyter notebook, using aicoe-ci build pipeline

Creating Data Pipelines with Apache Airflow to manage ETL from Amazon S3 into Amazon Redshift

Apartments Data Pipeline using Airflow and Spark.