Skip to content

This project showcases a scalable ETL pipeline that automates the extraction, transformation, and storage of Redfin housing market data using AWS, Apache Airflow, and Snowflake, with Power BI for data visualization. The pipeline is configured to run monthly, ensuring your data remains up-to-date.

Notifications You must be signed in to change notification settings

areesha-s/Redfin-Data-Pipeline-with-AWS-Apache-Airflow-Snowflake-and-PowerBI

Repository files navigation

Redfin-Data-Pipeline-with-AWS-Apache-Airflow-Snowflake-and-PowerBI

In this Project, we'll take you through the process of setting up a data pipeline using AWS EC2, Apache Airflow, Snowflake Data Warehouse, and Power BI. Our primary objective is to extract Redfin housing market data, process it, and store it in Snowflake for analytics and reporting.


Step by Step Process


Data provided by Redfin, a national real estate brokerage.

About

This project showcases a scalable ETL pipeline that automates the extraction, transformation, and storage of Redfin housing market data using AWS, Apache Airflow, and Snowflake, with Power BI for data visualization. The pipeline is configured to run monthly, ensuring your data remains up-to-date.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published