402.74 million terabytes, that's how much data the world creates everyday. In today's world of big data, storing, organizing and analyzing data is becoming more important than ever. Data Engineers build the engine that help companies make sense of it all. They are crucial to any company's data strategy.
In this program, I learnt and mastered how to
- Design data models
- Build data warehouses and data lakes
- Automate data pipelines and work with massive datasets
- Create database in Apache Cassandra
- Implement a data warehouse on AWS based on Redshift architecture
- Utilized Spark to work with massive datasets
- And used Apache airflow to schedule, automate and monitor data pipelines
