Data Engineering Projects for FREE

Naem Azam
2 min readSep 11, 2023

You will learn everything from AWS, GCP, and Azure by doing these projects

👨🏻‍💻 Kick-start your Career in Data Engineering by Doing these projects on weekends.

Data Engineering Projects for FREE

1. YouTube Data Analysis (End-To-End Data Engineering Project) — https://lnkd.in/d5BRZfXv

What will you learn?
✅ Python and PySpark
✅ SQL
✅ How to understand the business problem
✅ AWS Services — Athena, Glue, Redshift, S3, IAM
✅ Building Data Pipeline and Scheduling it

2. Twitter Data Pipeline using Airflow — https://lnkd.in/dE2VvdSg

What will you learn?
✅ Python
✅ Basics of Airflow
✅ Working with Twitter Data and Package — Tweepy
✅ Python Package — Pandas
✅ Writing ETL job and storing data on S3

3. Stock Market Real-Time Data Analysis using Kafka, AWS, and Python — https://lnkd.in/dah8Au3B

What will you learn?
✅ Build a Real-Time app using Python
✅ Understand the basics of Kafka
✅ Install Kafka on EC2
✅ Generate a real-time pipeline and
✅ Analyze Data in Real-Time

4. Uber Data Analytics Project On GCP
Video Link — https://lnkd.in/daiFAMHT

Here’s what you will learn:
✅ How to understand raw data
✅ Building Data Model (Lucid Chart)
✅ Writing ETL Script (Python)
✅ Modern Data Pipeline Tool (mage)
✅ SQL queries for analysis

5. Olympic Data Analytics | End-To-End Azure Data Engineering Project
Video Link — https://lnkd.in/dEtjqhar

Here’s what you will learn:
✅ Extract Data from APIs
✅ Learn Azure Services DataBricks, DataFactory, and Synapse Analytics
✅ Writing Spark Code
✅ SQL queries for analysis

Tag someone who might find this helpful 👇🏻

--

--

Naem Azam

Passionate self-taught Programmer, an open-source enthusiast, and maintainer. Expertise includes Programming, Linux, IT Support, Web Dev, and AI.