Projects 22 projects & 2 coming soon
Build an End-to-End Data Platform on AWS
Build a complete cloud data platform from ingestion to analytics on AWS.
Build Streaming Data Pipelines on Azure
Build a cloud-based streaming pipeline using Microsoft Azure.
Build an End-to-End Data Platform on GCP
Build a complete Data Engineering platform on Google Cloud.
Build Azure Data Pipelines with Terraform
Provision and build Azure data infrastructure using Infrastructure as Code.
Build Advanced Pipelines with Kestra on GCP
Orchestrate production-ready workflows on GCP with retries, triggers and monitoring.
Build a Cloud Data Warehouse on Snowflake
Build and configure a modern cloud data warehouse with Snowflake.
Transform Your Snowflake Data with dbt
Continue your Snowflake build and create reliable transformation workflows with dbt.
Build a Modern Lakehouse: Warehouses & Data Lakes
Build and compare modern warehouse, data lake and lakehouse architectures.
Build an Open Lakehouse with Apache Iceberg
Build an open lakehouse architecture using Apache Iceberg.
Build a Real-Time Streaming Platform with Kafka, Spark & MongoDB
Build a real-time architecture for ingesting, processing and storing streaming data.
Build Declarative Spark Pipelines with Lakeflow on Databricks
Move from notebooks to production-ready, declarative pipelines on Databricks.
Build Local-to-Cloud Data Workflows with DuckDB & MotherDuck
Build data workflows that run on your laptop, in the cloud, or across both.
Build High-Performance Analytics with Exasol
Deploy Exasol on AWS, run fast analytical queries and write Python UDFs.
Build a GenAI Platform with RAG
Build a local Retrieval-Augmented Generation platform from the ground up.
Build Semantic Log Search with Embeddings
Turn logs into embeddings and build semantic search across operational data.
Build & Deploy Containerized ML on AWS
Containerize a machine-learning application and deploy it on AWS.
Build Data Quality Monitoring with Databricks & Zapier
Build a dashboard, email the right owner and let Claude answer data quality questions.
Build a Slack Agent with a Local LLM (coming soon)
Build a fully local AI agent that answers questions in Slack.
Connect Your Slack Agent to MCP & RAG (coming soon)
Extend your agent with an MCP server and a RAG knowledge base.
Build a Dockerized ETL Pipeline with AWS, TDengine & Grafana
Build a containerized ETL pipeline for time-series ingestion, storage and visualization.
Build a Time Series Pipeline with InfluxDB & Grafana
Store, process and visualize time-series data in an end-to-end pipeline.
Build a Log Analytics Dashboard
Build a Python, Elasticsearch and Kibana pipeline for log analysis and visualization.
Build a Contact Tracing App with Elasticsearch
Build a searchable contact-tracing application using Elasticsearch.
Data Engineering with Hadoop
A Hadoop project with HDFS, YARN, MapReduce, Hive and Sqoop.
Tools & Skills 13 courses
Computer Science Fundamentals
A complete guide of topics and resources you should know as a Data Engineer.
Introduction to Python
Learn all the fundamentals of Python to start coding quickly.
Python for Data Engineers
Expand your Python skills to tackle complex Data Engineering projects.
Data Preparation & Cleaning for Machine Learning
All you need for preparing data to enable Machine Learning.
Docker Fundamentals
Learn the fundamental Docker concepts with hands-on examples.
SQL for Data Engineering
Learn fundamentals and advanced techniques for real-world data challenges.
The Hidden Foundation of GenAI
Learn embeddings, the core of search, RAG and LLMs.
API Fundamentals with FastAPI
Design, create and deploy APIs with FastAPI and Docker.
Apache Airflow Workflow Orchestration
Orchestrate your data pipelines with Apache Airflow.
Apache Spark Fundamentals
Spark quick start in Python with notebooks, DataFrames, SparkSQL and RDDs.
Data Engineering on Databricks
Everything from setup to ETL pipelines and warehousing on Databricks.
Apache Kafka Fundamentals
Learn the fundamentals of Apache Kafka.
MongoDB Document Store Fundamentals
Learn how to store and query documents with MongoDB.
Design 6 courses
Platform & Pipeline Design I & II
Design data platforms and pipelines with templates and real examples.
Platform Security
The important security fundamentals for Data Engineering.
Choosing Data Stores
Learn the different types of data stores and when to use which.
Data Modeling 1
Create data models for SQL, NoSQL databases and Data Warehouses.
Data Modeling 2: Relational Data Modeling
Model your data for relational databases.
Data Modeling 3: Dimensional Data Modeling
Model your data for analytical data stores with dimensional modeling.
Career 4 courses
Introduction to Data Engineering
Over 1 hour of videos to get started, including my own journey.
Becoming a Better Data Engineer
Master the core principles of Data Engineering and build smarter pipelines.
Successful Job Application Guide
Everything you need to successfully apply for Data Engineering jobs.
Associate Data Engineer Certification
Certify that you are job ready with the Associate Data Engineer exam.
Roadmaps 6 roadmaps
Data Engineering for Beginners
An 11-week Data Engineering roadmap for beginners and graduates.
Data Engineering for Data Analysts
A 10-week Data Engineering roadmap for Data Analysts.
Data Engineering for Data Scientists
A 14-week Data Engineering roadmap for Data Scientists.
Data Engineering for Software Developers
A 12-week Data Engineering roadmap for Software Developers.
Apache Spark & Kafka Bootcamp
Build an end-to-end streaming pipeline with Apache Spark, Kafka and more.
AI Engineering Track
Everything you need to become an AI Engineer.