Beginner Friendly

All courses are beginner friendly and vary from single courses to complete example projects.

On-Demand Access

Choose your own learning pace and access to content on-demand.

New Content

Academy content is constantly expanded and we usually release a new course every month.

Master Data Engineering through hands-on learning

Our main objective is to equip you with real-world skills, and you will be able to:

  • Work with data from data lakes by performing data integration tasks.
  • Model, write and query data in NoSQL data stores.
  • Build end-to-end streaming pipelines.
  • Design and implement ETL and ELT batch pipelines.
  • Effectively execute data transformation tasks.
  • Deploy containerized applications in the cloud.
  • And a lot more...

What you can achieve in the next 3 months:

In 1 Month: Data Engineering Fundamentals

After one month you know what Data Engineers do exactly, have the technical computer science fundamentals, brushed up on your Python coding skills and learned how to use Docker.

Plus the theoretical knowledge of how to design data platforms & pipelines and how to choose the right data store and do a schema design.

Gain all the fundamentals you need to do hands on projects.

Learn what Data Engineers do exactly, gain the technical the computer science fundamentals, brush up on your Python coding skills and learn how to use Docker.

Plus the theoretical knowledge of how to design data platforms & pipelines, how to choose the right data store and do a schema design.

In 3 Months: Build an Open Source Platform

After 3 months you built an awesome Open Source platform with tools like FastAPI, Apache Kafka, Apache Spark streaming, MongoDB and Streamlit. This will help you get into Data Engineering without a cloud platform subscription.

Depending on your speed or interests you can also add knowledge in orchestrating pipelines with Airflow, process time series data with InfluxDB, monitor pipelines with Elasticsearch and build a Elasticsearch contact tracing app.

After 3 months you built an awesome Open Source platform with tools like FastAPI, Apache Kafka, Apache Spark streaming, MongoDB and Streamlit. This will help you get into Data Engineering without a cloud platform subscription.

Depending on your speed or interests you can also add knowledge in orchestrating pipelines with Airflow, process time series data with InfluxDB and monitor pipelines with Elasticsearch.

Or in 3 Months: Do Data Engineering on AWS

Instead of going open source you gain extensive AWS experience by building your own stream and batch processing platform including deploying containerized apps like ML algorithms on AWS.

You will know how to work with all major tools like API Gateway, Kinesis, Lambda, AWS Glue, S3, DynamoDB, Redshift, Cloudwatch, RDS, Elastic Container Registry and Service.

If you take the open source and AWS tracks you will also be able to complete our Associate Data Engineer certification.

Instead of going open source you gain extensive AWS experience by building your own stream and batch processing platform including deploying containerized apps like ML algorithms on AWS.

You will know how to work with all major tools like API Gateway, Kinesis, Lambda, AWS Glue, S3, DynamoDB, Redshift, Cloudwatch, RDS, Elastic Container Registry and Service.

Plus: Modern Data Warehouses and Azure

Your schedule is fully customizable. Either with annual or unlimited access you have enough time to get familiar buiding streaming pipelines on Azure or Data Warehousing on AWS, GCP, Databricks and Hadoop if you are interested in that.

Within 3 to 4 weeks you can easily also gain the knowlege to work with AWS Athena and Quicksight, GCP BigQuery and Datastudio or build ETL pipelines and Warehouses on Databricks and Snowflake.

Within 2 weeks you will know the basics of Azure and be able to build streaming pipelines with API Management, EventHub, Function Apps, CosmosDB and PowerBI.

Within 3 to 4 weeks you can easily also gain the knowlege to work with AWS Athena and Quicksight, GCP BigQuery and Datastudio or build ETL pipelines and Warehouses on Databricks or Snowflake.

Within 2 weeks you will know the basics of Azure and be able to build streaming pipelines with API Management, EventHub, Function Apps, CosmosDB and PowerBI.

Huge Catalog!

From basics to full hands-on example projects.

All individually available in the Academy

1. The Basics

We start with the basics you need to learn Data Engineering. From what is Data Engineering, the computer science fundamentals, to how document your journey.

Video Time Available: 9.5h

  • 1.1Introduction to Data Engineering
  • 1.2Computer Science Fundamentals
  • 1.3Introduction to Python
  • 1.4Python for Data Engineers
  • 1.5Docker Fundamentals
  • 1.6Successful Job Application (NEW!!)
2. Platform & Pipeline Design Fundamentals

The second part teaches you the fundamentals of platform and pipeline design, how to incorporate security, the different types of data stores and schema design.

Video Time Available: 3.75h

  • 2.1Platform & Pipeline Design
  • 2.2Platform Security
  • 2.3Choosing Data Stores
  • 2.4Schema Design
  •  
  •  
3. Fundamental Tools

Module three contains hands-on trainings on fundamental tools. From data ingestion, message queues, processing frameworks to visualization.

Video Time Available: 11.75h

  • 3.1API Fundamentals with FastAPI
  • 3.2Apache Airflow Workflow Orchestration
  • 3.3Apache Spark Fundamentals
  • 3.4Data Engineering on Databricks
  • 3.5Apache Kafka Fundamentals
  • 3.6MongoDB Document Store Fundamentals
  • 3.7Log Analysis With Elasticsearch
  • 3.8Snowflake for Data Engineers
  • 3.9Data Transformation with dbt (coming soon)
4. Example projects

To apply what you have learned you can do a variety of hands-on example projects on AWS, Azure and your own computer.

Video Time Available: 21h

  • 4.1Document Streaming with Kafka, Spark & MongoDB
  • 4.2Data Engineering on AWS
  • 4.3Machine Learning & Containerization on AWS
  • 4.4Data Engineering on Azure
  • 2.5Modern Data Warehouses & Data Lakes
  • 4.6Storing & Visualizing Time Series Data
  • 4.7Contact tracing with Elasticsearch
  • 4.8Data Engineering on Hadoop
  •  

How we teach

Academy Structure

The Academy is split into 4 modules plus the Associate Data Engineer certifcation. You can start anywhere you like.

In module one you learn the basics every engineer needs: Computer Science Basics, Python and how to work with Docker.

Module two helps you understand how to design data platforms and pipelines. It will also teach you how to choose and model NoSQL data stores.

Module three allows you to gain hands-on knowledge in all super important tools like Spark, Kafka, Airflow, MongoDB and more.

Module four contains large example projects where you can build full end-to-end pipelines.

Academy is split into 4 modules plus the Associate Data Engineer certifcation.

In module one you learn the basics every engineer needs. Module two helps you understand how to design data platforms and pipelilnes.

Module three allows you to gain hands-on knowledge in all super important tools and module four contains large example projects

Over 40 Hours of Video Lessons

We created over 40 hours of pre-recorded videos in English for you. The videos can contain presentations, setup guides, live coding, step by step explanations of prepared code or hands-on demos you can replicate to learn.

Every topic is taught by going through the theoretical basics first.

Then you will set up the environment and gain your first hands-on experience. After that, you usually get into more advanced features or build a mini project.

We created over 40 hours of pre-recorded videos in English for you. The videos can contain presentations, setup guides, live coding, step by step explanations of prepared code or hands-on demos you can replicate to learn.

Every topic is taught by going through the theoretical basics first. Then you will set up the environment and gain hands-on experience.

Source Codes & Easy Setup

We give you prepared source codes for all hands-on lessons through our Academy GitHub. Use the example code to follow along, expand it to your liking or re-use it as template for your own ideas.

For teaching topics that require local installation of tools on your computer we use Docker images as much as possible. This way you don't have to struggle through setup procedures or deal with side effects that don't add much value. You can focus on the important stuff.

We give you prepared source codes for all hands-on lessons thorugh our Academy GitHub. Use the example code to follow along, expand it to your liking or re-use it as template for your own ideas.

We use Docker images for local installation of tools as much as possible. This way you don't have to struggle through setup procedures or deal with side effects that don't add much value.

Individual Help Channels

Giving you the support you need is super important to us. Sometimes you might have questions regarding learning topics. Sometimes you might struggle with an error during a hands-on.

No problem! Get answers by using the individual Discord channels for bigger projects or use the general questions channel. We are here for you :)

You quickly want to chat with another student? We have set up a voice channnel for it.

Even if our team is not available, there are so many students around that there's usually someone there to support you.

Giving you the support you need is super important to us. Sometimes you might have questions regarding learning topics. Sometimes you might struggle with an error during a hands-on.

No problem! Get answers by using the individual Discord channels for bigger projects or use the general questions channel. We are here for you :)

Plus Free Mentoring!

You have 24/7 access to our Discord server and the private Academy channels to get answers to all your questions by connecting with Andreas and hundreds of other students.

Live office hours every other week with Andreas will help you get direct feedback. You can listen to other students' questions and connect with them.

Check Out the Full Curriculum

Explore in detail every individual course and example project included in the Academy

Start Today!

Get full access to the Academy!
All these benefits are included:
  • Huge Step by step Data Engineering Course
  • Unlimited access to all current and future courses during your subscription
  • We typcially release one new course every month
  • 5 theory courses on the most important engineering techniques
  • 11 hands-on courses the most important tools for engineers
  • 8 hands-on example data engineering projects on major platforms like AWS, Azure, Hadoop and open source platforms
  • Associate Data Engineer Certification
  • Individual course certificates
  • Live Data Engineering office hours every other Thursday (10am USA eastern time)
  • Personal support on your journey over our private Discord server
  • 30 days money back guarantee

Group Discounts: If you're interested in signing up with your team -
ask about our group discounts here: Group Discount Application

      Your personal price:
      $685.44

      $261.80

      Money back guarantee if you don't like it.

      Data Engineering Academy in Numbers

      What our students say

      Godwin E.

      Great course by Andreas, my favorite part of the course are the example projects, it gives you the understanding of how data engineering is done in the real world, also get to have a portfolio of projects across different cloud platforms. 

      Andy N.

      Andreas's method of targeting skills that are in demand and building projects around them is the fastest way to get a job in Data Engineering. I was able to get a job in 2 months. Thanks Andreas.

      Seemanthini N

      I was always in the search for a good resource for Data Engineering hands on/knowledge and found Learn Data Engineering. This is the perfect course for someone who has coding experience and is looking to transition to a date engineering role.

      Trustpilot









      Here's what is coming soon:

      Transforming Data with dbt & Snowflake

      Transforming data in your data warehouse is super important. And dbt is THE tool for that job right now. In this course you will learn the fundamentals of dbt by using dbt Core and dbt Cloud.

      You will develop locally with dbt core and connect to Snowflake to run data transformation tasks. We'll also show you how to create dbt CI/CD pipelines using GitHub, GitHub Actions and dbt Cloud.
      This way you will be able to use dbt for all the tasks a Data Engineer needs.

      Release: March 2023

      Transforming data in your data warehouse is super important. And dbt is THE tool for that job right now. In this course you will learn the fundamentals of dbt by using dbt Core and dbt Cloud.

      You will develop locally with dbt core and connect to Snowflake to run data transformation tasks. We'll also show you how to create dbt CI/CD pipelines using GitHub, GitHub Actions and dbt Cloud.
      This way you will be able to use dbt for all the tasks a Data Engineer needs.

      Release: March 2023

      MLOps & CI/CD on AWS

      In our Machine Learning and containerization project you learned how easy it is to deploy a NLP algorithm as Lambda function and a visualization as containerized app on AWS ECS.

      In this project you learn how to take it to the next level. You'll use GitHub, GitHub Actions and AWS CDK to automatically package your ML model into a Docker container and deploy it as an API on AWS.

      Release: April 2023

      In our Machine Learning and containerization project you learned how easy it is to deploy a NLP algorithm as dockerized Lambda function

      In this project you learn how to take it to the next level. You'll use GitHub, GitHub Actions and AWS CDK to automatically package your model into a Docker container and deploy it as an API on AWS.

      Release: April 2023

      Frequently Asked Questions

      Why join Learn Data Engineering?

      Unlike online course platforms like Udemy or Coursera we focus on holistic learning and personal support. This way you are getting the full picture of Data Engineering and not just learn a few tools. You also get help when you need it. The content on Learn Data Engineering also grows every month. Andreas and our trainers are constantly adding new topics, videos and worksheets.

      Is Learn Data Engineering right for me?

      Our Academy is right for you if you are interested in the plumbing of Data Science. We have helped over 1,000 students who, for instance, work as Data Scientist, Data Analyst, Database Administrator, Software Developer as well as graduates who want to get a Data Engineer job or want to apply the skills in the future.

      What is the difference between annual (12 months) and unlimited subscription?

      With the Annual Subscription you have access to all current and future content of the Academy for one year, starting with the day of your purchase.
      The Unlimited Sububscription has the same content, but your subscription will never expire.

      How long do I have to complete the training?

      The content of the Academy is completely on-demand, which means you can advance at your own pace. You can start whenever you want, and there are no deadlines to finish. The limiting factor is only the expiry date of your subscription.

      What prior knowledge should I have for learning Data Engineering?

      The optimal preparation to join the Academy is that you can program Python and have basic knowledge in SQL. As a Data Engineer you need to be able to code and use SQL to talk to databases. Don’t worry though, if you are coming from a different field. In our basic section we have courses and links to free external resources that help you gain that knowledge.

      Can I earn certificates?

      Yes, you can earn certificates for all individual topics of the academy. We also provide a Associate Data Engineer certification to help you prove that you are job ready.

      Is there a monthly payment option?

      You can currently choose between a one time payment or three monthly payments.
      With the three month payment option you can split the membership fee into three small payments.

      How does the money back guarantee work?

      We are absolutely confident that you like what you get with the Academy. However, if you don't like what you get then please contact us at [email protected] within the 30 days after the purchase to get a full refund.

      Is there a free trial available?

      No, sorry there is no trial. We have a huge collection of over 200 videos you can watch for free on YouTube.

      Here's the link: http://bit.ly/YoutubeAndreaskayy

      Or read the data engineering cookbook. It's going to help you a lot learning more about Data Engineering.

      Do students need to create their own cloud accounts and will this incur additional costs?

      Yes, you need to create your own accounts on the cloud platforms. All major platforms currently offer either free credits or free tiers. Please check the cloud providers' websites for details, because their conditions may change.

      Our training is designed to use those free tiers and credits so you don’t pay extra.

      One exception is the AWS training. Not all services used by the training are available in the free tier. The expected charge is usually below $10/month though. We show you in the beginning of the AWS training how you can set alarm thresholds (in $) so you get notified immediately if you exceed your limits.

      Where can I get even more information?

      If you have specific questions regarding the Academy or Learn Data Engineering, please feel free to contact us via email directly.