Beginner Friendly

All courses are beginner friendly and vary from single courses to complete example projects.

On-Demand Access

Choose your own learning pace and access to content on-demand.

New Content

Academy content is constantly being expanded and I release updates every week.

From basics to full hands-on example projects 

The on-demand online courses are everything you need to learn the Plumbing of Data Science. They include the most important fundamentals, tools and example projects.The Data Engineering Academy is perfect for becoming a Data Engineer or add Data Engineering to your skillset. You only need basic knowledge in Python.

1. The Basics

We start with the basics you need to learn Data Engineering. From what is Data Engineering, the computer science fundamentals, to how document your journey.

Video Time Available: 6h

  • 1.1Introduction to Data Engineering
  • 1.2Computer Science fundamentals
  • 1.3Introduction to Python
  • 1.4Python for Data Engineers
2. Platform & Pipeline Design Fundamentals

The second part teaches you the fundamentals of platform and pipeline design, how to incorporate security, the different types of data stores and schema design.

Video Time Available: 3.75h

  • 2.1Platform & Pipeline Design
  • 2.2Platform security
  • 2.3Choosing data stores
  • 2.4Schema design
3. Fundamental Tools

Module three contains fundamental tools who you are going to see all the time. From data ingestion, message queues, processing frameworks to visualization.

Video Time Available: 8h

  • 3.1Docker Fundamentals
  • 3.2API Fundamentals with FastAPI
  • 3.3Apache Spark Fundamentals
  • 3.4Apache Kafka Fundamentals
  • 3.5MongoDB Document Store Fundamentals
  • 3.6Modern Data Warehouses & Data Lakes
  • 3.7Log Analysis With Elasticsearch
4. Example projects

To apply what you have learned you can do a variety of hands-on example projects on AWS, Azure and your own computer.

Video Time Available: 20h

  • 4.1Data Engineering on AWS
  • 4.2Machine Learning & Containerization on AWS
  • 4.3Data Engineering on Azure
  • 4.4Document Streaming with Kafka, Spark & MongoDB
  • 4.5Storing & Visualizing Time Series Data
  • 4.6Data Engineering on Hadoop
  • 4.7Contact tracing with Elasticsearch (NEW!!)

Join the Data Engineering Academy

The step by step course to learn Data Engineering with prepared example projects and sub courses on specific topics. It links together all courses in the academy. Constantly new content!

or

Highlights and our prepared Step by Step Example Projects

NEW!!! (May 17th) Contact tracing with Elasticsearch

In this example project you will learn how easy it is to track 100.000 people making 1M scans with their phone.

You will create a custom dataset using Python, pandas and a open San Francisco dataset. You will write the created dataset into Elasticsearch.

For visualization you create a Streamlit app with control elements, maps and tables. These allow you to free text search for businesses, find businesses by zip code, list users who visited a business as well as to track individual people.

In this example project you will learn how easy it is to track 100,000 people making 1M scans with their phone.

YYou will create a custom dataset using Python, pandas and a open San Francisco dataset. You will write the created dataset into Elasticsearch.

For visualization you create a Streamlit app with control elements, maps and tables to track individual people.

NEW!!! (May 5th) Associate Data Engineer Certification

We just released the new "Associate Data Engineer Certification" for our Data Engineering Academy. This certificate is a great way to show companies that you are ready to start a job as a Data Engineer.

The certification will test you in many topics you have learned in our academy's courses and example projects. From coding, to platform design and AWS cloud knowledge.

Earning this certificate will give you a huge leg up on other job applicants. Click the button below to see what you will learn to earn this certificate.

Show what you have learned and that you are job ready with our Associate Data Enigneer Certification.

The certification will test you in many topics you have learned in our academy's courses and example projects.

Earning this certificate will give you a huge leg up on other job applicants.

Machine Learning & Containers on AWS

In this project you learn how to create a data pipeline where you pull data from the Twitter API, analyze, store and visualize the it.

You will host your Machine Learning algorithm on AWS using Lambda and setup your own postgres database with RDS.
You create a Streamlit dashboard and gain experience hosting it using Elastic Container Registry (ECR) and Elastic Container Service (ECS).

This project also gives you insights on how to handle dependency management with Poetry.

In this project you learn how to create a data pipeline where you pull data from the Twitter API, analyze, store and visualize the it.

You will host your Machine Learning algorithm on AWS using Lambda and setup your own postgres database with RDS.

You create a Streamlit dashboard and gain experience hosting it using Elastic Container Registry (ECR) and Elastic Container Service (ECS).

AWS Example Project

AWS is the most used cloud platform out there.
In this course, with 4 hours of video material, Andreas shows you how to do Data Engineering on AWS.

From the basics of setting up your account to building streaming and batch pipelines. You will learn working with the major tools like API Gateway, Kinesis, Lambda, AWS Glue, S3, DynamoDB, Redshift as well as connecting Power BI.

The dataset we use is an e-commerce dataset.

AWS is the most used cloud platform out there. In this course, with 4 hours of video material, Andreas shows you how to do Data Engineering on AWS.

From the basics of setting up your account to building streaming and batch pipelines. You will learn working with the major tools like API Gateway, Kinesis, Lambda, AWS Glue, S3, DynamoDB, Redshift as well as connecting Power BI

The dataset we use is an e-commerce dataset

Azure Example Project

In this capstone project Kristijan Bakaric (Follow on LinkedIn) shows you how to start working with Microsoft Azure and how to build a complete end to end streaming pipeline.

The project uses major Azure components like API Management, Event Hub, Azure Functions, CosmosDB as well as PowerBI

This project uses Twitter data in combination with images of hurricane damages

In this capstone project Kristijan Bakaric (Follow on LinkedIn) shows you how to start working with Microsoft Azure and how to build a complete end to end streaming pipeline.

The project uses major Azure components like API Management, Event Hub, Azure Functions, CosmosDB as well as PowerBI

This project uses Twitter data in combination with images of hurricane damages

Document Streaming Example Project

If you are on the cloud or on premise. These awesome Open Source tools like FastAPI, Apache Kafka, Apache Spark streaming, MongoDB and Streamlit will help you get into Data Engineering without a cloud platform subscription

In this capstone project we build an end to end streaming pipeline. All in a dockerized environment so you can learn locally, but also deploy this on the cloud.

If you are on the cloud or on premise. These awesome Open Source tools like FastAPI, Apache Kafka, Apache Spark streaming, MongoDB and Streamlit will help you get into Data Engineering without a cloud platform subscription

In this capstone project we build an end to end streaming pipeline. All in a dockerized environment so you can learn locally, but also deploy this on the cloud.

Time Series Example Project

In this project you learn how to process time series data from CSV files containing air quality data. You are also going to use an external weather API to extract and bring in live weather data.

You will learn how to write data into influxDB 2.0 and read data from InfluxDB using Python and Flux query language. For visualization you are going to learn how to use Grafana dashboards.

In this project you learn how to process time series data from CSV files containing air quality data. You are also going to use an external weather API to extract and bring in live weather data.

You will learn how to write data into influxDB 2.0 and read data from InfluxDB using Python and Flux query language. For visualization you are going to learn how to use Grafana dashboards.

Choose your plan for Data Engineering Academy

Get full access to the Academy and all courses on-demand.
All these benefits are included:
  • Huge Step by step Data Engineering Course
  • Unlimited access incl. future courses during subscription
  • Access to all 21 courses and example projects in the Academy
  • Includes our Associate Data Engineer Certification
  • Two great Data Engineering on AWS example projects
  • Microsoft Azure example project
  • Document Streaming example project with Docker, FastAPI, Apache Kafka, Apache Spark, MongoDB and Streamlit
  • Time Series example project with InfluxDB and Grafana
  • Lifetime access to the private Slack Workspace
  • Course certificates

Group Discounts: If you're interested in signing up with your team -
ask about our group discounts here: Group Discount Application

      Your personal price:
      $685.44

      $261.80

      Money back guarantee if you don't like it.

      What my students say

      Godwin E.

      Great course by Andreas, my favorite part of the course are the example projects, it gives you the understanding of how data engineering is done in the real world, also get to have a portfolio of projects across different cloud platforms. 

      Andy N.

      Andreas's method of targeting skills that are in demand and building projects around them is the fastest way to get a job in Data Engineering. I was able to get a job in 2 months. Thanks Andreas.

      Ritesh C.

      I appreciate the way Andreas has been able to identify and bring forward real concepts that help understand the overall subject better. He covers a lot of contemporary tools and tech in small capsule courses that are easy to understand and build upon. Glad to have opted in.

      Here's what is coming soon

      MLOps on AWS using GitHub

      In our Machine Learning and containerization project you learned how easy it is to deploy a NLP algorithm as Lambda function and a visualization as containerized app on AWS ECS.

      In this project you learn how to take it to the next level. You learn how to Use GitHub, GitHub Actions and AWS CDK to package your algorithm into a Docker container and deploy it as an API on AWS.

      This way you can see the sentiment of Tweets on your dashboard and an update to the algorihm is only a git commit away.

      In our Machine Learning and containerization project you learned how easy it is to deploy a NLP algorithm as Lambda function and a visualization as containerized app on AWS ECS.

      In this project you learn how to take it to the next level. You learn how to Use GitHub, GitHub Actions and AWS CDK to package your algorithm into a Docker container and deploy it as an API on AWS.

      This way you can see the sentiment of Tweets on your dashboard and an update to the algorihm is only a git commit away.

      Frequently Asked Questions

      Why join Learn Data Engineering?

      Unlike typical online course, the content on Learn Data Engineering grows every week. Andreas and other trainers are constantly adding new topics, videos and worksheets.

      Is Learn Data Engineering right for me?

      Our academy is right for you if you are interested in the plumbing of Data Science. We have helped many members and coaching students who work as Data Scientist, Data Analyst, Database Administrator, Software Developer as well as graduates who are searching for Data Engineering jobs or want to apply the skills in the future.

      How long do I have to complete the course?

      The courses in our academy are all completely on-demand, which means you can advance the courses and their modules at your own pace. You can start whenever you want, and there are no deadlines to finish. If you have questions just use our Slack group to get help.

      What prior knowledge should I have for the course?

      The optimal foundation for Data Engineering is having prior computer science knowledge. As a Data Engineer you need to be able to code and use SQL to talk to databases. Don’t worry though, if you are coming from a different field. In our basic section we have courses and links to free external resources that help you gain that knowledge.

      Can I earn course certificates?

      Yes, you can earn course certificates for all the courses in the academy. We also provide a Associate Data Engineer certification to help you prove that you are job ready.

      Is there a monthly payment option?

      You can currently choose between a one time payment or three monthly payments.
      With the three month payment option you can split the membership fee into three small payment.

      How does the money back guarantee work?

      We are absolutely confident that you like what you get with the academy. However, if you don't like what you get and you contact Andreas within the 30 days after the purchase to get a full refund.

      Can I upgrade to the Coaching as an Academy member?

      Yes, this is no problem!

      Just send an email to [email protected] Then you will receive a coupon from us, which reduces the price of the coaching by the price of the annual access to the Academy, which you have already paid.

      Is there a free trial available?

      No, sorry there is no trial. We have a huge collection of over 200 videos you can watch for free on YouTube.

      Here's the link: http://bit.ly/YoutubeAndreaskayy

      Or read the data engineering cookbook. It's going to help you a lot learning more about Data Engineering.

      Where can I get even more information?

      If you have specific questions regarding Learn Data Engineering, the academy or the coaching, please feel free to contact Andreas directly.