Platform & Pipeline Security

Description

Having a proper security concept around your platform and pipelines is super important. Almost anybody can build a one off proof of concept that lacks in the security part. If you want to become a good Data Engineer you need to know how to secure your work and data.

That is why I created this security training so that you are well prepared for your job as Data Engineer. Here, I will show you the basic topics that you are going to experience at work all the time.

Sections

Network Security

In this part, you will learn about important security methods and tools from the bare networking with firewalls and access control lists. I will show you how they work and how they are connected with each other. 

Proxy servers and bastion hosts will also be a topic, which are basically restricting the access to your platform and certain security zones. Learn how they work, how they are connected to your network and which communication ways they use.

Identity & Access Management

In the following, you will learn about identity and access management. Understand the difference between those two concepts and how they intertwine with each other and the different networks.

I will also explain to you the LDAP - Library Directory Access Protocol - which secures the proxy servers and bastion hosts.

Data Transmission Security

Last but not least, I will show you why you should use secured communication ways like HTTPS and how you can do it. We also will make a little detour and talk about APIs and how you can secure the communication on a platform through encrypted tokens.