kestra.io
Making workflow orchestration straightforward and collaborative for engineering teams.
FREE LAB: Building Advanced Pipelines with Kestra on GCP
Workflow Orchestration without limits: Learn how to orchestrate scalable, production-ready workflows with Kestra on GCP, including BigQuery pipelines, retries, triggers, and monitoring.
About kestra.io
Kestra is one of the newer orchestration tools I find really interesting right now.
The idea is simple: everything is code, defined in YAML, but with a clean UI on top so you're not staring at config files all day. You get the flexibility engineers want and the visibility everyone else needs.
What stands out is how inclusive it is for different kinds of teams. Data engineers, DevOps, software developers — everyone works in the same platform instead of maintaining separate tools and pipelines. That's harder to pull off than it sounds.
It's open source, highly extensible, and the event-based triggers make complex orchestration surprisingly straightforward to set up and maintain. We built a free lab around running Kestra on GCP. Real BigQuery pipelines, retries, triggers, and monitoring, so you can see how it holds up in a real cloud environment.
And because it works across cloud, on-prem, or hybrid, whatever you build in the lab translates directly to how you'd run it in production. That's the kind of tool worth learning properly.
More Material
Become a Partner!
Join Learn Data Engineering Labs & Partners and showcase your product to thousands of engineers learning the modern data stack. Whether you want to run a full hands-on Lab, publish a technical video, or launch a complete campaign - we help you educate engineers and grow adoption through practical, measurable learning experiences.