As an engineer you very often have to quickly set up a simple ETL script that just does the job. In this project I show you how you can easily do this on AWS. You'll use the live data from a weather API and write it into the timeseries database TDengine.
What will I learn?
Learn the basics of timeseries databases, how they work and when you would use them.
Use an online weather API
Setup and explore a public weather API. Create a Python script that reads data from the API.
Create a Dockerized ETL script on AWS
Package your script into a Docker container and use Amazon Elastic Container Registry, Lambda and EventBridge to deploy it as a serverless ETL script.
Setup Timeseries Database TDengine
Learn about TDengine, setup an instance through TDengine cloud and configure your database.
Visualize data with Grafana
Visualize the data you extracted from the API and stored in TDengine with Grafana. You'll learn how to setup and configure Grafana with TDengine.