An end-to-end Data Engineering Architecture in the Energy Domain

Google Drive Link

The purpose of this work is to illustrate how, after having understood the needs of the company in terms of data engineering, and end-to-end use case of data engineering can be built, covering four different areas of interest: data extraction transform, loading and aggregation pipelines, processes Orchestration and Alerting.