november 2023 - januari 2025 (1 jaar en 3 maanden)
Brussel, België
Lead Data engineer
• Context: For the manufacturing department, delivered a data pipeline allowing the optimization of the production process using the continuous and discrete data from the different source systems. This was done using technologies like Terraform, Kedro, Spark, Databricks, Container and Function Apps, Posit Workbench, AzureML, Linux(Ubuntu), Docker
• Responsibilities:
• Data engineering tasks: cleaning, transformation, modelling, coordinating junior DE’s.
• Data analysis tasks: profiling, completeness, quality, visualization.