Over Mani Deepak
Senior Data Engineer and Data Architect with 14+ years of experience designing and implementing enterprise-grade data platforms, Common Data Models, and integration layers. Deep expertise in data architecture (3NF / Kimball), data governance, and end-to-end data integration across insurance, telecom, and retail domains. Proven track record leading on-premises DWH migrations to cloud-native lakehouse platforms (Delta Lake / Azure Synapse) and delivering single sources of truth by consolidating siloed data sources into unified integration layers. Hands-on with Azure Synapse Analytics, Azure Data Lake Storage, PySpark / SparkSQL (Spark 3.5/4.x), and Azure DevOps CI/CD. Fluent communicator who bridges business stakeholders and engineering teams; experienced in mentoring junior engineers and driving FinOps-oriented cost optimisation across the full data platform.
Engels
Tweetalig / moedertaal
Nederlands
Beperkte professionele capaciteit
Frans
Basiskennis
Kan op locatie werken
Sint-Lambrechts-Woluwe (tot 50km)
Werkervaring
- NikeData/DevOps Engineerseptember 2020 - Vandaag (5 jaren en 9 maanden)Architected and implemented scalable infrastructure on AWS following the Well-Architected Framework, developed reliable data pipelines. Built and maintained automated CI/CD pipelines for development and deployment lifecycle. Key responsibilities:• • Built reproducible analytics pipelines (Databricks/Jobs, Airflow) by following standards like Unit testing, maintaining code quality checks and thereby producing reliable code.• • Designed CI/CD: automated training, testing, packaging and release pipelines using Jenkins• • Creation of infrastructure using IaC approach using Terraform• • Containerized applications (Docker); created Helm charts and deployed apps to Kubernetes (EKS)• • Established observability: metrics, latency, throughput monitoring and alerting (Prometheus, SignalFX, Splunk).• • Maintained Kubernetes clusters, tuned CI/CD for workloads, and implemented infrastructure as code (Terraform) for reproducible environments. Technologies: Snowflake, Databricks, MLflow, AWS (EKS, EC2, S3, IAM, Secrets Manager), Terraform, Kubernetes, Helm, Seldon/KFServing, Databricks Jobs, Airflow, Jenkins, GitHub Actions, Docker, Python, Shell scripting, Prometheus, SignalFX, Splunk, ELK
- Pharma Client in Germany (Accenture)Data Engineer/Cloud Architect/DevOps Engineermei 2019 - april 2020 (11 maanden)Designed and implemented AWS infrastructure and platform tooling to support web and real-time streaming applications, improving reliability and deployment repeatability.
- Insurance client in Belgium (Accenture)Big Data Engineer/DevOps Engineernovember 2017 - mei 2019 (1 jaar en 6 maanden)Engineered real-time data ingestion and NoSQL storage for insurance systems to enable timely analytics and search over high-volume data.• • Developed CI/CD pipelines to automate build, test and deployment (Jenkins).• • Designed NoSQL data models and ingestion pipelines using Kafka and Spark (Scala) to preserve data integrity and support real-time access in HBase.• • Enabled search capabilities over ingested data with Solr and Lily to improve data discoverability and query performance.• • Led cloud POCs for Hadoop and implemented CI/CD for Hadoop applications using Jenkins and JFrog Artifactory. Technologies: Hadoop (Cloudera), HBase, Spark, Scala, Solr, Lily, AWS CloudFormation, Kafka, Kafka Connect, Git, Jenkins
Aanbevelingen
Wees de eerste die Mani Deepak aanbeveelt
Help deze freelancer om te schitteren door te vertellen hoe het is om met hem of haar te werken.
Deze freelancerprofielen matchen ook met zoekopdracht.
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Opleidingen
- AWS Certified Big Data - SpecialtyAmazon Web Services (AWS)AWS Certified Big Data - Specialty
- AWS Certified Solutions Architect AssociateAmazon Web Services (AWS)AWS Certified Solutions Architect Associate