Data Engineer

An independent, results-driven management consulting firm specialising in supporting leading banks and insurance organisations across the globe—including the UK, Europe, Scandinavia, Asia, South Africa, and the wider sub-Saharan region—is seeking a Cloud Data Engineer. Join a team of outstanding professionals whose diverse experience and expertise enhance the firm’s capability to deliver exceptional, world-class solutions.

Responsibilities:

• Design and implement scalable data pipelines using Azure (Data Factory, Synapse Analytics, Data Lake, Databricks) and AWS (Glue, Redshift, S3, Lambda, EMR, Athena).
• Develop and maintain ETL/ELT processes to transform and integrate data from diverse on-premises and cloud sources.
• Collaborate with data scientists, analysts, and business stakeholders to translate requirements into high-quality data solutions.
• Optimize and tune pipeline performance, queries, and workflows for efficiency and scalability.
• Ensure data quality, integrity, and reliability through robust testing, monitoring, and validation.
• Implement and maintain data security, governance, and compliance best practices across environments.

Qualifications and Experience:

• Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience).
• 5+ years of hands-on data engineering experience; financial services industry experience is an advantage.
• Proven experience in data engineering with Azure and AWS ecosystems.
• Strong proficiency in SQL, Python, and Spark (PySpark/Scala).
• Hands-on experience with Azure Data Factory, Synapse Analytics, Databricks, Data Lake and/or AWS Glue, Redshift, EMR, Athena, S3.
• Knowledge of DevOps and CI/CD practices for data pipelines (e.g., Git, Azure DevOps, AWS CodePipeline).
• Cloud certifications (e.g., Microsoft Certified: Azure Data Engineer Associate, AWS Certified Data Analytics) are a plus.

The Reference Number for this position is NG60512 which is a Permanent Hybrid position based in Johannesburg offering a contract rate of up to R800 per hour negotiable on experience and ability. Contact Nokuthula at nokuthulag@e-merge.co.za or call her on 011 463 3633 to discuss this and other opportunities.

Are you ready for a change of scenery? E-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the e-Merge website www.e-merge.co.za for more great positions.

Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!

Posted on 04 Dec 09:54, Closing date 2 Feb