Senior Data Engineer

We are seeking an experienced and forward-thinking Senior Data Engineer to lead the development and optimization of our enterprise data infrastructure. This role will play a strategic part in shaping the future of our data architecture and enabling advanced analytics across the organization.

You will design and implement scalable data solutions, mentor engineering teams, and collaborate closely with business stakeholders, analysts, data scientists, and platform teams to deliver high-impact data initiatives.

This opportunity is ideal for someone passionate about cloud-native data platforms, modern data engineering practices, and building reliable, secure, and high-performance data ecosystems.

Responsibilities:

• Lead design and implementation of scalable, high-performance data architectures
• Develop and optimise data pipelines, ETL/ELT processes, and data workflows
• Design advanced data models to support complex business and analytics needs
• Enable big data processing, machine learning pipelines, and advanced analytics
• Manage and optimise cloud-based data platforms (primarily AWS)
• Ensure performance, scalability, cost efficiency, and security of data systems
• Lead technical direction and set data engineering standards
• Mentor and guide data engineering team members
• Collaborate with stakeholders (data scientists, analysts, developers, business teams)
• Translate business requirements into effective data solutions
• Implement and enforce data governance, quality, and compliance standards
• Ensure adherence to data security and regulatory requirements
• Stay updated with emerging data engineering tools and best practices

Qualifications and experience:

• Bachelor’s or master’s degree in computer science, IT, engineering, or related field
• 10+ years’ experience in data engineering or similar roles
• Strong experience building and managing large-scale, complex data solutions
• Expertise in Python, SQL, and Spark (PySpark/Spark SQL)
• Solid understanding of data warehousing, big data, and ETL/ELT pipelines
• Strong experience with cloud platforms, especially AWS
• Proven leadership experience mentoring or leading data engineering teams
• Strong analytical, problem-solving, and communication skills
• Experience with data governance, streaming data, or certifications is advantageous

The reference number for this position is NG61336 which is a permanent, Hybrid position based in Cape Town offering a cost to company of up to R1.4mil CTC negotiable on experience and ability. Contact Nokuthula at e-merge.co.za or call her on 011 463 3633 to discuss this and other opportunities.

Are you ready for a change of scenery? E-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the e-Merge website www.e-merge.co.za for more great positions.

Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!

Posted on 20 May 19:43, Closing date 19 Jul