Senior Data Engineer

We are seeking a Senior Data Engineer to build and scale the data infrastructure that underpins the entire APEX platform. Zenith — our data collection and aggregation layer — is the foundation everything else runs on. You will architect ETL/ELT pipelines that ingest structured and unstructured data from diverse sources across agriculture, mining, retail, and banking, transforming it into the intelligence layer that powers Quantum’s AI analytics, Prism’s visualisations, and Vector’s verification processes.

Responsibilities:

• Design, build, and maintain the Zenith data aggregation layer, the core infrastructure of the APEX platform
• Develop scalable ETL/ELT pipelines to ingest data from APIs, databases, file systems, web scraping sources, and IoT devices
• Implement data quality checks, monitoring, and alerting to ensure accuracy, reliability, and consistency
• Optimise data storage, partitioning, and query performance for analytical and operational workloads
• Collaborate with ML engineers to prepare training datasets and serve model outputs through the data layer
• Design scalable data models supporting multi-tenant, multi-industry use cases
• Contribute to data governance, lineage tracking, and access control frameworks
• Mentor junior engineers and promote best practices in data engineering and pipeline design

Qualifications and experience:

• 5+ years’ experience in Data Engineering or Data Platform development
• Strong proficiency in Python and SQL
• Experience building and operating large-scale ETL/ELT pipelines (Airflow, dbt, Spark, or similar)
• Strong understanding of data warehousing concepts and dimensional modelling
• Experience with cloud data platforms such as AWS (Redshift, Glue), Azure (Data Factory, Synapse), or GCP (BigQuery)
• Excellent written and verbal English communication skills

The Reference Number for this position is NG61249 which is a Permanent Hybrid role in Johannesburg offering a salary of up to R1mil per annum salary negotiable based on experience. E-mail Nokuthula on nokuthulag@ e-Merge.co.za or call her for a chat on 011 463 3633 to discuss this and other opportunities.

Are you ready for a change of scenery? E-Merge IT recruitment is a niche recruitment agency. We offer our candidates options so that we can successfully place the right people with the right companies, in the right roles. Check out the E-Merge IT website www.e-merge.co.za for more great positions.

Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals

Posted on 14 Apr 10:24, Closing date 13 Jun