Data Engineer
Location: | Cape Town |
Remote work: | Some remote work allowed |
Type: | Permanent |
Reference: | #NG59778 |
Company: | E-Merge IT Recruitment |
Join a talented team as a data engineer. This role will focus on developing and maintaining robust data infrastructure on the Google Cloud Platform (GCP) to support data-driven decision-making. As a data engineer, you will be responsible for designing, implementing, and managing data pipelines, optimising data performance, and ensuring data integrity.
Responsibilities:
- Develop and maintain scalable data infrastructure on GCP, including data lakes, data warehouses, and data pipelines.
- Tune and optimise the performance of analytical systems to ensure efficient data processing and analysis.
- Design, implement, and manage data pipelines to extract, transform, and load data from various sources into target systems.
- Oversee analytical databases on BigQuery and ensure data integrity, performance, and security.
- Design and implement scalable data solutions to meet the evolving needs of various stakeholders.
- Integrate and manage data provided by third-party vendors and partners.
- Respond to internal and external data requests efficiently and accurately.
- Develop complex SQL queries for data analysis, reporting, and troubleshooting.
- Build and maintain visualised reports using advanced data visualisation.
- Bachelor's degree in computer science, information technology, or a related field,
- 10+ years of relevant experience in data engineering or a related field.
- Proficiency in at least one programming language, with a preference for Python and Java.
- Experience with cloud platforms, particularly Google Cloud Platform (GCP).
- Strong expertise in data pipeline tools such as Apache Beam, Apache Spark, etc.
- Proven experience with BigQuery and traditional SQL databases.
- Demonstrated experience in designing and managing data warehouses.
- Advanced SQL skills, including the ability to write and optimise complex queries.
- Familiarity with data visualisation tools such as Tableau, Qlik, Looker Studio, etc.
Are you ready for a change of scenery? E-Merge IT Recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the E-Merge website www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!
Posted on 01 Oct 14:19, Closing date 30 Nov
Desktop Support Engineer Team Lead
Requirements Grade 12 or NQF level 4Bachelor’s degree in information technology, computer science, or a related field, or equivalent work experienceFive-plus...
Intermediate Infrastructure Support Engineer
New work in with a leading provider of cloud contact centres and CRM solutions hub in Southern Africa known for implementing some of the most advanced technology...
Infrastructure Support Engineer
New work in with a leading provider of cloud contact centre and CRM solutions Hub in Southern Africa known for implementing some of the most advanced technology...
Data Engineer
If you are looking for an opportunity to work with data in a different and connected way, you might be the Data Engineer our client is looking for! If you are an...
Infrastructure Support Engineer
New work with a leading provider of Cloud contact centre and CRM solutions in Southern Africa known for implementing some of the most advanced technology within the...
Full-Stack Software Engineer
Requirements Five-plus years of experience in software engineering or development fieldsBachelor’s degree in computer science, engineering, or a related...
IT Support Engineer
The Window is based in Cape Town, we specialise in IT-managed services and are looking to expand our IT support team, we are a close-knit team with great values with a...
Senior Data Engineer
Requirements Five-plus years of experience as a data engineer or relevant experienceProven experience in designing and implementing data pipelinesExperience with...
Senior Python JavaScript AWS Software Engineer
Are you a Senior Python JavaScript Software Engineer looking for a new opportunity in an environment that empowers salesforce to reach every customer, through an...
Senior Back-end Engineer
Requirements Over five years of experience in back-end web development.In-depth expertise in PostgreSQL and RDBMS in general.Experience working with message brokers and...
Senior DevOps Engineer
New work in at an on-demand delivery and digital tech shop in SA, owned by one of our major retail groups. The current need is for a DevOps engineer with key...
Java System Integration Engineer
Become a member of a team enthusiastic about the challenges posed by integrating complex systems comprising diverse components and subsystems currently in search for...
Senior DevOps Engineer
New work in at an on-demand delivery and Digi tech shop in SA, owed by one of our major retail groups.
Data Engineer - SQL DBA
A Fintech department, delivering financial information to the company that is timely, accurate, reliable, and relevant data originating from a multitude of external...
Software Developer /Data Engineer
A dynamic client who leverages the power of AI to analyse and interpret data with unprecedented accuracy, speed and gives actionable improvement suggestions are looking...
Data Engineer
A fintech department, delivering financial information to the company that is timely, accurate, reliable, and relevant data originating from a multitude of external...
Junior Service Desk IT Technician
Requirements Grade 12 senior certificateCurrent A+ and N+ or equivalent certificationTwo or more years of industry-relevant experience in email/phone/onsite...
Mid-Level NodeJS JavaScript Developer
Looking for a mid-weight full-stack developer that will be helping with building a platform that will work globally to be used for deliveries to the world’s...
Mid-Level NodeJS JavaScript Developer
Looking for a mid-weight full-stack developer that will be helping with building a platform that will work globally to be used for deliveries to the world’s...
Full-Stack PHP JavaScript Developer
Looking for a mid-weight full-stack developer that will be helping with building a platform that will work globally to be used for deliveries to the world’s...
JavaScript Node.js Cloud Developer
In search for a Full Stack JavaScript Node.js Developer that will focus on both front-end and back-end development, currently offering this remote work opportunity, you...
Senior Data Engineer
Requirements Five-plus years of experience as a data engineer or relevant experienceProven experience in designing and implementing data pipelinesExperience with...
Senior Back-end Engineer
Requirements Over five years of experience in back-end web development.In-depth expertise in PostgreSQL and RDBMS in general.Experience working with message brokers and...
Full Stack Java Developer
Are you looking to expand your skills in the Global Market? We are looking for a Full Stack Java developer, to become a part of an international renowed asset management...
Java System Integration Engineer
Become a member of a team enthusiastic about the challenges posed by integrating complex systems comprising diverse components and subsystems currently in search for...
Java Angular Fullstack Developer
Opportunity to flex your Dev muscle on high-performance tools and platforms! You will be based in a progressive performance driven environment that offers collaboration...