Data Engineer

Details of the offer

Our Travelstart team is looking for a talented Data Engineer to join us. This role will focus on developing and maintaining robust data infrastructure on the Google Cloud Platform (GCP) to support data-driven decision-making. This individual will be responsible for designing, implementing, and managing data pipelines, optimizing data performance, and ensuring data integrity.
Key Responsibilities
Data Infrastructure Development: Develop and maintain scalable data infrastructure on GCP, including data lakes, data warehouses, and data pipelines.Performance Optimization: Tune and optimize the performance of analytical systems to ensure efficient data processing and analysis.Data Pipeline Development: Design, implement, and manage data pipelines to extract, transform, and load data from various sources into target systems.Database Management: Oversee analytical databases on BigQuery, ensuring data integrity, performance, and security.Data Solution Design: Design and implement scalable data solutions to meet the evolving needs of various stakeholders.Data Integration: Integrate and manage data provided by third-party vendors and partners.Data Quality: Troubleshoot and resolve data-related issues to improve data quality and accuracy.Data Requests: Respond to internal and external data requests efficiently and accurately.Data Analysis: Develop complex SQL queries for data analysis, reporting, and troubleshooting.Data Visualization: Build and maintain visualized reports using advanced data visualization tools.
Qualifications
Bachelor's degree in Computer Science, Information Technology, or a related field, or 10+ years of relevant experience in data engineering or a related field.Proficiency in at least one programming language, with a preference for Python and Java.Experience with cloud platforms, particularly Google Cloud Platform (GCP).Strong expertise in data pipeline tools such as Apache Beam, Apache Spark, etc.Proven experience with BigQuery and traditional SQL databases.Demonstrated experience in designing and managing data warehouses.Advanced SQL skills, including the ability to write and optimize complex queries.Familiarity with data visualization tools such as Tableau, Qlik, Looker Studio, etc.Excellent problem-solving skills and the ability to troubleshoot data issues effectively.Strong communication skills, with the ability to collaborate with cross-functional teams.
#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Whatjobs_Ppc

Requirements

Devops Engineer | Orion Labs

Orion Labs is a dynamic cloud and development consulting firm specializing in AWS, Terraform, and Kubernetes. We are committed to delivering exceptional clou...


Orionlabs - Western Cape

Published 16 days ago

Crm Co-Ordinator (Tbs)

The Body Shop is an International brand of luxury bath, body and beauty products operating in retail locations throughout South Africa. We currently have a v...


Clicks Group Limited - Western Cape

Published 16 days ago

Lead Software Engineer

Kick-start your career in the online gaming world and experience the very latest in technology and innovation. Who we are We're part of Super Group, the NYSE...


Betway Group - Western Cape

Published 16 days ago

Net Zero And Decarbonisation Consultant Cape Town, South Africa

AESG is an international specialist consultancy, engineering, and advisory firm, with offices across the UK, UAE, Saudi Arabia, South Africa, Egypt and Singa...


Aesg - Western Cape

Published 16 days ago

Built at: 2024-12-27T00:13:34.342Z