Data Engineer

Details of the offer

Our Travelstart team is looking for a talented Data Engineer to join us. This role will focus on developing and maintaining robust data infrastructure on the Google Cloud Platform (GCP) to support data-driven decision-making. This individual will be responsible for designing, implementing, and managing data pipelines, optimizing data performance, and ensuring data integrity.
Key Responsibilities
Data Infrastructure Development: Develop and maintain scalable data infrastructure on GCP, including data lakes, data warehouses, and data pipelines.Performance Optimization: Tune and optimize the performance of analytical systems to ensure efficient data processing and analysis.Data Pipeline Development: Design, implement, and manage data pipelines to extract, transform, and load data from various sources into target systems.Database Management: Oversee analytical databases on BigQuery, ensuring data integrity, performance, and security.Data Solution Design: Design and implement scalable data solutions to meet the evolving needs of various stakeholders.Data Integration: Integrate and manage data provided by third-party vendors and partners.Data Quality: Troubleshoot and resolve data-related issues to improve data quality and accuracy.Data Requests: Respond to internal and external data requests efficiently and accurately.Data Analysis: Develop complex SQL queries for data analysis, reporting, and troubleshooting.Data Visualization: Build and maintain visualized reports using advanced data visualization tools.
Qualifications
Bachelor's degree in Computer Science, Information Technology, or a related field, or 10+ years of relevant experience in data engineering or a related field.Proficiency in at least one programming language, with a preference for Python and Java.Experience with cloud platforms, particularly Google Cloud Platform (GCP).Strong expertise in data pipeline tools such as Apache Beam, Apache Spark, etc.Proven experience with BigQuery and traditional SQL databases.Demonstrated experience in designing and managing data warehouses.Advanced SQL skills, including the ability to write and optimize complex queries.Familiarity with data visualization tools such as Tableau, Qlik, Looker Studio, etc.Excellent problem-solving skills and the ability to troubleshoot data issues effectively.Strong communication skills, with the ability to collaborate with cross-functional teams.
#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Whatjobs_Ppc

Requirements

Developer - Internship Role (Cpt)

Parvana Role: Our highly successful national client is looking for a bright and ambitious developer for their team. You are not expected to know anything, yo...


Parvana - Western Cape

Published 8 days ago

It Field Technician

This role is for a field technician to use his home as a based to service our clients in the greater Cape Town area. The description of duties are as foll...


Stepco Recruitment - Western Cape

Published 8 days ago

Devops / Build And Release Manager

THIS IS A REMOTE POSITION Salary is open WHAT WE DO FOR OUR CLIENTS We develop sophisticated software products and solutions for some of the world's biggest...


Beingit® - Western Cape

Published 8 days ago

Take On / Data Migration

POS24094 Take on Accounting Migration Consultant (POS24094)Somerset WestR 15 000 to R 23 000 per monthJob Purpose:Looking for junior Accounting/ graduates to...


Emporium Human Capital - Western Cape

Published 8 days ago

Built at: 2024-11-23T14:21:38.406Z