Data Engineer

Details of the offer

Our Travelstart team is looking for a talented Data Engineer to join us. This role will focus on developing and maintaining robust data infrastructure on the Google Cloud Platform (GCP) to support data-driven decision-making. This individual will be responsible for designing, implementing, and managing data pipelines, optimizing data performance, and ensuring data integrity.


Key Responsibilities Data Infrastructure Development: Develop and maintain scalable data infrastructure on GCP, including data lakes, data warehouses, and data pipelines.Performance Optimization: Tune and optimize the performance of analytical systems to ensure efficient data processing and analysis.Data Pipeline Development: Design, implement, and manage data pipelines to extract, transform, and load data from various sources into target systems.Database Management: Oversee analytical databases on BigQuery, ensuring data integrity, performance, and security.Data Solution Design: Design and implement scalable data solutions to meet the evolving needs of various stakeholders.Data Integration: Integrate and manage data provided by third-party vendors and partners.Data Quality: Troubleshoot and resolve data-related issues to improve data quality and accuracy.Data Requests: Respond to internal and external data requests efficiently and accurately.Data Analysis: Develop complex SQL queries for data analysis, reporting, and troubleshooting.Data Visualization: Build and maintain visualized reports using advanced data visualization tools. Qualifications Bachelor's degree in Computer Science, Information Technology, or a related field, or 10+ years of relevant experience in data engineering or a related field.Proficiency in at least one programming language, with a preference for Python and Java.Experience with cloud platforms, particularly Google Cloud Platform (GCP).Strong expertise in data pipeline tools such as Apache Beam, Apache Spark, etc.Proven experience with BigQuery and traditional SQL databases.Demonstrated experience in designing and managing data warehouses.Advanced SQL skills, including the ability to write and optimize complex queries.Familiarity with data visualization tools such as Tableau, Qlik, Looker Studio, etc.Excellent problem-solving skills and the ability to troubleshoot data issues effectively.Strong communication skills, with the ability to collaborate with cross-functional teams.
#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Jobleads

Requirements

Azure Cloud Engineer

Azure Cloud Engineer Position Overview: We are seeking a skilled and motivated Azure Cloud Engineer with around 5 years of experience working with Microsoft ...


From Optimal Growth Technologies - Western Cape

Published a month ago

Wordpress Developers

Job Title: WordPress Developer Location: Remote Job Type: Part-time/Contract About our client: Our client is dedicated to crafting digital experiences that i...


From The Legends Agency - Western Cape

Published a month ago

Bot Engineer

Purpose Statement We are seeking a skilled Chatbot Developer to join our innovative team. In this role, you will be responsible for designing and developing ...


From Weplace - Western Cape

Published a month ago

Cyber Security Engineer (6 Month )

Cyber Security Engineer - 6 Month Contract Minimum Requirements: 7+ years experience in Infrastructure, Software Development, DevOps or Security 4+ years of ...


From Boardroom Appointments - Western Cape

Published a month ago

Built at: 2024-11-07T18:59:21.419Z