Data Engineer

Details of the offer

Duties & ResponsibilitiesDesign and develop scalable data pipelines and ETL (Extract, Transform, Load) processes to collect, process, and integrate data from various sources into a centralized data warehouse or data lake.Implementing data models, schemas, and database structures to organize and optimize data storage for efficient data retrieval, writing and analysis.Collaborating with quantitative and analysts to understand their data requirements and provide them with the necessary infrastructure and tools for data exploration, analysis, and visualization.Ensuring data quality and consistency by implementing data validation, cleaning, and transformation procedures.Monitoring and maintaining the performance, availability, and security of data systems, including database servers, data warehouses, and data processing frameworks.Troubleshooting and resolving data-related issues and performance bottlenecks in collaboration with the investment teams.Evaluating and integrating new data technologies, tools, and frameworks to improve data infrastructure and processing capabilities.Documenting data pipelines, workflows, and technical specifications to facilitate knowledge sharing and maintain system.Keeping up-to-date with industry trends, best practices, and emerging technologies in the field of data engineering.General:Assist and collaborate on team wide projects.Contribute to the analytics platform to know what is required from a Data Engineering perspective.Assist and investigate ad-hoc data related queries.Desired Experience & QualificationREQUIRED EXPERIENCEUp to 3 years' experience with a specific focus in database management, data analysis and have produced ETL processes at scale are essential.Basic understanding of financial instruments and markets.Exceptional skill and experience in Python and SQL.REQUIRED QUALIFICATIONSUniversity Post Graduate Degree (Computer Science/Information Systems/Maths/Stats/Business Science/Actuarial).Strong programming skills in Python and SQL.KEY COMPETENCIESExcellent interpersonal skills, excellent communication skills oral and written.Aptitude in decision-making and problem-solving.Strong work ethic, self-motivated, driven and results oriented.Ability to listen and respond to new ideas, input and diverse perspectives.High levels of self-confidence, assertive as well as healthy levels of EQ.Energetic problem-solver.Structured work style, attention to detail and accuracy is of the utmost importance.
#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Whatjobs_Ppc

Requirements

Reactjs Developer

Our client is eagerly searching for a passionate and dynamic ReactJS Developer to join their team in an exciting hybrid role based in Cape Town This is a fan...


Msp Staffing Ltd - Western Cape

Published 8 days ago

Portfolio Specialist

Location: Western Cape Job Type: Full-Time Salary: Competitive Benefits Are you a skilled and detail-oriented professional with a passion for managing insura...


Network Recruitment - Western Cape

Published 8 days ago

Artisan (M03)

Artisan Ons kliënt, geleë in Durbanville, is 'n toonaangewende speler in die handel van edelmetale, insluitend goud. Hulle is toegewy aan die verskaffing van...


Werksmag Consilium Pty Ltd - Western Cape

Published 8 days ago

Rf Field Technician

We are seeking a skilled RF Field Technician for network maintenance and building, ensuring optimal communication system performance. Key Responsibilities: P...


Network Recruitment - Western Cape

Published 8 days ago

Built at: 2024-11-23T22:01:51.557Z