Data Engineer

Details of the offer

Duties & ResponsibilitiesDesign and develop scalable data pipelines and ETL (Extract, Transform, Load) processes to collect, process, and integrate data from various sources into a centralized data warehouse or data lake.Implementing data models, schemas, and database structures to organize and optimize data storage for efficient data retrieval, writing and analysis.Collaborating with quantitative and analysts to understand their data requirements and provide them with the necessary infrastructure and tools for data exploration, analysis, and visualization.Ensuring data quality and consistency by implementing data validation, cleaning, and transformation procedures.Monitoring and maintaining the performance, availability, and security of data systems, including database servers, data warehouses, and data processing frameworks.Troubleshooting and resolving data-related issues and performance bottlenecks in collaboration with the investment teams.Evaluating and integrating new data technologies, tools, and frameworks to improve data infrastructure and processing capabilities.Documenting data pipelines, workflows, and technical specifications to facilitate knowledge sharing and maintain system.Keeping up-to-date with industry trends, best practices, and emerging technologies in the field of data engineering.General:Assist and collaborate on team wide projects.Contribute to the analytics platform to know what is required from a Data Engineering perspective.Assist and investigate ad-hoc data related queries.Desired Experience & QualificationREQUIRED EXPERIENCEUp to 3 years' experience with a specific focus in database management, data analysis and have produced ETL processes at scale are essential.Basic understanding of financial instruments and markets.Exceptional skill and experience in Python and SQL.REQUIRED QUALIFICATIONSUniversity Post Graduate Degree (Computer Science/Information Systems/Maths/Stats/Business Science/Actuarial).Strong programming skills in Python and SQL.KEY COMPETENCIESExcellent interpersonal skills, excellent communication skills oral and written.Aptitude in decision-making and problem-solving.Strong work ethic, self-motivated, driven and results oriented.Ability to listen and respond to new ideas, input and diverse perspectives.High levels of self-confidence, assertive as well as healthy levels of EQ.Energetic problem-solver.Structured work style, attention to detail and accuracy is of the utmost importance.
#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Whatjobs_Ppc

Requirements

Devops Engineer | Orion Labs

Orion Labs is a dynamic cloud and development consulting firm specializing in AWS, Terraform, and Kubernetes. We are committed to delivering exceptional clou...


Orionlabs - Western Cape

Published 16 days ago

Crm Co-Ordinator (Tbs)

The Body Shop is an International brand of luxury bath, body and beauty products operating in retail locations throughout South Africa. We currently have a v...


Clicks Group Limited - Western Cape

Published 16 days ago

Lead Software Engineer

Kick-start your career in the online gaming world and experience the very latest in technology and innovation. Who we are We're part of Super Group, the NYSE...


Betway Group - Western Cape

Published 16 days ago

Net Zero And Decarbonisation Consultant Cape Town, South Africa

AESG is an international specialist consultancy, engineering, and advisory firm, with offices across the UK, UAE, Saudi Arabia, South Africa, Egypt and Singa...


Aesg - Western Cape

Published 16 days ago

Built at: 2024-12-27T00:02:42.387Z