Data Engineer: Data & Machine Learning Platform

Details of the offer

Our client in Cape Town is looking for a Data Engineer to join their team Responsibilities Build configurable data ingestion platforms to collect and protect data from any source within two weeks or less. The team will build and assemble a tool suite of persistent and secure ingestion tools, optimized for cost efficiency, with reliability as a non-negotiable standard. Success will be measured by the consistent achievement of the two-week ingestion target while maintaining high reliability and security. Engineer the platform for observability and performance. Make your systems observable from the outside, taking ownership of their performance. Facilitate real-time tracking of the systems internal state through logs, metrics, and traces. Define clear and measurable Service Level Indicators (SLIs) and Service Level Objectives (SLOs), and integrate these into team OKRs to drive excellence. Success will be measured by meeting or exceeding defined performance and reliability benchmarks, and the quick identification and resolution of issues. Engineer the platform with privacy and security by design. Secure the platform through compliance engineering initiatives that reduced the time and cognitive load related to compliance. Implemented our Data Governance and Privacy policies effectively, leveraging encryption, firewalls, VPCs, Role Based Access Control and IAM integrations such as Active Directory. Success will be measured by the platforms adherence to security and privacy standards, with minimal compliance overhead for users. Leverage containerization and infrastructure as code. Implement containerization strategies and infrastructure as code (IaC) practices to ensure scalable, repeatable, and efficient deployment of data services. Utilize tools like Docker and Terraform to automate infrastructure management and streamline the development pipeline. Success will be measured by the consistency and reliability of deployments, reduced deployment times, and increased system scalability. Contribute to technology decisions. Engage in technology spikes to clarify needs and articulate solution criteria. Evaluate different options through hands-on experimentation, leading to documented evaluations and recommendations that were understood by technology leaders or users across the company. Success will be measured by the quality and clarity of your contributions to technology decisions and the adoption of your recommendations. Invest in your own development. Executed on a culture of excellence and continuous improvement for both your part of the platform and your own abilities. Live our culture of ownership, curiosity, and continuous learning. Participate in pre and post-mortems, sharing lessons learned across the organization along with how you are improving based on those lessons. Success is measured by your active participation in continuous learning initiatives and the tangible improvements in platform performance and personal growth. Requirements Qualifications Matric National Diploma in an Information Technology related discipline or a Bachelors degree in Computer Science, Statistics, Informatics, Information Systems, or a quantitative field will be recommended. Experience 5 years experience as a Data Engineer in data platform or service engineering team with at least 2 in a modern context with cloud technologies. Track record of high impact and investing in your own development. Skills/Attributes You look for ways to do, instead of reasons not to . You are high agency, high ownership in everything you do. You know we own our future, only we can make it happen. If you find something that keeps us from our mission, you own it or work collaboratively with others until you find the right owner of it. Where some see impossible, you see a way. You have the strong conviction in our ability to innovate and bring financial services, and financial confidence to everyone across the continent. You turn obstacles into opportunity, chance into change. You move fast and fix things. You publish early and often, when you fail you learn and go again. You know that speed gives you the licence to fail, because youre moving fast enough to correct course. You love creating more with less. Knowing that the biggest impact is born of the smallest acts, scale is built into your thinking from day 1. You seek out and value different perspectives. Believing that when we change how we look at things, how things look for us also changes.


Nominal Salary: To be agreed

Source: Whatjobs_Ppc

Requirements

Information Technology Manager

Location: King George, VA Desired Candidate Qualities: Ten (10) plus years of experience with demonstrated ability to plan and coordinate the installation, t...


Tech Wizards - South Africa

Published a month ago

Data & Analytics Industrial Placement

Data & Analytics Industrial PlacementJob Description SummaryPrior to submitting your application, please visit our early careers website to find out more abo...


Industry Placements - South Africa

Published a month ago

Specialist Technology Transfer Project

JOB PROFILE FIXED TERM CONTRACT (12 MONTHS) JOB TITLE: Specialist: Technology Transfer Projects JOB GRADE: C5 Minimum Midpoint TOTAL CTC: R507 409 - R596 9...


Small Enterprise Development Agency_Gov - South Africa

Published a month ago

Data Engineer

Please note that at this time, we are not accepting resumes from external agencies or recruiters. Any unsolicited resumes will not be considered and will not...


Hakkoda Inc. - South Africa

Published 13 days ago

Built at: 2024-12-23T23:47:55.240Z