Intermediate Data Engineer

Details of the offer

About the job Intermediate Data EngineerMatric (Grade 12)Masters in Software Engineering, Data Engineering, Computer Science or related field2-3 years of relevant work experienceStrong Scala or Java backgroundKnowledge of AWS, GCP, Azure, or other cloud platformUnderstanding of data modeling principlesAbility to work with complex data modelsExperience with relational and NoSQL databases (e.g. Postgres, ElasticSearch/OpenSearch, graph databases such as Neptune or neo4j)Experience with technologies that power analytics (Spark, Hadoop, Kafka, Docker, Kubernetes) or other distributed computing systemsKnowledge of API development and machine learning deploymentResponsibilities:Build and scale data infrastructure that powers real-time data processing of billions of records in a streaming architectureBuild scalable data ingestion and machine learning inference pipelinesBuild general-purpose APIs to deliver data science outputs to multiple business unitsScale up production systems to handle increased demand from new products, features, and usersProvide visibility into the health of our data platform (comprehensive view of data flow, resources usage, data lineage, etc) and optimize cloud costsAutomate and handle the life-cycle of the systems and platforms that process our data
#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Whatjobs_Ppc

Requirements

Software Engineer Iii

Are you ready for the next step in your engineering career? Would you enjoy working on our cutting-edge products? About our Team LexisNexis Legal & Professio...


Lexisnexis Risk Solutions - KwaZulu-Natal

Published 13 days ago

Senior .Net Developer (Remote)

Responsibilities:Play a significant role in developing a complex web-based application, where you will account for scalability, reliability, security, and pe...


Recruitech - KwaZulu-Natal

Published 13 days ago

Internal- Assistant Technician- Pietermaritzburg

Job Summary:We are seeking a diligent and motivated Assistant Technician to join our team. The successful candidate will assist senior technicians in maintai...


Britelinkmct - KwaZulu-Natal

Published 12 days ago

Senior Data Engineer

Let's Write Africa's Story Together!Old Mutual is a firm believer in the African opportunity and our diverse talent reflects this.Job DescriptionQualificatio...


Old Mutual - KwaZulu-Natal

Published 12 days ago

Built at: 2024-12-23T15:05:06.579Z