Lead Hadoop Engineer

Details of the offer

Empowering Africa's tomorrow, together…one story at a time.
With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to reset our future and shape our destiny as a proudly African group.
Job Summary
This role provides an exciting opportunity to roll out a new strategic initiative within the firm - Enterprise Infrastructure Big Data Service. The Big Data Developer serves as a development and support expert with responsibility for the design, development, automation, testing, support, and administration of the Enterprise Infrastructure Big Data Service. The role requires experience with both Hadoop and Kafka. This will involve building and supporting a real-time streaming platform utilized by the Absa data engineering community. You will be responsible for developing features, ongoing support and administration, and documentation for the service. The platform provides a messaging queue and a blueprint for integrating with existing upstream and downstream technology solutions.
Job Description
Candidate Description
You will have the opportunity of working directly across the firm with developers, operations staff, data scientists, architects, and business constituents to develop and enhance the big data service.

Development and deployment of data applications
Design & Implementation of infrastructure tooling and work on horizontal frameworks and libraries
Creation of data ingestion pipelines between legacy data warehouses and the big data stack
Automation of application back-end workflows
Building and maintaining backend services created by multiple services framework
Maintain and enhance applications backed by Big Data computation applications
Be eager to learn new approaches and technologies
Strong problem-solving skills
Strong programming skills
Background in computer science, engineering, physics, mathematics or equivalent
Worked on Big Data platforms (Vanilla Hadoop, Cloudera or Hortonworks)
Preferred: Experience with Scala or other functional languages (Haskell, Clojure, Kotlin, Clean)
Preferred: Experience with some of the following: Apache Hadoop, Spark, Hive, Pig, Oozie, ZooKeeper, MongoDB, CouchbaseDB, Impala, Kudu, Linux, Bash, version control tools, continuous integration tools

Education
Bachelor's Degree: Information Technology
Absa Bank Limited is an equal opportunity, affirmative action employer. In compliance with the Employment Equity Act 55 of 1998, preference will be given to suitable candidates from designated groups whose appointments will contribute towards achievement of equitable demographic representation of our workforce profile and add to the diversity of the Bank.
Absa Bank Limited reserves the right not to make an appointment to the post as advertised.

#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Whatjobs_Ppc

Requirements

Feature Analyst

Business Segment: Business & Commercial Banking To deliver value in the form of business outcomes by collaborating within the feature team and key stakeholde...


Standard Bank Of South Africa Limited - Gauteng

Published a month ago

Senior Application Solutions Specialist (Netsuite) - Remote (South Africa)

Are you looking to join a company where your contributions truly matter, and where you'll be part of a supportive, innovative team? MMS is an award-winning, ...


Mms Holdings Inc - Gauteng

Published a month ago

Date 08. August 2024 Administration Manager To Be Able To Use The Watchlist, Please Accept Cook[...]

Reference number 2024-1243 Date 08. August 2024 Administration ManagerDivision: Administration / Law Company Location: Johannesburg, South Africa Join as: Pr...


Krones Group - Gauteng

Published a month ago

Specialist: Hyperconverged Infrastructure

Specialist: Hyperconverged InfrastructureThe ideal candidate will be responsible for supporting, configuring, and maintaining all VxRail and other Hyperconve...


C40 Cities - Gauteng

Published a month ago

Built at: 2024-11-15T06:39:05.779Z