A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core capabilities as spanning the disciplines of Data Science, Data Engineering and Software Engineering have an opening for an Azure Data Engineer to help develop best practices and drive improvements in data engineering across the business and across a wide range of industries such as mining, telcos, retail and financial services.
Responsibilities: Analyse and organise raw dataDesign data engineering solutions to meet business requirementsBuild scalable data pipelines that clean, transform and aggregate data from different sources using appropriate tools and technologiesCollaborate with data scientists to prepare data sets for analytical modellingIdentify ways to enhance data quality and reliabilityManage technical delivery of projectsMentor junior data engineersQualifications and Experience: Graduate or Postgraduate degree in Computer Science, Information Technology, Statistics, Engineering or related technical field.2-6 years of relational SQL databaseSolid understanding of Apache Spark as a distributed data processing frameworkExperience in designing, implementing and performance tuning solutions in Apache SparkExperience in complex data warehouse and data lake designExperience in building, optimizing and managing data pipelines for large and complex datasetsExperience in Azure Storage / Data Lake, Azure SQL Database, Azure Data Factory, Azure Data bricks, Azure Synapse Analytics to implement data pipelines and analytical solutionsExperience in Python would be beneficialReference Number for this position is NG59096 this is a Permanent position in Johannesburg offering a salary of R900k to 1.1mil CTC salary negotiable based on experience.
E-mail Nokuthula on