A leading telecommunications company, with innovative solutions from designing, building, deploying, and managing high performance computing infrastructure and an innovative approach with a focus on innovation topics such as Development and Operations for are looking for an Azure Data Engineer to give deep insight into the compliance and IT Methodology processes within the group and offer internal clients an extended warranty on vested interests.
Responsibilities: Design and set up projects that bring together information from a variety of sources, to enable analysis and decision-making.Ensure data is accessible and easy to use, so that it can be used for routine and ad-hoc analysis.Analyse current business practices, processes, and procedures as well as identifying future business opportunities for leveraging Microsoft Azure Data & Analytics PaaS Services.Support the planning and implementation of data design services, providing sizing and configuration assistance, and performing needs assessments.Delivery of architectures for transformations and modernizations of enterprise data solutions using Azure cloud data technologies.Design and Build Modern Data Pipelines and Data Streams.Design and Build Data Service APIs.Develop and maintain data warehouse schematics, layouts, architectures, and relational/non-relational databases for data access and Advanced Analytics.Expose data to end-users using Power BI, Azure API Apps, or any other modern visualization platform or experience.Implement effective metrics and monitoring processes. Experience and Qualifications: Bachelors degree in a quantitative field (e.g., Statistics, Mathematics, Computer Science) or equivalent experience.Proven experience as a Data Engineer with 5+ years experience.Experience preparing data for use in Azure Machine Learning and/or Azure Databricks is a plus.Big Data components such as Kafka, Spark SQL, Data frames, HIVE DB etc.
and their implementation using Azure Data Bricks (Desirable)Experience in migration from on-premises Spark environment to Azure using Azure Data bricksPowerShell scripting The Reference Number for this position is NG56891 which is a Contract position in Johannesburg offering a salary of R450 up to R650 per hour, salary negotiable based on experience.
E-mail Nokuthula on