Senior Data Engineer

Key Responsibilities:Design, Develop, and Optimize Data Pipelines: Lead the design, development, and management of robust cloud and on-premises data pipelines, ensuring efficiency and accuracy in support of our data strategy.Ensure Data Quality and Consistency: Implement data validation processes, enforce data guidelines, and monitor for inconsistencies to maintain high-quality data.Azure DevOps Repos and CI/CD Integration: Utilize Azure DevOps Repos for version control and Azure Pipelines for CI/CD practices, ensuring seamless integration and automation.Technical Leadership: Mentor junior and intermediate engineers, lead technical solutions, and resolve complex issues to build a strong, skilled team.Stakeholder Engagement: Foster relationships across the business to align stakeholders with data engineering objectives.Project Management: Plan, coordinate, and execute tasks to ensure successful project completion and manage timelines effectively.Required Skills:Cloud Technology: Expertise in Azure services (Data Factory, Databricks, Data Lake, SQL Databases, Azure DevOps). Experience with Apache Spark is essential; knowledge of GCP and AWS is a plus.Programming Languages: Proficiency in Python and SQL, with exposure to PySpark.Commercial Acumen: Ability to develop solutions independently and provide technical assistance with an understanding of business objectives.Education and Experience:Education: Grade 12/SAQA Accredited Equivalent (Essential); 3-year Degree in IT, Sciences, Informatics, or Computer Sciences (Essential); Masters degree (Advantageous).Experience: 5+ years in data engineering, data science, or computer science (Essential); experience in the Financial Services Industry, especially Short-Term Insurance (Advantageous).Why Join Us?:Innovative Environment: Work on exciting projects in a forward-thinking company.Leadership Role: Take charge and lead a dynamic team of talented engineers.Professional Growth: Access to extensive development opportunities and career advancement.Ready to lead and innovate? Apply now and become a key player in our data engineering success story!