Job title : Data Engineer - Manager Job Location : Gauteng, Johannesburg Deadline : January 04, 2025 Quick Recommended Links Jobs by Location Job by industries Key Responsibilities: Lead the design, development, and maintenance of data pipelines to support seamless data flow within the organisation.
Implement and manage testing and deployment processes to ensure data reliability and integrity.
Oversee DevOps practices, including continuous integration/continuous deployment (CI/CD) pipelines, version control, and automated testing.
Supervise the quality assurance of code and data processes, ensuring alignment with industry best practices.
Mentor and guide team members on data engineering techniques and DevOps practices.
Collaborate with stakeholders to gather requirements and ensure alignment on project objectives.
Manage Agile project delivery, including sprint planning, backlog management, and project updates.
Monitor and optimise data pipelines for performance and scalability.
Stay informed of emerging technologies and best practices in data engineering and DevOps.
Qualifications: Bachelor's degree in Computer Science, Information Systems, or a related field.
Strong experience in data pipeline development and DevOps, particularly within AWS and Microsoft platforms.
Proficiency in SQL, ETL processes, and data warehousing.
Python advantageous.
Knowledge of CI/CD pipelines, infrastructure as code (IaC), and version control systems.
Proven experience in leading data engineering projects and managing a team.
Experience with Agile project delivery methodologies.
Excellent communication, teamwork, and leadership skills.
Ability to manage multiple tasks and projects concurrently.
Familiarity with data governance and data security best practices Research / Data Analysis jobs