As an Azure Data Engineer, you are responsible for designing, maintaining, and optimizing data infrastructure for data collection, management, transformation, and access. You will create data pipelines that convert raw data into usable formats for data consumers. The role involves collaborating with Business and IT stakeholders at all levels to ensure that our data management initiatives add value to the business.
Key deliverables and outputs Develop and maintain scalable data pipelines and build out new integrations to support continuing increases in data volume and complexity.Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.Write unit/integration tests, contribute to the data engineering wiki, and document work.Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.Work closely with a team of frontend and backend engineers, product managers, and analysts.Define company data assets (data models) and data pipelines to populate those models.Design data integration solutions and data quality approaches for solutions.Design and evaluate open source and vendor tools for data lineage.Work closely with all business units and engineering teams to develop strategy for long-term data platform architecture.Maintain technical and operational metadata during data solution development.Have experience in advanced query performance and query optimization.Develop complex SQL to implement complex business logic.Translate functional requirements to high-level design and build technical specifications documents.Work with internal and external stakeholders to assist with data-related technical issues and support data infrastructure needs.Work experience Essential: 4 – 10 years practical experience as a Data Engineer/ETL Developer.Experience in the following technologies:3 years' experience in Data Factory.2 years' experience in Azure Synapse.3 years' experience in Azure SQL.2 years' experience in PowerBI.1 year's experience in Databricks.5 years' experience in SQL.Experience in developing and building data pipelines.Experience in troubleshooting and debugging of data pipelines.Advantageous: Experience in Agile and DevOps squads.Experience in Informatica.Experience in Teradata.Experience in SAP Data Services.Qualifications Diploma in IT related field or equivalent qualification; orBTech in IT related field or equivalent qualification.Advantageous: Certification in Data Integration technologies.CDMP.Postgraduate degree in IT or related field.
#J-18808-Ljbffr
