Data Engineer

Data Engineer
Company:

Expleo Group


Details of the offer

Expleo is a trusted partner for end-to-end, integrated engineering, quality services and management consulting for digital transformation. We are a talent incubator. The time you spend at Expleo will turbo-charge your career, allowing you to work on complex technical challenges, enjoy opportunities to expand your skills and take part in inspiring, multi-disciplinary collaborations with your colleagues. Whether working on autonomous vehicles, green planes, the factories of tomorrow or cutting-edge banking technology, you will have the opportunity to become a bolder version of yourself. Let's change the game together.We are seeking a highly skilled Data Engineer with extensive experience in Ab Initio to join our team in Johannesburg (Onsite).The ideal candidate will be responsible for designing, developing, and maintaining our data infrastructure to ensure the efficient processing and storage of large datasets. This role involves collaborating with cross-functional teams to deliver high-performance data solutions, enabling informed decision-making across the organization. You will play a key role in optimizing data pipelines, ensuring data integrity, and implementing best practices for scalability and performance in a dynamic environment.Data Pipeline DevelopmentDesign, build, and maintain scalable, efficient, and reliable data pipelines using Ab Initio, ensuring data flows seamlessly between various systems.Develop robust ETL (Extract, Transform, Load) processes to handle large volumes of data from diverse sources, enabling timely and accurate data delivery.Continuously improve and optimize pipeline architectures for future scalability and enhanced performance.Data Integration And ManagementIntegrate structured and unstructured data from multiple sources to create a unified and consistent data environment.Ensure the integrity, accuracy, and consistency of data across all platforms and systems, implementing validation processes and data quality checks.Maintain data management policies and procedures to ensure compliance with industry standards and organizational goals.Performance OptimizationMonitor the performance of data pipelines and ETL workflows to identify bottlenecks and areas for improvement.Implement best practices for data storage, retrieval, and archiving to ensure fast and reliable access to critical information.Utilize performance-tuning techniques to optimize data transformations and processing, ensuring minimal downtime and efficient resource utilization.Collaboration And CommunicationAct as a liaison between data scientists, business analysts, and other technical stakeholders to gather requirements and provide technical solutions that align with business objectives.Collaborate with cross-functional teams, including DevOps, system engineers, and business units, to ensure seamless data integration and project alignment.Communicate complex technical concepts in a clear and understandable manner, facilitating better decision-making for stakeholders.Troubleshooting And SupportProactively identify, troubleshoot, and resolve data-related issues, including inconsistencies, discrepancies, and performance issues, to ensure smooth operations.Provide timely support for data-related queries and requests from various teams, offering insights and technical assistance to optimize workflows.Maintain and update documentation for data processes, ensuring that all procedures and solutions are well-documented for future reference.Minimum QualificationsBachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field.5+ years of experience in data engineering and ETL development.Extensive experience with Ab Initio, including developing and maintaining data pipelines.Proficiency in SQL and other database technologies.Experience with big data technologies such as Hadoop, Spark, and Hive.Knowledge of data modeling, data warehousing, and data integration best practices.Strong problem-solving and analytical skills.Excellent communication and collaboration abilities.Preferred ExperienceExperience with cloud platforms such as Azure.Familiarity with scripting languages like Python or R.Knowledge of data governance and security practices.We are guided by shared values in all things we do: Courage, Excellence, Collaboration, Respect and Accountability.Courage – We are bold thinkers and doers, always ready to take on new challenges. We think of ourselves as entrepreneurs, matching creativity with vigilance.Excellence – We are united by a shared ambition: change the game, together. Continuous performance is both an objective and a mindset.Collaboration – Teamwork and emotional intelligence are what makes us stand out in a crowd. We stand shoulder to shoulder, with our clients and our peers, through good times and setbacks.Respect – We are a hive of different profiles, and we place a high value on openness and transparency. We show respect, always.Accountability – We are reliable. We celebrate our successes, we take responsibility and learn from our failures. This is why we protect our 'right to fail' as an opportunity to bounce back and progress.
#J-18808-Ljbffr


Source: Whatjobs_Ppc

Requirements

Data Engineer
Company:

Expleo Group


Verification Technician

Minimum Requirements: Must have a Grade 12, with Mathematics and/or Science as subjects required Relevant experience within FMCG Sector would be advantageou...


South Africa

Published a month ago

It Desktop Support Technician

A great opportunity for a top performing IT Desktop Support Technician to join our professional team, reporting to the IT Systems Administrator. Key Responsi...


South Africa

Published a month ago

Aom Clerksouth Africa

Job Description:As our AOM Clerk of your responsibilities will include but not limited to:Adhere to all health and safety practices requirements and promote ...


From De Beers Group - South Africa

Published a month ago

Powerbi Consultant

Companies of all sizes successfully rely on our client's management and IT consulting to solve relevant BI, planning and digitization challenges efficiently,...


From Carlysle Human Capital - South Africa

Published a month ago

Built at: 2024-09-20T00:52:52.175Z