Responsibilities Data Pipeline Development:Design, build, and maintain scalable, efficient, and reliable data pipelines using Ab Initio, ensuring data flows seamlessly between various systems.Develop robust ETL (Extract, Transform, Load) processes to handle large volumes of data from diverse sources, enabling timely and accurate data delivery.Continuously improve and optimize pipeline architectures for future scalability and enhanced performance.Data Integration and Management:Integrate structured and unstructured data from multiple sources to create a unified and consistent data environment.Ensure the integrity, accuracy, and consistency of data across all platforms and systems, implementing validation processes and data quality checks.Maintain data management policies and procedures to ensure compliance with industry standards and organizational goals.Performance Optimization:Monitor the performance of data pipelines and ETL workflows to identify bottlenecks and areas for improvement.Implement best practices for data storage, retrieval, and archiving to ensure fast and reliable access to critical information.Utilize performance-tuning techniques to optimize data transformations and processing, ensuring minimal downtime and efficient resource utilization.Collaboration and Communication:Act as a liaison between data scientists, business analysts, and other technical stakeholders to gather requirements and provide technical solutions that align with business objectives.Collaborate with cross-functional teams, including DevOps, system engineers, and business units, to ensure seamless data integration and project alignment.Communicate complex technical concepts in a clear and understandable manner, facilitating better decision-making for stakeholders.Troubleshooting and Support:Proactively identify, troubleshoot, and resolve data-related issues, including inconsistencies, discrepancies, and performance issues, to ensure smooth operations.Provide timely support for data-related queries and requests from various teams, offering insights and technical assistance to optimize workflows.Maintain and update documentation for data processes, ensuring that all procedures and solutions are well-documented for future reference.
Qualifications Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field.
Experience Required Experience: 5+ years of experience in data engineering and ETL development.Extensive experience with Ab Initio, including developing and maintaining data pipelines.Proficiency in SQL and other database technologies.Experience with big data technologies such as Hadoop, Spark, and Hive.Knowledge of data modeling, data warehousing, and data integration best practices.Strong problem-solving and analytical skills.Excellent communication and collaboration abilities.Preferred Experience:Experience with cloud platforms such as Azure.Familiarity with scripting languages like Python or R.Knowledge of data governance and security practices Benefits We are guided by shared values in all things we do:Courage, Excellence, Collaboration, Respect and Accountability.Courage – We are bold thinkers and doers, always ready to take on new challenges.
We think of ourselves as entrepreneurs, matching creativity with vigilance.Excellence – We are united by a shared ambition: change the game, together.
Continuous performance is both an objective and a mindset.Collaboration –Teamwork and emotional intelligence are what makes us stand out in a crowd.
We stand shoulder to shoulder, with our clients and our peers, through good times and setbacks.Respect – We are a hive of different profiles, and we place a high value on openness and transparency.
We show respect, always.Accountability – We are reliable.
We celebrate our successes, we take responsibility and learn from our failures.
This is why we protect our "right to fail" as an opportunity to bounce back and progress
