Data Engineer

Summary: The role of a data analyst is to develop strategies for the clients (growers and buyers) by leveraging data management principles. By conducting experiments/doing research/analysing the data harnessed by the platform (as well as external data sources), the data analyst should be able to highlight market insights, generate key reports and design functional requirements that meet clients needs.Responsibilities: Close co-operation with Management.Be able to deliver consistent value in meeting client's needs.Strong project management skills to oversee the project from start to completion.Understand all departments within the company and go through the necessary training.Effectively prioritise deliverables by being systematic and pragmatic.Client engagement.Initial Scoping and requirement gathering.Creating dashboard mock-ups.Project planning (timelines / prioritization model setting up tickets in Jira).Translate client needs.Confluence and project documentation.Requirements: Proven experience as a Data Engineer or similar role, with a strong understanding of data modelling, data warehousing, and ETL processes.Proficient in SQL and experience working with relational databases (e.g. PostgreSQL, MySQL, SQL Server) and NoSQL databases (e.g., MongoDB, Cassandra).Strong programming skills in at least one scripting language (e.g., Python) and experience with data manipulation and transformation libraries (e.g., Pandas, PySpark).Comfortable working with cloud-based infrastructure and services provided by Amazon Web Services (AWS)/ Azure.Familiarity with data pipeline orchestration tools (e.g., Apache Airflow, Luigi,Lambda) and workflow management systems.? Experience with real-time data streaming technologies (e.g., Apache Kafka, ApacheFlink).? Knowledge of containerisation technologies and orchestration tools (e.g., Docker,Kubernetes).? Familiarity with machine learning concepts and frameworks.Education: Preferably a bachelors degree in computer science, engineering, or a related field.Certifications (AWS, GCP, Azure, Microsoft) a plusReady to grow ? Apply now and become a vital part of an innovative team, shaping the future of agricultural technology. We can't wait to see what you'll bring to the table!