We are looking for an experienced Mid-Level Data Engineer to join us in driving significance together.The Data Engineer will have a knack for data analysis, data manipulation and data modelling.
The consultant will be responsible for understanding and driving the overall technical vision and planning of a client's organisation and translating business needs into technical strategy. Key Responsibilities: Identify valuable data sources and automate collection processes.
Undertake preprocessing of structured and unstructured data.
Analyze large amounts of information to discover trends and patterns.
Data Modeling (Relational and Star Schema).
Database design.
Database development.
Data Warehouse Design - Build and Development.
Database Administration.
Database Performance Tuning and Optimisation.
Present information using data visualization techniques.
Propose solutions and strategies to business challenges.
Collaborate with engineering and product development teams.
An understanding and hands-on experience on Hadoop/Spark based distributed storage and computing frameworks.
Real-Time analytics and batch processing.
Strong experience in architecture analytical applications in cloud environment such as Amazon Web Services and Microsoft Azure.
KINDLY TAKE NOTE THAT THE RECRUITMENT AND SELECTION PROCESS WILL INVOLVE PSYCHOMETRIC ASSESSMENTS .
Requirements Required Qualifications: Tertiary degree, diploma or certificate in a related field (BSc Computer Science, B.IT or Informatics related degrees).
DP-203: Data Engineering on Microsoft Azure Certification.
Experience and Knowledge: 5-8 years of experience as a Data Engineer/Database Developer.
Skilled in data mining, large-scale data modeling (Dimensional Modeling, Data Vault), and business requirements analysis.
Experienced in data integration, transformation, and master data management.
Proficient in SQL Server, Oracle, and designing ETL solutions using SSIS, Azure Data Factory, and SQL Server stored procedures.
Knowledge of Big Data technologies (Hadoop, Spark) and event processing tools like Kafka, Event Hub, and Stream Analytics.
Expertise in T-SQL, ANSI SQL, PL/SQL, with some experience in Visual Basic, C++, C#, Java, and Python.
Experience using SQL Server Management Studio, Visual Studio, Azure SQL databases, Azure Synapse, Azure Storage, and Databricks.
Analytical skills and business acumen, with additional knowledge of Tableau, Power BI, and math skills (statistics, algebra), Scala, Python, or R. Competencies: Critical thinking and problem-solving abilities.
Strong systems analysis and active learning capabilities.
Excellent communication and engagement with C-level stakeholders.
High technical literacy and ability to develop project specifications.
Schedule management, team leadership, and experience in large project execution.
Ability to translate strategic objectives into actionable projects.
