Senior Data Engineer

Role Overview

We are looking for an experienced Senior Data Engineer to build scalable, secure, and high-performing data solutions that support digital transformation and data-driven decision-making. In this role, you will design and maintain data pipelines, data models, and data warehouse solutions while working closely with business users, IT teams, and data stakeholders across complex technology environments.

Job Responsibilities

• Translate business data requirements into technical specifications.
• Collaborate with IT teams on technology stack, infrastructure, and security alignment.
• Design and build data ingestion pipelines to collect, clean, merge, and harmonize data from multiple source systems.
• Monitor databases and ETL systems, including capacity planning, maintenance, performance tuning, and issue prevention.
• Construct, test, and maintain reusable data models based on end-user requirements.
• Design and build secure mechanisms for users and systems to access data from the data warehouse.
• Research, propose, and develop new technologies and processes to improve data infrastructure.
• Work with data stewards to establish and enforce data governance policies, best practices, and procedures.
• Maintain data catalogue, metadata, and data lineage documentation.
• Implement data quality checks and validation processes to ensure data accuracy and consistency.
• Implement data security best practices, including access control, encryption, and data masking.

Job Requirements

• Bachelor's Degree in Computer Science, Software Engineering, Information Technology, or related disciplines.
• Strong understanding of system design, data structures and algorithms, data modelling, data access, and data storage.
• Hands-on experience with cloud technologies such as AWS, Azure, or Google Cloud.
• Experience with Databricks.
• Experience in designing, building, and maintaining batch and real-time data pipelines.
• Experience with orchestration frameworks such as Airflow or Azure Data Factory.
• Proficient in Python, Shell Scripting, and SQL.

Preferred Requirements

• Familiarity with CI/CD pipelines.
• Familiarity with DevOps tools such as Docker, Git, and Terraform.
• Experience implementing technical processes for data security, data quality, and data governance.
• Familiarity with government systems and policies relating to data governance, data management, data infrastructure, and data security will be an advantage.
• Experience in Climate and Weather domains will be an added advantage.