Senior Data Engineer

Senior Data Engineer | Remote | Dubai Hours | 6-Month Contract

Location: Remote — candidate must work Dubai business hours (GMT+4)

Engagement: Contract, initial 6 months with potential for longer extension

Working hours: 9:00 AM – 6:00 PM (GMT+4)

We're looking for a Senior Data Engineer to design, build, and scale an Azure Databricks lakehouse that consolidates operational and commercial data across multiple regions.

This is a hands-on role with genuine architectural ownership. You'll help define the platform's engineering standards, orchestration framework, data models, and operating practices—not simply work from an existing blueprint.

What You'll Be Doing

• Build scalable ingestion and transformation pipelines using Databricks, Python, SQL, and Spark, with a strong focus on performance, reliability, and cost.
• Design and maintain a medallion lakehouse architecture across bronze, silver, and gold layers, including standards for data quality and promotion.
• Integrate data from Microsoft SQL Server, Oracle-based ERP systems, APIs, SaaS platforms, flat files, and legacy sources, including CDC and replication patterns.
• Consolidate multi-region data into a consistent group-level model, addressing differences in master data, currencies, time zones, schemas, and local business practices.
• Evaluate and implement the most appropriate orchestration framework, such as Databricks Workflows, Azure Data Factory, Airflow, or similar.
• Establish monitoring, alerting, and data quality controls, while taking ownership of troubleshooting and incident response for pipeline failures.
• Partner with business and technical stakeholders to translate requirements into scalable data models and clearly communicate architectural decisions and trade-offs.

What We're Looking For

• At least 5 years of professional data engineering experience, including 2+ years of hands-on Databricks experience in a production environment.
• Strong proficiency in Python, advanced SQL, and Spark performance optimisation.
• Proven experience designing and operating medallion or comparable layered lakehouse architectures.
• Experience working in a manufacturing / logistics / agriculture industries is a plus
• Strong Microsoft SQL Server expertise, including T-SQL, stored procedures, replication, and CDC.
• Experience extracting and modelling data from Oracle databases and Oracle-based ERP systems.
• Hands-on experience with Azure services, particularly Azure Data Lake Storage, Azure Data Factory, Key Vault, and related data platform technologies.
• Experience integrating heterogeneous data sources, including relational databases, APIs, SaaS applications, and flat files.
• Strong dimensional modelling skills and the ability to work effectively with complex, inconsistent, real-world source systems.
• Experience delivering data solutions across multiple countries or regions and collaborating with distributed stakeholders.
• Working knowledge of Git, CI/CD, infrastructure as code, and modern data engineering practices.
• Strong communication and stakeholder-management skills, with the confidence to recommend and defend architectural decisions.
• Professional written and spoken English.