Data Engineer (Azure)

A leading global market research organisation is seeking a highly skilled Data Engineer Azure to join their Data & Platform Engineering team in Makati.

This role offers the opportunity to work with cutting-edge Azure technologies, designing and evolving scalable data pipelines and enrichment layers that power digital shopper marketing solutions for some of the worlds largest brands. You will be part of a passionate, supportive team committed to helping clients understand, predict, and influence consumer choice in a rapidly changing retail environment. The organisation values inclusivity, collaboration, and professional growth, providing flexible working opportunities and ongoing training to ensure you thrive in your career. If you are looking for a role where your expertise will directly impact business outcomes and where your commitment to quality, security, and innovation is celebrated, this is the perfect opportunity for you.

• Join a globally recognised market leader in digital shopper marketing, where your work will help shape the future of consumer behaviour analytics for top-tier brands.
• Enjoy flexible working arrangements and continuous learning opportunities within a supportive team environment that values knowledge sharing and personal development.
• Be empowered to own the SQL data estate, design robust Azure-based pipelines, and set standards for modelling, quality, security, and cost across an advanced technology stack.

What youll do:

As a Data Engineer Azure based in Makati you will play a pivotal role in shaping the organisations data landscape. Your day-to-day responsibilities will involve designing scalable schemas for both transactional and analytical workloads on Azure platforms. You will architect complex ELT/ETL pipelines across batch and streaming environments using state-of-the-art tools such as Data Factory and Databricks. Your expertise will be crucial in establishing robust data contracts and versioning systems while implementing CDC/SCD patterns to maintain high-quality datasets. You will also be responsible for building reliable pipelines that meet stringent SLAs/SLOs with comprehensive observability features. In addition to technical execution you will define enrichment layers that integrate diverse metadata sources enhancing the value of analytics products. Collaboration with Data Science teams will be key as you operationalise feature stores and model outputs. Security compliance is you will own reference architectures ensuring encryption secret management RBAC/ABAC controls GDPR/SOC 2 adherence. Your success in this role hinges on your ability to deliver production-grade Python/SQL solutions optimise performance manage costs document features partner cross-functionally all within an inclusive supportive environment focused on professional growth.

• Design and evolve schemas for OLTP/OLAP databases including Azure SQL, Synapse, and Delta Lake with partitioning, indexing, and row-level security to ensure multi-tenant isolation.
• Establish data contracts and versioning protocols while governing schema evolution and implementing change data capture (CDC) as well as slowly changing dimension (SCD) patterns.
• Optimise database performance through query tuning, resource class management, caching strategies, and cost guardrails to deliver efficient data solutions.
• Architect ELT/ETL processes across batch and streaming environments using Azure Data Factory, Synapse, Databricks, Event Hubs, Service Bus, Functions, Container Apps, and AKS.
• Build reliable and observable data pipelines that are idempotent, retryable, lineage-aware with defined SLAs/SLOs supported by comprehensive runbooks.
• Implement CI/CD workflows for data projects including dbt/SQL projects and PySpark jobs using GitHub Actions alongside infrastructure-as-code tools such as Terraform or Bicep.
• Define and operate enrichment layers incorporating UPC/GS1 codes, OCR/EXIF metadata extraction, taxonomies, embeddings, and third-party data joins to enhance analytics capabilities.
• Curate gold-standard semantic models for analytics and product APIs while managing feature definitions and documentation for seamless integration with downstream applications.
• Partner closely with Data Science/Machine Learning teams to operationalise feature stores, model outputs, drift signals, and evaluation tables ensuring robust ML deployment.
• Own reference architecture across ADLS Gen2, Synapse/Databricks, Azure SQL/SQL Server, Cosmos DB (including vector), Azure AI Search, Key Vault, Purview ensuring security compliance by default.

What you bring:

To excel as a Data Engineer Azure you bring extensive experience in designing managing optimising enterprise-scale SQL databases alongside deep familiarity with cloud-native Azure services. Your technical acumen spans Python scripting PySpark development advanced SQL query optimisation enabling you to build robust scalable solutions tailored to complex business needs. You have demonstrated success architecting ELT/ETL pipelines integrating batch streaming workflows leveraging modern orchestration tools like Data Factory Synapse Databricks. Your background includes implementing rigorous data quality frameworks lineage tracking cost management strategies ensuring datasets remain reliable performant secure. You possess strong interpersonal skills collaborating effectively across teams particularly with Data Science professionals operationalising ML features outputs within production environments. Your understanding of multi-tenant SaaS architectures privacy regulations such as GDPR supports compliant secure operations vital for global enterprises. Experience with advanced technologies like Cosmos DB vector search embedding pipelines feature stores MLflow Purview further distinguishes your profile positioning you as a valuable contributor capable of driving innovation within an inclusive collaborative setting.

• Extremely strong proficiency in Python and SQL enabling you to diagnose complex query plans write PySpark scripts as well as pandas code with equal ease.
• At least seven years of experience in data engineering or architecture with proven production ownership of SQL databases and pipelines within enterprise environments.
• Deep hands-on experience with Azure services including ADLS Gen2 Data Factory Synapse Databricks Azure SQL/SQL Server Functions Event Hubs Service Bus Key Vault.
• Demonstrated skills in designing data models using star/snowflake schemas Data Vault/Lakehouse approaches CDC/SCD techniques semantics via dbt or equivalent tools.
• Track record of implementing scalable data quality frameworks lineage tracking cost/performance guardrails at scale ensuring reliability across large datasets.
• Strong understanding of multi-tenant SaaS architectures security best practices privacy regulations including GDPR basics supporting compliant operations.
• Experience with Cosmos DB (including vector search) Azure AI Search embedding pipelines for images/text considered highly desirable but not mandatory.
• Familiarity with feature stores MLflow registries real-time inference plumbing adds significant value to your profile enhancing ML integration capabilities.
• Knowledge of SQL Server internals PolyBase Serverless SQL Postgres familiarity beneficial for optimising hybrid database environments.
• Experience rolling out Purview governance programs operating models for data products advantageous supporting enterprise-wide compliance initiatives.

What sets this company apart:

This organisation stands out as the global leader in digital shopper marketing renowned for its decades-long expertise in behavioural research applied through a digital-first approach. Employees benefit from being part of a passionate network dedicated to helping major brands navigate retail uncertainty by defining diagnosing behaviours that drive shopper growth. The company fosters an inclusive culture where every individuals contribution is valued regardless of background identity or expressionensuring equal opportunity employment free from discrimination. Flexible working arrangements support work-life balance while ongoing training opportunities empower professional development at every stage of your career journey. Supportive leadership encourages knowledge sharing communal problem-solving nurturing both personal growth and collective achievement within a dependable team environment. By joining this organisation you become part of a mission-driven community committed not only to client success but also to advancing industry standards through ethical responsible practices.

Whats next:

If you are ready to make a meaningful impact in digital shopper marketing apply now to join this collaborative team as a Data Engineer Azure!

Apply today by clicking on the link provided.

Due to the high volume of applications we are experiencing, our team will only be in touch with you if your application is shortlisted.