Role: Data Engineer
Location: Makati | Hybrid — 2x a week onsite
JOB OVERVIEW
The purpose of the Data Engineer position is to design, implement, and maintain robust data pipelines that support the client's analytics and reporting capabilities. A primary focus of this role is the architectural development of Silver and Gold data layers within our Medallion architecture. The Data Engineer is responsible for ingesting diverse datasets—specifically converting complex JSON structures into high-quality, relational Gold-standard tables—to ensure accurate, timely, and actionable insights for the business.
DUTIES AND RESPONSIBILITIES
- Data Architecture: Design and implement scalable data models, focusing on the transition from raw/bronze data to refined Silver and Gold standard datasets.
- Semantic Modelling: Design, validate, and own Semantic Modelling to ensure models are optimised for End User Reporting.
- Pipeline Development: Build and optimize ETL/ELT processes to ingest data from a variety of source systems, including ERP and CRM platforms.
- JSON Transformation: Engineer specific logic to parse, flatten, and transform nested JSON data into structured formats suitable for business reporting.
- System Migration: Support ongoing data migration projects (such as Project Harvest), assisting in the transition of logic from legacy SQL environments to modern cloud platforms like Microsoft Fabric.
- Performance Tuning: Optimize SQL queries and Power Query transformations to ensure efficient data processing and refresh rates for Power BI Semantic Models.
- Data Integrity: Validate and monitor data quality throughout the pipeline to ensure that Gold-layer outputs are accurate and reliable for decision-making.
- Collaboration: Work closely with the BI team and business stakeholders.
QUALIFICATIONS
- Education: Relevant academic qualifications in Computer Science, Data Engineering, or a related quantitative field
- Experience: 5+ years of experience in data engineering, with a demonstrable track record
- Advanced Technical Skills: Expert-level proficiency in SQL, Power Query, and Python
- Platform Expertise: Extensive experience with Microsoft Fabric, including Lakehouses, Warehouses, and Power BI environments
- JSON Specialist: Demonstrated mastery in transforming semi-structured JSON data into relational models
- Strategic Modelling: Deep understanding of dimensional modelling (Star/Snowflake) and Medallion architecture principles
- Problem Solving: Advanced ability to troubleshoot complex data discrepancies and optimize slow-running pipelines
