Senior Data Engineer / Integration Developer

Company Description

Whitehall Consulting is dedicated to shaping organizations and driving excellence through tailored solutions that address modern business challenges. Our core services include Accelerating Change, Lean Six Sigma, Program and Project Management, Change Management, Organizational Development, Leadership Development, Creativity and Innovation, and Data Analytics. By leveraging these expertise areas, we empower companies to implement effective strategies for sustainable growth and competitive advantage. Based in the Philippines, our dynamic team is committed to delivering measurable results for our partners.

Role Description

We are seeking a skilled and forward-thinking Senior Data Engineer / Integration Developer to join our growing team. In this role, you will be responsible for designing, building, and optimizing our cloud-native data ecosystem. You will spearhead the development of robust data pipelines, collaborate with business analysts to turn complex data into actionable strategies, and experiment with cutting-edge technologies like Agentic AI to automate and enhance our data delivery.

Data Integration Pipeline Development

• Design, develop, and test end-to-end data pipelines to extract, transform, and load (ETL) data from diverse source systems into target models and locations
• Partner with Business Analysts to define precise data mapping and transformation rules.
• Ensure absolute data accuracy and integrity through rigorous testing, validation, and quality checks
• Produce clear high-level and detailed technical designs, including comprehensive documentation for all pipelines.
• Experiment with and evaluate emerging solutions, including Agentic AI, to improve the efficiency, accuracy, and automation of data delivery processes.

Environment Setup & Management

• Design and implement Azure-based cloud-native solutions utilizing Azure Data Factory, Databricks, Azure Container Apps, and Azure Service Bus
• Support the configuration and maintenance of development and production environments for core data integration projects.
• Maintain CI/CD deployment pipelines in strict alignment with enterprise and architecture standards.
• Ensure scalable, secure, and event-driven data integrations aligned with banking architectures, utilizing best-practice integration templates and tools.

Pipeline Operations & Continuous Improvement

• Actively monitor and maintain data pipelines to ensure continuous alignment with evolving source systems.
• Troubleshoot and resolve pipeline issues promptly to maintain highly reliable operations.
• Participate in Agile development processes, including regular Scrum and Kanban events.
• Support project planning efforts and actively manage planning dependencies.
• Stay updated with the latest trends in data engineering to suggest and implement process improvements.

Qualifications

• Education: Bachelor's degree in Computer Science, Information Systems, Information Technology, or a related field.
• Experience: Minimum of 5 years of experience as an Integration Developer and/or Data Engineer, preferably within the banking or financial services sector.
• Cloud Expertise: Strong hands-on expertise in the Azure Data Ecosystem (Azure Data Factory, Azure Data Lake, Databricks, Azure Blob Storage, and Azure SQL Databases).
• Programming Skills: Professional experience in at least one of the following integration languages: Python, Quarkus (Java), C#, Node.js, or Golang.
• API Development: Proven experience in REST API programming within an enterprise context.
• DevOps & Automation: Hands-on experience setting up development/production environments, using Azure DevOps for version control, and building automated CI/CD pipelines.
• Frameworks & Methodologies: Strong familiarity with ITIL practices and experience working within structured Scrum/Agile frameworks.
• Soft Skills: Excellent written and verbal communication skills in English, with the ability to collaborate effectively across cross-functional IT teams.

• Experience with Azure Service Bus, specific enterprise integration patterns, and/or the Quarkus framework for microservices development.
• Multi-cloud experience with other public cloud providers such as AWS or OCI.
• Familiarity with the Oracle ecosystem.
• Active Azure certifications (e.g., AZ-900, DP-900, or higher-level associate/expert certifications).