The Cloud Data Testing Engineer is responsible for ensuring the quality, accuracy, and reliability of cloud-based data platforms and pipelines. The role focuses on validating data integrity, automating testing processes, and ensuring cloud data solutions are scalable, high-performing, and production-ready.
The role follows a hybrid work arrangement, requiring regular onsite work at UP Ayala Technohub in Quezon City. Candidates must be willing to report onsite, work on mid-shift and graveyard schedules, and observe U.S. holidays instead of Philippine holidays.
Key Responsibilities:
· Develop and execute test strategies for cloud data pipelines, integrations, and AWS-based solutions.
· Validate data quality, integrity, and transformation across the data lifecycle.
· Design and maintain automated testing frameworks using Python and SQL.
· Verify data models, cloud infrastructure, and pipeline orchestration to ensure reliability and performance.
· Collaborate with cross-functional teams to identify, troubleshoot, and resolve data quality issues.
· Document test results, provide quality metrics, and support continuous improvement initiatives.
Core Expertise:
- Experience: At least 5 years in a data engineering role working on validation of data integration, processing, and transformation pipelines and cloud infrastructure.
- Strong Python skills for test frameworks, API integration, and data validation, emphasizing code quality and TDD.
- Demonstrated proficiency with SQL for deep-dive data reconciliation, data profiling, and backend verification.
- Combines cloud data engineering with QA practices (planning, automation, and reporting) to validate data pipeline integrity, scalability, and performance for production readiness.
- Practical knowledge of big data storage formats (Apache Parquet, ORC), including schema validation, file size optimization testing, and identifying data corruption pitfalls.
- Demonstrated client-facing experience, multicultural team experience, technical leadership, and team leadership.
- Data Modeling Verification: Experience reviewing and verifying various data models for structural integrity and performance:
- Relational modeling
- Dimensional modeling (Nice to have)
- NoSQL modeling
- Working knowledge of IaC on AWS (CloudFormation or CDK)
- Working knowledge of AWS Services:
- Required: Glue, IAM, Lambda, DynamoDB, Step Functions, S3, CloudFormation or CDK
- Nice-to-have: Athena, Kinesis, MSK, MWAA, SQS
- Test Lifecycle Management: Skilled in end-to-end data test planning, scenario design, automated script writing, execution, and quality reporting.
- Pipeline Orchestration Testing: Experience validating the orchestration and failure boundaries of data flows and pipelines.
- Experience with data streaming (Kinesis, Kafka)
- Experience with Apache Spark
- Client-facing experience, multi-cultural team experience, technical leadership, team leadership
Key Competencies & Abilities:
- Ability to work independently and collaboratively in a team environment.
- High level of attention to detail and commitment to delivering quality work.
- Strong analytical and critical thinking skills.
- Effective time management and organizational skills.
- Strong customer focus and the ability to communicate technical concepts clearly to stakeholders.
- Excellent written and verbal communication skills.
Additional Information:
- Must be willing to work in a hybrid setup, with onsite reporting to UP Ayala Technohub, Quezon City.
- Shift: Midshift (3:00 pm to 12mn) on Work in Office (WIO) days; 4:00 pm to 1:00 am on Work from Home (WFH) days.
- 1 month of night shift at the start of the project to build rapport with the US-based client.
- The resource is required to WIO at least twice a week (Tuesday and Wednesday)
- Engagement is project-based for 6 months, with a possibility of extension.
- The role observes U.S. holidays instead of Philippine holidays.
- The candidate will undergo a practical exam (problem-solving) to validate technical knowledge.
