Data Engineer

JOB RESPONSIBILITIES:

• Design, implement, monitor, and maintain performant and scalable ETL pipelines to efficiently and effectively extract data from various sources – such as databases, flat files, and online sources – both structured and unstructured, to consolidate and transform them into specified targets such as a data warehouse.
• Ensure data quality requirements in the data platforms are met through creation and implementation of automated detection of anomalies and remediation, as applicable, related to validity, accuracy, completeness, timeliness, uniqueness, and consistency.
• Collaborate with cross-functional teams to ensure data engineering solutions are aligned with business requirements and objectives – such as business and process owners, solution architects, and BI developers.
• Participate and contribute to all data-engineering related project activities – such as solution design, testing (unit testing, SIT, UAT, hypercare) – as well as housekeeping/BAU activities – such as troubleshooting / issue resolutions, enhancements, extensions, and optimization.
• Contribute to the company's knowledge repository by creating and continuously updating requisite technical documentation – such as solution architectures, data mapping documents, root cause analyses and how-to guides – to support all data engineering activities.
• Conduct knowledge-sharing sessions with other members of the technology office, as applicable

QUALIFICATIONS:

• Usage, administration, and configuration of AWS data engineering-related services, including:
• AWS S3, AWS Redshift, AWS Glue, AWS EC2, AWS RDS, AWS DMS, and AWS Lambda.
• Usage, administration, and configuration of other data engineering-related platforms, including: Snowflake, Apache Airflow, Talend Data Management, and Git/GitHub/GitLab.
• Candidates are expected to have a solid conceptual understanding of data modeling, including dimensional modeling and data vault modeling.
• Candidates are expected to communicate effectively, in either English or Filipino, to ensure solutions delivered are both high quality and timely.
• Candidates are expected to be self-sufficient and proactive, and must be able to both ideate and implement end-to-end data engineering solutions with minimal supervision.
• Experience in other DE/BI stacks, such as: Microsoft (DataBricks, SSMS, SSIS, SSAS, ADF, etc), Oracle (ODI), SAP (DS, BW), Informatica is not required, but will be considered a plus.
• Experience in programming languages, such as Python and Spark, is not required, but will be considered a plus.

Data Collection and Privacy Statement

In accordance with the Data Privacy Act of 2012, submission of your application constitutes your consent to the collection, use, processing, storage and endorsement of your personal information to clients, prospective employers or partner organizations solely for recruitment, evaluation, placement and other legitimate employment-related purposes.

All personal data obtained shall be treated with strict confidentiality and safeguarded through appropriate organizational, physical and technical security measures. Access to such information shall be limited to authorized personnel directly involved in the recruitment and client endorsement process and shall not be disclosed to unauthorized parties, except as may be required by law.

By submitting your application, you further represent that all information provided is true and accurate and authorize the retention of your application records for current and future employment opportunities, unless otherwise requested in writing.