Data Engineer

Duties and Responsibilities

• Develop, test, monitor, and optimize end-to-end data processing jobs and workflows, covering data acquisition, transformation, and data exposure/publishing.
• Design, develop, and enhance applications, solutions, or software that consume data from the data lake/data warehouse for visualization and advanced analytics (e.g., reports and dashboards).
• Build, test, and maintain big data architecture and open-source databases (e.g., Hadoop, Hive, HBase, Presto), including supporting the development and deployment of innovative big data platforms.
• Establish and enforce controls on data being collected, processed, transformed, and presented. Perform regular audits on data quality (accuracy, completeness, timeliness) and ensure compliance with PLDT Group standards.
• Collaborate and communicate regularly with business users, data owners and stewards, IT hardware and infrastructure teams, IT data source teams, database administrators, and other stakeholders to clarify requirements, provide status updates, resolve issues, and present solutions.
• Manage daily operations of scheduled jobs or programs, including enforcing policies, maintaining systems, and responding to user requests. Ensure consistent system delivery in line with operational-level agreements (OLAs). Take responsibility for prompt resolution of issues across end-to-end data platform components.
• Oversee vendor performance to ensure delivery commitments within service-level agreements (SLAs), including troubleshooting, applying patches, handling exceptions, and escalating problems when necessary.
• Support technology upgrades and migrations to keep platforms current and secure.
• Diagnose and resolve issues, synthesizing conclusions into actionable recommendations that improve overall delivery.
• Create and maintain solution design and technical architecture documentations.

Education

• Graduate of any bachelor's degree in Computer Science, Information Systems/Information Technology, or Engineering

Qualifications

• Experience in software development.
• Working knowledge of Python, Perl, C/C++, PL/SQL, NoSQL, and Java.
• Proficiency in Linux and Unix (required).
• Knowledge and experience in Big Data technologies such as HDFS, Hadoop, and Apache Spark (a plus).
• Familiarity with the end-to-end software development lifecycle.