Job Description
We need someone who has solid coding skills, especially in Python, aside from the other requirements in the job description
Core Expertise
Experience: At least 3 years in a data engineering role working on data integration, processing, and transformation use cases with open-source languages (i.e. Python) and cloud technologies.
Strong programming skills in Python specifically for API integration and data libraries, with an emphasis on quality and test-driven development.
Demonstrated proficiency with big data storage formats (Apache Parquet, ORC) and practical knowledge of pitfalls and optimization strategies.
Demonstrated proficiency with SQL
Experience With Data Modeling
Relational modeling
Dimensional modeling
NoSQL modeling
Working knowledge of IaC on AWS (CloudFormation or CDK)
Working Knowledge Of AWS Services
Required: Glue, IAM, Lambda, DynamoDb, Step Functions, S3, CloudFormation or CDK
Nice-to-have: Athena, Kinesis, MSK, MWAA, SQS
Experience with orchestration of data flows/pipelines: Apache Airflow or Dagster
Nice-to-have
Experience with data streaming (Kinesis, Kafka)
Experience with Apache Spark
Client-facing experience, multi-cultural team experience, technical leadership, team leadership
Key Competencies & Abilities
Ability to work independently and collaboratively in a team environment.
High level of attention to detail and commitment to delivering quality work.
Strong analytical and critical thinking skills.
Effective time management and organizational skills.
Strong customer focus and the ability to communicate technical concepts clearly to stakeholders.
Excellent written and verbal communication skills.
Additional Information
Must be willing to work on a hybrid setup, with onsite reporting to UP Ayala Technohub, Quezon City.
Engagement is project-based for 6 months, with a possibility of extension.
Work schedule is on a mid-shift and graveyard rotation.
The role observes U.S. holidays instead of Philippine holidays.
