Data Engineer

We're Hiring: Senior Data Engineer | AWS | Insurance

Location- KL

Preferred- Mandarin

We are looking for an experienced Senior Data Engineer to join our Data & Analytics team within the Insurance domain.

This role is ideal for a hands-on data engineer with strong AWS, Data Lake/Data Warehouse, ETL/ELT, PySpark, Python, SQL, Terraform, and Apache Iceberg experience, with an interest in modern AI-enabled software development.

Key Responsibilities

• Design and develop scalable, secure, and high-performing data pipelines

• Build and optimize ETL/ELT processes across Data Lake and Data Warehouse environments

• Develop batch and near real-time data processing solutions

• Design and maintain Apache Iceberg datasets

• Build and support cloud-native data platforms on AWS

• Implement Infrastructure as Code (IaC) using Terraform

• Monitor, troubleshoot, and optimize data pipelines and platform performance

• Support Disaster Recovery (DR), failover/failback, RTO/RPO, and business continuity activities

• Implement data quality, reconciliation, governance, and metadata management controls

• Support AWS DataZone initiatives and enterprise data governance

• Collaborate with Architects, Business Analysts, Data Analysts, BI Developers, Product Owners, and business stakeholders

• Prepare technical documentation, runbooks, solution designs, and data flow diagrams

• Conduct knowledge transfer sessions and mentor junior engineers

Required Skills & Experience

3+ years of experience in Data Engineering, Data Warehousing, or Data Platform Engineering

Strong hands-on experience with SQL, Python, PySpark, and Terraform

Strong AWS experience, particularly:

AWS Glue | Amazon Redshift | Amazon S3 | Amazon RDS | Amazon SNS | AWS Step Functions | Amazon CloudWatch | AWS IAM | Amazon EventBridge | AWS DataZone

Experience designing and supporting Enterprise Data Lake & Data Warehouse solutions

Hands-on experience with Apache Iceberg

Strong understanding of ETL/ELT, data modeling, and data integration

Experience with Terraform / Infrastructure as Code

Understanding of cloud security, IAM, permissions, and access control

Experience supporting Disaster Recovery and Business Continuity activities

Knowledge of Generative AI, Agentic AI, and AI-assisted software development

Experience using AI-powered coding assistants to improve engineering productivity and code quality

Strong analytical, troubleshooting, communication, and problem-solving skills

Good to Have

• AWS Certifications such as AWS Certified Data Engineer / Solutions Architect / Developer / Cloud Practitioner

• Power BI experience

• SAP BusinessObjects (SAP BO) knowledge

• AWS DataZone and enterprise data governance experience

• Data Lakehouse architecture experience

• DevOps, CI/CD, and cloud automation experience

• Experience in Insurance or Financial Services

Core Technologies:

AWS | Glue | Redshift | S3 | RDS | Step Functions | CloudWatch | IAM | EventBridge | DataZone | SQL | Python | PySpark | Terraform | Apache Iceberg | Data Lake | Data Warehouse | Power BI | Generative AI