Data Engineer

Data Engineer - L3

Location: Singapore

Experience: 5-8 Years

Salary: Up to SGD 8K

Employment Type: Contract - 1 year

Job Description

We are looking for a skilled Data Engineer to design, develop, and optimize scalable ETL/ELT solutions across Teradata and Hadoop ecosystems. The ideal candidate should possess strong hands-on expertise in enterprise data engineering, data warehousing, CDC frameworks, and big data technologies.

Key Responsibilities

Design and develop scalable ETL/ELT pipelines using Teradata SQL, Informatica PowerCenter, Apache Spark, QueryGrid, and Trino.

Build and maintain enterprise data warehouse (EDW) and data mart solutions.

Develop robust data ingestion and transformation frameworks across Teradata and Hadoop platforms.

Perform performance tuning and optimization of complex ETL and database applications to improve efficiency and reduce resource utilization.

Create automation frameworks using GCFR, Shell scripting, and BTEQ for end-to-end process orchestration and integration.

Build and enhance CDC (Change Data Capture) frameworks using Java for processing SAP Oracle OLR logs and ingesting data into Teradata.

Develop configurable ingestion frameworks and reusable components for scalable data processing.

Support installation and implementation of Master Data Management (MDM) applications, including data validation and approval workflows.

Collaborate with cross-functional teams to ensure reliable integration of enterprise data sources.

Required Skills

Strong experience in Teradata ETL development and Informatica PowerCenter.

Hands-on experience with Hadoop ecosystem technologies including Hive, Impala, Spark, Kafka, Iceberg, Ranger, Atlas, NiFi, and Flink.

Strong SQL and performance tuning expertise.

Experience in Shell scripting, Java, and automation frameworks.

Good understanding of Data Warehousing concepts, CDC, and MDM solutions.

Experience in large-scale enterprise data processing environments.

Preferred Qualifications

Experience with real-time data ingestion and orchestration tools.

Strong analytical and troubleshooting skills.

Ability to work independently in a fast-paced environment.