Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

ql resources berhad
Early Applicant
  • Posted 9 days ago
  • Be among the first 10 applicants

Job Description

Snapshot of the Role

In this role as the Senior Data Engineer, you will design, build and operate QL Group's enterprise data platform on Microsoft Fabric, delivering reliable, high-quality data that powers analytics, AI, and self-service BI across the organisation. You will work on Lakehouse architecture, data ingestion, ETL/ELT pipelines, data quality, performance optimisation and reusable analytics-ready data assets.

What You'll Be Driven To Do

  • Build and enhance QL Group's enterprise Lakehouse platform using Medallion Architecture principles.
  • Develop and optimise data ingestion from ERP, manufacturing, supply chain, finance and other enterprise systems.
  • Design, schedule and monitor ETL/ELT pipelines to ensure timely, accurate and reliable data delivery.
  • Apply data governance, access control and data quality standards to keep enterprise data secure and trusted.
  • Partner with business and IT stakeholders to translate requirements into effective analytics solutions, improving data accessibility, self-service adoption, and overall user satisfaction.
  • Deliver high-quality technical work on assigned projects, share expertise, and mentor junior team members to help raise data literacy across teams.
  • Support performance, cost optimisation and continuous improvement across the data platform

What You'll Need to Succeed

  • Bachelor's degree in Computer Science, IT, Data Science, Data Engineering or a related field. A Master's degree or relevant professional certification (e.g. Microsoft Fabric, Azure Data Engineer, Power BI Data Analyst, Databricks, or AWS/GCP data certifications) is an added advantage.
  • Minimum 4–6 years of hands-on experience in data engineering, BI, data warehousing or analytics.
  • Proven track record in delivering enterprise data pipelines, ingestion and integration frameworks, and analytics platforms within a complex, multi-system environment (ERP, financial, manufacturing, supply chain, and commercial systems).
  • Strong experience with Microsoft Fabric, OneLake, Azure Synapse, Azure Data Factory, SQL, Python and PySpark. Knowledge of Lakehouse design, Medallion Architecture, Parquet/Delta formats and dimensional data modelling.
  • Experience with data ingestion from enterprise systems, APIs, flat files and databases using CDC or incremental loading.
  • Strong communication, problem-solving and stakeholder management skills, with a practical, service-oriented mindset.
  • Willing to be based at Shah Alam, Selangor.

At QL, sustainability and innovation go hand in hand. Join us in building data-driven solutions that support a sustainable agrofood ecosystem and accelerate our digital transformation journey.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Parquet

OneLake

dimensional data modelling

Medallion Architecture

Delta formats

Lakehouse design

Microsoft Fabric

About Company

Similar Jobs

4-6 yrs
Petaling Jaya, Malaysia, Selangor
Skills:
data segmentation , Data structures, Apache Spark, Data Modeling, Data mining, Sql, Metadata Management, Data Transformation, Databricks, DataFlow, Python, dependency management, Database design and development, MLflow, Prefect, ETL processes, Experiment tracking, workload management, A/B testing platforms, Feature stores
5-7 yrs
Malaysia, Selangor
Skills:
Apache Airflow, Data Analytics, Hadoop, Apache Spark, Kafka, Data Visualization, Python, Sql, Etl, ELT, dashboard development
5-7 yrs
Malaysia, Selangor, Petaling Jaya
Skills:
snowflake , Sql, Apache Airflow, Python, Data Transformation, Data Warehousing, Data Governance, dbt, data quality frameworks, data ingestion
5-7 yrs
Petaling Jaya, Malaysia, Selangor
Skills:
snowflake , BigQuery, T-sql, Power Bi, Ms Sql Server, PostgreSQL, PowerShell, Avro, Sap Ecc6, SSIS, Ssas, Databricks, Excel, Apache Arrows, Apache Iceberg, Parquet, DuckLake, DuckDB, Synapse, Apache Hudi, ADLS2
2-4 yrs
Malaysia, Selangor
Skills:
Google Cloud Platform (GCP), notification , Terraform, Python, Logging, alerting, Infrastructure as Code, CI/CD pipelines, Data Ops Workflows, Monitoring