Senior Data Engineer
- Posted 2 months ago
- Be among the first 40 applicants
Job Description
We are looking for an experienced Data Engineer with strong expertise in designing, building, and maintaining scalable data platforms. The ideal candidate should have hands-on experience in data modeling and developing end-to-end ETL pipelines using AWS services. You will work extensively with AWS Glue and AWS DMS for data integration and migration, and manage data stored in Snowflake, Oracle, and AWS RDS.
The role requires strong programming skills in Python and PySpark to process large-scale datasets efficiently. Candidates should be proficient in SQL for data analysis, transformations, and performance tuning. Experience with DBT for data transformations and maintaining analytics-ready datasets is highly desirable.
You should have exposure to CI/CD pipelines, GitLab, and version control best practices to support automated deployments and collaborative development. The role involves working closely with cross-functional teams to ensure data quality, optimize performance, and deliver reliable data solutions aligned with business requirements. Strong problem-solving skills and experience in cloud-based data engineering environments are essential.
Requirements
Data Modelling, Glue, DMS, Snowflake, Oracle, Python, PySpark, CI/CD, DBT, Gitlab, AWS RDS, ETL Pipeline, SQL
The role requires strong programming skills in Python and PySpark to process large-scale datasets efficiently. Candidates should be proficient in SQL for data analysis, transformations, and performance tuning. Experience with DBT for data transformations and maintaining analytics-ready datasets is highly desirable.
You should have exposure to CI/CD pipelines, GitLab, and version control best practices to support automated deployments and collaborative development. The role involves working closely with cross-functional teams to ensure data quality, optimize performance, and deliver reliable data solutions aligned with business requirements. Strong problem-solving skills and experience in cloud-based data engineering environments are essential.
Requirements
Data Modelling, Glue, DMS, Snowflake, Oracle, Python, PySpark, CI/CD, DBT, Gitlab, AWS RDS, ETL Pipeline, SQL
More Info
About Company
Skills:
Git, Data Modelling, Power Bi, Databricks, Data Warehouse Architecture, Tableau, Azure, Sql, Python, ETL pipelines
Skills:
Devops, Terraform, Power Bi, Spark, Grafana, Azure, Python, Sql, AWS, ML lifecycle, CI/CD
Skills:
Agile Development, Alteryx, Power Bi, Databricks, Data Warehouse Architecture, Tableau, Azure, Sql, Python, data modelling techniques, ETL pipelines
Skills:
Git, Hive, Hadoop, Pyspark, Spark, Azure Databricks, Azure, Python, Sql, AWS, Palantir Foundry
Skills:
Azure Data Factory, Azure Cloud, Apache Spark, Databricks, Sql, Python, AI coding assistants