Data Engineer

We are looking for a Data Engineer with 2–3 years of experience in developing, maintaining, and optimizing data pipelines using Python and AWS services, particularly AWS Glue.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using Python and AWS services.
• Develop and manage ETL/ELT processes using AWS Glue.
• Extract, transform, and load data from various sources into data warehouses or data lakes.
• Perform data cleansing, transformation, validation, and quality checks to ensure data accuracy and consistency.
• Work with AWS services to support data storage, processing, and integration.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Collaborate with data engineers, analysts, and other stakeholders to support data requirements and business needs.
• Maintain technical documentation for data workflows, pipelines, and processes.

Qualifications:

• At least 2–3 years of experience as a Data Engineer or in a similar role.
• Strong programming skills in Python.
• Hands-on experience with AWS Glue and ETL/ELT development.
• Working knowledge of AWS services and cloud-based data engineering solutions.
• Experience in SQL and working with relational or non-relational databases.
• Understanding of data warehousing, data lakes, and data pipeline architecture.
• Strong analytical, troubleshooting, and problem-solving skills.
• Good communication and collaboration skills.

Preferred Qualifications:

• Experience with AWS S3, Lambda, Redshift, or Athena.
• Familiarity with Apache Spark or PySpark.
• Knowledge of data orchestration, workflow automation, and pipeline monitoring.