AWS Data Engineer

Key Responsibilities

• Design, develop, and maintainscalable ETL/ELT pipelinesusing AWS services such asGlue, Lambda, Step Functions, EMR, Athena, and Redshift.
• Build and managedata lakes, ensuring organized, secure, and optimized storage onAmazon S3.
• Develop and maintaindata warehouse solutionson AWS Redshift and implement performance tuning strategies.
• Implement and automatedata ingestion frameworksfrom structured and unstructured data sources.
• Collaborate with data scientists, analysts, and business teams to transform business requirements into reliable data models and pipelines.
• Optimize data workflows forhigh availability, cost efficiency, and performance.
• Implement and enforcedata governance, security, compliance, and IAM policiesacross the data ecosystem.
• Monitor and troubleshoot data pipelines usingCloudWatch,Glue logs, and other observability tools.
• Work withCI/CD tools(CodePipeline, CodeBuild, GitHub, Jenkins) to automate deployments.
• Develop and maintaindocumentationfor architecture, data flows, and operational processes.

Required Skills & Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
• Strong hands-on experience withAWS cloud services(S3, Glue, Lambda, Redshift, EMR, Athena, DynamoDB, Kinesis).
• Proficiency inPython,PySpark, orScalafor data processing and automation.
• Strong experience withSQL, data modeling, and database optimization.
• Experience withbig data frameworks(Spark, Hadoop) on AWS.
• Solid understanding ofdata warehousing, star/snowflake schemas, and best ETL design practices.
• Familiarity withCI/CD pipelines, Git, and container technologies likeDocker.
• Knowledge ofsecurity best practices, including encryption, IAM, and VPC networking.
• Strong analytical, problem-solving, and communication skills.

Preferred Qualifications

• Experience withAWS Glue Studio,Glue Data Catalog, and schema management.
• Knowledge ofmachine learning data preparationand integration with services likeSageMaker.
• Experience withTerraformorCloudFormationfor infrastructure-as-code (IaC).
• AWS Certification (e.g.,AWS Data Analytics Specialty,AWS Solutions Architect) is a plus.