Data Engineer

Job description

Python Scripting for ETL, Automation & REST API integration

SQL (Athena / RDS) Query writing, Optimization & Schema design

Pandas, PySpark Data transformation, Aggregation & processing

JSON & REST API Integration for data retrieval & automation

Amazon S3 Data storage, partitioning, lifecycle policies, and cost optimization.

AWS Athena SQL-based querying, performance tuning (partitioning, compression,

indexing), and cost-efficient querying.

AWS Lambda Serverless function development, event-driven processing, and

integration with AWS services.

Amazon RDS Database management, query optimization, replication, and backup

strategies.

Amazon DynamoDB NoSQL data modelling, indexing, and performance tuning

(provisioned v/s on-demand capacity).

AWS Step Functions Orchestration of workflows, state management, and error

handling.

AWS Cloud Formation Infrastructure as Code (IaC), resource provisioning, and version

control.

AWS Data Pipelines CI/CD setup for automated deployment of data pipelines and

infrastructure

Required Skills Python, SQL, Pandas, Pyspark, JSAN, Rest API, Amazon S3, AWS Lamda, AWS Data Pipelines, AWS RDS, Amazon DynamoDB, AWS Step Functions

Role: Data Engineer

Industry Type: Recruitment / Staffing

Department: Engineering - Software & QA

Employment Type: Full Time, Permanent

Role Category: Software Development

Education

UG: Any Graduate

PG: Any Postgraduate