Search by job, company or skills

AWS Data Engineer

AWS Data Engineer

Tata Consultancy Services
6-12 Years
Not Disclosed
Early Applicant
  • Posted 11 days ago
  • Be among the first 30 applicants

Job Description

Exp Must --6 to 12 Years

Preferred location-- Pune, Bengaluru, NCR, Kolkata

Job Requirements*

The successful candidate will be responsible for

  • Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
  • Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
  • Manage efficiently large dataset.
  • Manage SQL database - Postgresql or MongoDB.
  • Implement and maintain complex data calculation formula.
  • Open to collaborate with Software Engineers.
  • Participate in code reviews, design discussions, and software planning.
  • Contribute to automation, testing, and deployment processes.

Key Responsibilities*

  • Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
  • Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
  • Manage effeciently large dataset.
  • Manage SQL database - Postgresql or MongoDB.
  • Implement and maintain complex data calculation formula.
  • Open to collaborate with Software Engineers.
  • Participate in code reviews, design discussions, and software planning.
  • Contribute to automation, testing, and deployment processes.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Similar Jobs

5-7 yrs
Pune, India
Skills:
snowflake , Java, Pyspark, Amazon S3, AWS Glue, Pl Sql, Sql, Lambda, Sts, Kms, Unix Scripting, Iam, Selenium, Aws Cloud, Python, Airflow, Step Functions, Lake Formation, AWS Data Analytics stack, DBT Data Build Tool, Athena
7-10 yrs
Pune, India
Skills:
Github, Apache Spark, AWS Glue, Amazon Redshift, Data Lake, Data Warehousing, Python, Etl, Apache Iceberg, Amazon Athena, JSON processing, API integrations
6-8 yrs
Pune, India
Skills:
Pyspark, Python, Oracle to PostgreSQL, AWS DMS, AWS Data Engineer
12-18 yrs
Pune, India
Skills:
Azure, Databricks, Sql, Apache Airflow, Apache Spark, Pyspark, Kafka, AWS, Kubernetes, Python, Data Governance, Terraform, Docker, Infrastructure as Code
5-7 yrs
Pune, India
Skills:
snowflake , Spark, Sql, S3, Apache Airflow, Aws Services, Emr, AWS Glue, Windows, Lambda, Yarn, Hadoop, Pyspark, Linux, Hive, Python, Redshift, Ec2, Scala, AWS Aurora, Shell Scripts, Athena, Step Functions, Singlestore