Search by job, company or skills

Data Engineer - AWS

Data Engineer - AWS

Innova Solutions
4-10 Years
Not Disclosed
  • Posted a month ago
  • Over 50 applicants have applied

Job Description

Hey Jobseekers,

we are looking for AWS Data Engineer with glue & Pyspark experience

Experience : 4 to 10 Years

Location : Hyderabad / Chennai / Noida / Pune / Bangalore

kindly reply with below details [Confidential Information]

CTC :-

ECTC :-

Notice Period :-

Preferred Location :-

  • Hands on experience in Dimensional, Data vault and relation modelling
  • Expertise in Data warehousing and ETL Design and implementation
  • Hands on experience with Programming language like Python/Scala
  • Good understanding of Spark architecture along with internals
  • Hand on experience using AWS services like Glue(Pyspark), Lambda, S3, Athena, RDS, IAM, Lake formation
  • Experience on Mulesoft is good to have
  • Hands on experience on implementing different loading strategies like SCD1 and SCD2, Table/ partition refresh, insert update, Swap Partitions,
  • Experience in consuming and writing data from and to Flat files, RDMBS systems, MPPS, JSON and XML, Service, Streams, queues, CDC etc.
  • Experience in Parallel Loading and Dependencies orchestrations
  • Awareness of scheduling and orchestration tools
  • Awareness of OS Compute, Networking, internal working and architecture of DB and ETL Server and its impact on ETL Design, Data transfer and Data processing
  • Experience on RDBMS systems and concepts
  • Expertise in writing and complex SQL queries and developing Database components including creating views, stored procedures, triggers etc.
  • Create test cases and perform unit testing of ETL Jobs
  • Analytical mind with a problem-solving and debugging skills.
  • Excellent Communication Skills
  • Awareness of Replication, Synchronization and Disaster Management techniques
  • Hand on experience in Data Quality Management
  • Awareness of data governance concepts and implementation
  • Hand on experience using AWS services like Glue, Lambda, S3, Athena, RDS, IAM, Lake formation

Thanks

Nishikanth

More Info

Job Type:
Industry:
Employment Type:

Key Skills

RDBMS systems

Data Quality Management

ETL Design and implementation

Service Streams

Spark architecture

Parallel Loading

queues

Database components

data governance concepts

About Company

Similar Jobs

6-8 yrs
Hyderabad, India
Skills:
Python Scripting, Sql, AWS Core Services S3 Lambda IAM, Query Database Performance Tuning, ETL Integrations Data Transformations
4-6 yrs
Hyderabad, India
Skills:
Spark SQL, Git, Pyspark, Apache Spark, Python, Sql, Etl, ELT, DataFrames
3-5 yrs
Hyderabad, India
Skills:
Apache Airflow, Hadoop, Apache Spark, Big Data, Python, Sql, AWS, Etl
10-12 yrs
Hyderabad, India
Skills:
.NET, Selenium, Databricks, Sql, Java, Tensorflow, Rust, React, MLops, Angular, Pytorch, Nosql, Terraform, Big Data, Nodejs, Bdd, Cucumber, Kubernetes, Python, Docker, Gherkin, LLMOps, LangFuse, LangChain, LangGraph, Playwright, LangSmith
8-12 yrs
Hyderabad, India
Skills:
Spark, Data Modeling, Big Data Technologies, Java, Aws S3, Python, Scala, Hadoop, data warehousing solutions, ETL processes