Lead Data Engineer

4-7 years
8 Applied
Job Description

Job Description
A Lead Data Engineer(CL3) is a well versed data engineer who will help Data Management and Systems Operations (DSO) department by enabling the business and its clients on designing, building and moving their data from operational and external environments to the business intelligence environment or any other designated target for analysis, consumption and utilization, driving real business impact and helping clients, both internal and external, embrace complete digitalization. The Lead Data Engineer is also expected to mentor associate and senior data engineers and serve as a consultant in times of need
Duties and Responsibilities

  • Extract client data from different sources for processing, integration and business rule applications
  • Develop state of the art ETL jobs for transforming data depending on the client's current business need
  • Ensure data quality and data integrity throughout the ingestion process
  • Develop data ingestion jobs for POCs leaning towards advanced business solutions
  • Contribute in the development of end to end enterprise level solution and architecture, ensuring the feasibility and proper orchestration of data ingestion and data quality solutions
  • Support the overall end to end enterprise level data projects, both internally and externally
  • Mentor associate and senior data engineers and serve as a consultant in times of need

  • Requires a Bachelor's Degree in Engineering, Computer Science, Information Technology or other related field
  • At least 4 years of experience working on enterprise level solutions in required for this position
  • At least 2 years of experience developing ETL jobs using Talend is required for this position
  • Proficient Knowledge in Java or any programming language strongly preferred
  • Proficient Knowledge in Big Data, Hadoop, HIVE, Informatica, Spark or any other related technologies strongly preferred
  • Proficient Knowledge in SQL, PL/SQL or any other relational and non relational database strongly preferred
  • Working knowledge on data modelling is strongly preferred
  • Working knowledge in using Amazon Web Services is a big plus
  • Working knowledge in using linux environment is a big plus
  • Working knowledge in software development life cycle and agile/scrum methodology is preferred but not required
  • Natural leader, problem solver and critical thinker
  • Detail oriented, highly adaptive and always willing to learn