Search by job, company or skills

Databricks / Delta Lake Tech Lead + Business Analyst

Databricks / Delta Lake Tech Lead + Business Analyst

Tata Consultancy Services
15-17 Years
Not Disclosed
  • Posted 8 days ago
  • Be among the first 10 applicants

Job Description

  • Defines, prioritizes and allocates resources; tracks and provides status reports of work assignments, projects, and programs performed in support of the Data Engineering team.
  • Lead design, development, and implementation of end-to-end complex automated data pipeline system using common Big Data Tools.
  • Design and implement robust data architectures and data pipelines for large-scale data processing.
  • Review business and technical requirements and ensure the data integration platform meets requirements
  • Identifying bottlenecks and optimizing data processing and storage systems for improved performance and efficiency implement monitoring and measurement of data quality as defined by business rules
  • Collaborating with other departments such as data science, analytics, and IT to understand their data needs and requirements, and aligning data engineering efforts to support organizational goals and initiatives.
  • Ensuring compliance with data privacy regulations and implementing robust security measures to protect sensitive data from unauthorized access or breaches.
  • 15 or more years of application delivery experience in the financial services industry
  • 10 or more years of experience in managing complex projects involving the implementation of digital or online-transaction solutions
  • Experienced in handling vendor and third-party SI engagements
  • Expertise in database technologies (SQL, NoSQL, etc.) and data warehouse platforms (e.g., Redshift, Snowflake).
  • Experience with ETL tools and data pipeline frameworks.
  • Candidate must be willing to work in Ortigas or Makati.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

data pipeline frameworks

Big Data Tools

Similar Jobs

15-17 yrs
Taguig, Philippines
Skills:
snowflake , Nosql, Etl Tools, Databricks, Redshift, Sql, data pipeline frameworks, Delta Lake