N
Data Engineer Databricks
N
Data Engineer Databricks
Ncs- Posted 3 hours ago
- Be among the first 10 applicants
Job Description
- Provides assessment and estimation of effort needed based on the provided Business request form.
- Develops and delivers automated data pipelines (Extract, Transform, Load-ETL) jobs in the Data Lake within expected timelines.
- Coordinates with various support groups to accomplish assigned automated data pipes for development
- Prepares deployment package for endorsement to Release Testing Team which includes Solutions Design Document and Operations Guide.
- Provides support during the stabilization phase of pipes endorsed to production until declared BAUeview and approves builds based on the set framework, standards, and best practices.
- Documents source code.
- Other job-related activities that may be assigned from time to time.
- Skilled in Python (atleast 4/5 rating), SQL (atleast 3/5 rating)
- Working or has experience working on modern data cloud platforms ( Databricks/Snowflake)
- With exposure to cloud services (preferably Azure or AWS)
- Must have strong SQL & PL/SQL skills with the ability to solve highly complex challenges
- Must have good communication and interpersonal skills for interacting and collaborating with developers, analysts, and business staff throughout the organization.
- Must have the ability to communicate clearly in writing to document data requirements and translate them into technical solutions.
- Must be adept to work in a fast-paced environment with tight SLAs.
More Info
About Company
Skills:
data engineering , snowflake , databricks, Apache Spark
Skills:
Sql, Azure Data Factory, Etl Tools, Pyspark, data integration techniques, Databricks Unified Data Analytics Platform, Databricks Unity Catalog, Auto Loader, Python Programming Language, data warehousing concepts and practices, Delta Live Tables, cloud platforms and services related to data engineering