Azure Data Engineer (Databricks)

Description

We are seeking an experienced Azure Data Engineer with expertise in Databricks to join our dynamic team in India. The ideal candidate will have a robust background in data engineering and a passion for building efficient data solutions in the Azure ecosystem.

Responsibilities

• Design and implement scalable data pipelines using Azure Databricks.
• Collaborate with data architects and data scientists to create data models and optimize performance.
• Develop ETL processes to extract, transform, and load data from various sources into Azure.
• Monitor and maintain data quality and integrity throughout the data lifecycle.
• Implement security measures to protect sensitive data in compliance with regulations.
• Document data engineering processes and best practices for team knowledge sharing.

Skills and Qualifications

• 7-14 years of experience in data engineering or related field.
• Proficiency in Azure Data Services, especially Azure Databricks.
• Strong programming skills in Python or Scala for data processing.
• Experience with SQL and data modeling techniques.
• Familiarity with data warehousing concepts and tools.
• Knowledge of big data technologies like Spark and Hadoop.
• Ability to work with data visualization tools such as Power BI or Tableau.
• Strong problem-solving skills and ability to work in a team environment.