Azure Data Engineer
- Posted 24 days ago
- Be among the first 30 applicants
Job Description
Company Name: WillwareTechnologies
Role:Azure Data Engineer
Experience:7+ Years
Location:Chennai, Bangalore, Mumbai, Noida, Gurugram
WorkMode:Hybrid
Job Overview
Role:Azure Data Engineer
Experience:7+ Years
Location:Chennai, Bangalore, Mumbai, Noida, Gurugram
WorkMode:Hybrid
Job Overview
We are looking for an experienced Azure Data Engineer with strong hands-on expertise in Azure Databricks, Azure Data Factory (ADF), Apache Airflow, Snowflake, SQL, and Python. The candidate should be capable of developing and maintaining scalable data pipelines and data engineering solutions.
Key Responsibilities- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
- Develop data processing solutions using Azure Databricks and PySpark/Python.
- Build and manage data pipelines using Azure Data Factory (ADF).
- Develop and manage workflows and orchestration using Apache Airflow.
- Design and optimize data solutions using Snowflake.
- Write complex and optimized SQL queries for data transformation and analysis.
- Develop data engineering solutions using Python.
- Perform data integration, transformation, validation, and troubleshooting.
- Optimize pipeline and query performance.
- Collaborate with data architects, analysts, and other engineering teams to deliver reliable data solutions.
- Hands-on experience with Azure Databricks
- Hands-on experience with Azure Data Factory (ADF)
- Hands-on experience with Apache Airflow
- Strong SQL skills
- Hands-on experience with Python
- Minimum 3 years of hands-on Snowflake experience - Mandatory
More Info
Key Skills
About Company
Skills:
Spark SQL, Apis, Pyspark, Sql, ELT, Azure Synapse, Devops, Azure Data Factory, Databricks, Data Governance, Python, Etl, Z-ordering, Data Partitioning, Bucketing, Streaming Data, Delta Lake, Liquid Clustering, Batch Processing, Indexing
Skills:
Spark, Azure Data Lake, Databricks, Sql, Python, Delta Tables, Synapse, Unity Catalog
Skills:
Azure Data Factory (ADF), T-sql, Data Warehouse Concepts, Pyspark, SQL Server, Sql, Git, Python, Star Schema, Azure DevOps, Generative AI, AI-Assisted Development, Claude Claude Code, Fact Dimension modeling, Azure SQL Database, Stored Procedures, CI/CD, Microsoft Fabric
Skills:
Spark SQL, Data Modeling, Pyspark, Dimensional Modeling, Azure Data Factory, Azure Functions, Iam, Spark, Microsoft Azure, Databricks, OneLake, Fabric Data Factory, Lakehouse Architecture, Medallion Architecture, Unity Catalog, Azure RBAC, Synapse Analytics, Notebooks, Delta Lake, Microsoft Fabric, Fabric Notebooks
Skills:
Pyspark, Adf, Azure Synapse Analytics, Azure Data Lake, Databricks, Python, Sql, Azure SQL Database