T
Azure Data Engineer
T
Azure Data Engineer
Tata Consultancy Services- Posted 11 days ago
- Over 100 applicants have applied
Job Description
Azure Databricks,PySpark, Azure Data Factory
Responsibilities
- Design, develop, and maintain data pipelines using Azure Data Factory.
- Manage and optimize data storage using Azure Data Lake Gen 2.
- Build and process large-scale data solutions with Azure Databricks and Apache Spark.
- Create interactive reports and dashboards in Power BI for business insights.
- Collaborate with cross-functional IT and business teams to translate requirements into data solutions.
- Ensure data quality, security, and compliance in line with organizational standards.
Core Skills Required
- Azure Data Factory: Experience in building and managing data pipelines.
- Azure Data Lake Gen 2: Proficient in data storage and management within Azure's data lake environment.
- Azure Databricks / Apache Spark: Hands-on skill with distributed data processing, transformations, and analytics.
- Power BI: Expertise in data visualization and reporting.
More Info
Key Skills
About Company
Skills:
Pyspark, PostgreSQL, Databricks, MongoDB, Azure, Python, Etl, Data Transformation, Large Data Processing
Skills:
Azure Data Factory, Pyspark, Azure Data Lake, Azure Databricks, Sql
Skills:
Pyspark, Performance Tuning, Scala, Data Warehousing, Azure Databricks, Data Modeling, Sql, ELT, Spark, Etl, cloud-based data platforms, big data processing, Azure Data Services
Skills:
Git, SQL Server, Sql Development, Azure DevOps, Azure Data Lake Storage ADLS Gen2, ETL ELT pipelines, Synapse Analytics, Azure SQL Database, Azure Data Factory ADF
Skills:
Pyspark, Adf, Spark, Azure Databricks, Data Engineer, Azure, Synapse, ADLS, Data Bricks