Senior Data Engineer

We are looking for an experienced Data Engineer – Azure/SAP to design, develop, and maintain reliable, scalable, and secure data pipelines that integrate SAP and non-SAP data into Microsoft Azure platforms. The successful candidate will play a key role in making enterprise SAP data accessible for analytics, reporting, and downstream business applications.

Key Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines using Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Microsoft Fabric.
• Build and support data integrations from SAP S/4HANA and SAP ECC into Azure-based data platforms.
• Transform and process large datasets using SQL, Python/PySpark, and Spark.
• Manage and organize enterprise data using Azure Data Lake Storage Gen2 and Azure Blob Storage.
• Ensure data accuracy, quality, security, and pipeline performance through validation, monitoring, and reconciliation.
• Optimize data pipelines for scalability, reliability, and cost efficiency.
• Implement CI/CD, version control, testing, and deployment processes using Azure DevOps and Git.
• Collaborate with SAP technical and functional teams, platform teams, and business stakeholders to deliver effective data solutions.
• Troubleshoot data integration and pipeline issues and maintain technical documentation.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent practical experience.
• Proven experience as a Data Engineer or in a similar role developing production data pipelines and ETL/ELT solutions.
• Strong hands-on experience with Microsoft Azure Data Factory and Azure data services.
• Experience integrating SAP S/4HANA or SAP ECC data into Azure platforms.
• Knowledge of SAP HANA, CDS Views, OData, APIs, SAP extractors, or other SAP data integration methods.
• Strong SQL and Python/PySpark programming skills.
• Experience with Apache Spark or distributed data processing.
• Understanding of Git, Azure DevOps, CI/CD, software engineering practices, and data pipeline deployment.

Preferred Qualifications

• Hands-on experience with Azure Databricks, Delta Lake, Microsoft Fabric, or Lakehouse architecture.
• Knowledge of Parquet, Delta, and Avro file formats.
• Experience with Azure DevOps pipelines and repositories.
• Familiarity with Azure security, identity and access management, and infrastructure automation.
• Strong analytical, problem-solving, communication, and stakeholder management skills.