lnformatica ETL Developer

Shift: Night Shift

Employment Type: Contract

Job Summary

We are looking for a skilled ETL Developer / Data Engineer with strong expertise in Informatica, Databricks, Python/PySpark, and Azure Data Factory (ADF) to support enterprise data integration and modernization initiatives. The ideal candidate will have hands-on experience migrating legacy Informatica workflows to Databricks and building scalable, high-performance data pipelines.

Key Responsibilities

• Design, develop, and maintain ETL pipelines using Informatica, Azure Data Factory (ADF), and Databricks.
• Migrate legacy ETL workflows from Informatica to Databricks using Python and PySpark.
• Re-engineer ETL processes into optimized Spark-based transformations.
• Develop and optimize complex SQL queries, data models, and transformations.
• Schedule, monitor, and troubleshoot jobs using AutoSys.
• Integrate data from multiple sources including SQL Server, DB2, Mainframe systems, files (CSV, XML, JSON), and Kafka.
• Perform data validation, reconciliation, and quality assurance activities.
• Support AI/ML-driven data initiatives, including data preparation and feature engineering.
• Collaborate with offshore and onshore teams to support development and production activities.

Required Skills

• Strong experience in Informatica ETL Development.
• Proven experience migrating Informatica workflows to Databricks.
• Hands-on experience with Databricks and Azure Data Factory (ADF).
• Strong programming skills in Python and PySpark.
• Advanced SQL development and optimization skills.
• Experience with AutoSys job scheduling.
• Experience working with DB2, Mainframe systems, and Kafka.
• Strong understanding of ETL modernization, Spark optimization, and data engineering best practices.

Preferred Skills

• Experience with AI/ML concepts and data pipelines.
• Databricks ML, MLflow, and notebook experience.
• Knowledge of Pandas, Scikit-learn, and predictive analytics.
• Exposure to GenAI/LLM integrations.
• Experience with Azure Data Lake/Lakehouse architecture.
• Familiarity with CI/CD and DevOps practices.

Qualifications

• Experience working within the Azure cloud ecosystem.
• Exposure to batch and streaming data processing.
• Excellent communication and stakeholder management skills.
• Ability to work independently in a fast-paced environment.