Job Summary:
We are looking for a Python Developer with strong experience in batch processing and data workflows. The role involves designing, developing, and maintaining scalable batch jobs that process large volumes of data efficiently and reliably. You will work closely with data engineers, analysts, and business stakeholders to support data-driven initiatives.
Key Responsibilities:
- Design, develop, and maintain batch processing systems using Python
- Build and optimize data pipelines for large-scale data processing
- Develop scheduled jobs for data ingestion, transformation, and reporting
- Ensure data quality, integrity, and consistency across systems
- Monitor, troubleshoot, and enhance existing batch workflows
- Collaborate with cross-functional teams to gather requirements and deliver solutions
- Implement logging, error handling, and performance tuning for batch jobs
- Document processes, workflows, and technical solutions
Required Skills & Qualifications:
- Strong experience in Python development
- Hands-on experience with batch processing frameworks such as Apache Airflow or Luigi
- Experience working with large datasets and data processing libraries (e.g., Pandas, PySpark)
- Solid understanding of SQL and relational databases
- Experience with scheduling and orchestration of jobs
- Familiarity with Linux/Unix environments
- Strong problem-solving and analytical skill
- AWS required
