We are seeking an experienced ETL Developer with a strong background in Databricks to join our dynamic team in the Philippines. The ideal candidate will have 4-10 years of experience in ETL development, specializing in building and optimizing data pipelines for large-scale data processing. You will play a key role in transforming raw data into actionable insights, ensuring data quality and efficiency in our data operations.
Responsibilities:
- Design, develop, and maintain ETL processes using Databricks and Apache Spark.
- Collaborate with data architects and data analysts to understand data requirements and translate them into ETL solutions.
- Optimize ETL processes for performance and scalability in cloud environments.
- Monitor ETL jobs and troubleshoot any issues that arise during data processing.
- Ensure data quality and integrity throughout the ETL pipeline by implementing validation and error-handling mechanisms.
- Document ETL processes and maintain updated technical documentation for reference and knowledge sharing.
- Participate in code reviews and provide constructive feedback to peers.
Skills and Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 4-10 years of experience in ETL development and data engineering.
- Proficiency in Databricks and Apache Spark for big data processing.
- Strong experience with SQL for data manipulation and querying.
- Familiarity with data warehousing concepts and practices.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Knowledge of data modeling and data architecture principles.
- Experience with data integration tools and frameworks, preferably in a cloud environment.
- Strong analytical and problem-solving skills.
- Excellent communication skills to collaborate with cross-functional teams.
