Key Responsibilities
- Build and maintain ETL pipelines using Azure Databricks and PySpark.
- Develop and manage the Databricks Unity Catalog (data lake).
- Build and integrate data‑driven applications using Azure Databricks and Azure services.
- Work with Azure Data Lake, SQL DB, Data Factory, Synapse Analytics, and Power BI.
- Optimize Databricks notebooks for performance and cost.
- Implement data quality, security, and governance standards.
- Troubleshoot workflow and application deployment issues within CI/CD processes.
- Document data flows, technical designs, and application architectures.
Required Qualifications
- Bachelor's degree in IT, Computer Science, Engineering, or related field.
- Microsoft Certified: Azure Fundamentals.
- Databricks Data Engineer Associate (Professional preferred).
- Essential Skills7+ years hands-on experience with Azure Databricks, PySpark, and cloud application development.
- Strong proficiency in Python and SQL.
- Experience with Azure Data Lake, Data Factory, SQL DB, and Synapse Analytics.
- Background in building and deploying cloud-based data pipelines and applications.
- Understanding of big data concepts, distributed systems, and data modelling.
- Experience with CI/CD, GitHub, and release management.
- Strong analytical, troubleshooting, and communication skills.
Nice-to-Have
- Power BI or other data visualization tools.
- Knowledge of MLflow, AI/Genie, or GenAI technologies.
- Familiarity with DevOps and Agile environments.
Work Arrangement
This role requires the candidate to be amenable to work full onsite at our office located in Alphaland Southgate Tower, Makati City.