
Search by job, company or skills
Position: Senior Data Engineer
Job Type: Permanent
Work Setup: Hybrid
Location: Pasig or BGC, Philippines
What You'll Do:
• Build Data Pipelines: Design and maintain robust pipelines using Python and SQL specifically for transactional systems.
• Operational Modeling: Design relational schemas for live, day-to-day transactions, focusing on normalization rather than star schemas.
• System Optimization: Perform deep-dive query optimization and schema design on MySQL and RDS platforms.
• Production Transformations: Implement and manage data transformations at scale using DBT.
• Cloud Integration: Utilize the AWS ecosystem, including RDS, S3, and Lambda, to ensure seamless data movement.
• Maintain Quality: Lead efforts in data deduplication, identity resolution, and standardization at the source.
What We're Looking For:
• OLTP Expertise: Proven experience with transactional databases like MySQL, MariaDB, or PostgreSQL (Required).
• Python Proficiency: Strong, hands-on experience using Python specifically for data processing and ETL/ELT.
• Advanced SQL: Expertise in complex queries, stored procedures, and optimization for large transactional datasets.
• AWS Native: Significant experience with AWS services like RDS, S3, and CloudWatch; Azure/GCP-only profiles will not be considered.
• DBT Skills: Practical experience using Data Build Tool (DBT) within a production environment.
• Operational Focus: A background in building application-side systems, not just analytical data warehouses like Snowflake or BigQuery.
Job ID: 148395821
Skills:
S3, RDS, PostgreSQL, Mariadb, Sql, Lambda, Cloudwatch, MySQL, Python, AWS, AWS DMS, dbt
Skills:
Data Integration, Data Mart, Dax, Microsoft Office 365, Sql, Microsoft Azure, azure devops, Data Warehouse, python, Version Control, Data Security, powershell, elt/etl, Sharepoint, Stakeholder Management, medallion architecture, presentational skills, data pipeline development, microsoft fabric, data orchestration, lakehouse design, agile framework, teams
Skills:
snowflake , Apache Spark, Databricks, Sql, Python, AWS, Airflow, dbt, Delta Lake, Fabric
Skills:
Java, Scala, Pyspark, Apache Spark, Azure Databricks, Avro, Sql, Automated Testing, Version Control, Git, Azure Data Factory, Ansible, Azure Synapse Analytics, Rest Apis, Python, Azure DevOps, Parquet, Code reviews, Azure Data Lake Storage Gen2, Azure Blob Storage, CI CD, Delta Lake, Microsoft Fabric
Skills:
Power Bi, Dax, Sql, Synapse, Data Pipelines, Dataflows, Lakehouse, Medallion Architecture, Azure Fabric
We don’t charge any money for job offers