Data Engineer

Description

We are seeking a skilled Data Engineer to join our team in Southeast Asia. The ideal candidate will have extensive experience in building and optimizing data pipelines and working with large datasets to support our data-driven decision-making processes.

Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures.
• Collaborate with data scientists and analysts to understand their data requirements and provide solutions.
• Implement data quality checks and monitoring to ensure data integrity and reliability.
• Optimize and improve existing data processes for performance and efficiency.
• Work with cloud platforms (e.g., AWS, Google Cloud, Azure) to manage data storage and processing solutions.
• Conduct data modeling and ETL (Extract, Transform, Load) processes to ensure data is readily available for analysis.

Skills and Qualifications

• 5-14 years of experience in data engineering or related field.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong experience with SQL and database management systems (e.g., PostgreSQL, MySQL, MongoDB).
• Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka).
• Experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
• Knowledge of cloud data services and architecture.
• Understanding of data modeling and ETL processes.
• Strong analytical and problem-solving skills.
• Ability to work collaboratively in a team environment.