DATA ENGINEER

0-2 years
21 days ago 2 Applied
Job Description

Description

We are seeking an experienced Data Engineer to join our dynamic team. The ideal candidate will have a strong background in building and maintaining data pipelines, managing data lakes, and developing solutions using Azure, Python, Spark, Rust, and MongoDB/NoSQL databases. This role involves working closely with data scientists, analysts, and other stakeholders to ensure the efficient and effective use of data within the organization.

Key Responsibilities:

  • Design, construct, install, test, and maintain highly scalable data management systems.
  • Develop and implement data pipelines and ETL processes to support data transformation, workload management, and error handling.
  • Manage Azure cloud-based data systems, including Azure Data Lake, Azure Data Factory, and other Azure services.
  • Employ a variety of languages and tools (e.g., Python, Spark, Rust) to marry systems together or try to hunt down opportunities to optimize and improve data reliability and quality.
  • Collaborate with data science and analytics teams to assist in data-related technical issues and support their data infrastructure needs.
  • Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
  • Build algorithms and prototypes to improve data quality and accessibility.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product.
  • Ensure compliance with data governance and data security requirements.
  • Expertise in working with NoSQL databases like MongoDB and other similar technologies.

Agile Methodologies:

  • Apply Safe Agile or Scrum methodologies to drive project success.
  • Lead Agile ceremonies, including sprint planning, daily stand-ups, and retrospectives.

Collaboration and Communication:

  • Collaborate effectively with cross-functional teams, including product managers, designers, and QA engineers.
  • Communicate project status, issues, and risks clearly and concisely to stakeholders.

Qualifications:

  • Bachelor's or master's degree in Computer Science, Engineering, or related field.
  • Proven experience as a Data Engineer, Software Developer, or similar role.
  • Advanced working knowledge of Azure cloud services, data pipeline and workflow management tools.
  • Experience with big data tools: Spark, Hadoop, etc.
  • Proficiency in programming languages: Python and Rust.
  • Experience with data modelling, data warehousing, and building ETL pipelines.
  • Strong experience with SQL and NoSQL databases, including SQL Server, PostgreSQL, MongoDB, Cassandra, etc.
  • Strong analytic skills related to working with unstructured datasets.
  • Ability to work in a fast-paced, team-oriented environment.
  • Excellent problem-solving skills and attention to detail

KMC is the largest Flexible Workspace provider and Talent Sourcing Provider, dedicated to delivering customer-centric and highly-flexible solutions to businesses seeking to establish or expand operations in the Philippines.KMC has the largest portfolio of serviced offices and coworking space in the Philippines while providing dedicated offshore virtual teams to its clients from the US, Australia, Europe and Singapore. In addition to coworking and private offices, KMC designs and builds entire leased office floors for its Enterprise clients.

Career Advice to Find Better