Data Engineer

Position Summary

We are seeking a skilled and experienced Data Engineer to join our team for a cutting-edge Big Data Project. The ideal candidate will be responsible for designing, developing, and maintaining scalable and efficient data pipelines and infrastructure to support our data-driven initiatives. This role requires a strong technical background in big data technologies and data engineering best practices.

Role and Responsibilities

Duties & Responsibilities:

Responsibilities Include:
. Implement, maintain and evolve cloud-based Big Data products and services
. Responsible for designing, implementing, testing, and maintaining ETL processes for Analytics and Business Intelligence Systems
. Analyze data warehouses and suggest optimizations to SQL Queries used for Business Intelligence reporting
. Modify structured and unstructured data to provide meaningful reports to business
. Write large amounts of code, perform code reviews, write unit tests
. Write documentation
. Interface with other groups including Product Management, QA and Operations
. Create quick proof-of-concept prototypes
. Participate in an agile team

Work Experience:

At least 2 years relevant work experience

Skills & Competencies:

. Working experience in software development using Java, Scala, or Python is a must
. Extensive experience in implementing scalable and reliable ETL pipelines using Big Data Technologies such as Apache Spark, Hadoop, AWS Glue
. Experience transforming data in various formats ( JSON,CSV, PARQUET, YAML, Avro, Orc)
. Experience managing and scheduling workflows (Apache Airflow experience is preferred)
. Experience with working on SQL Databases (Cloud Data Warehouses such as Amazon Redshift, Google BigQuery, and Data Lakes/Delta Lakes are preferred)
. Ability to analyze and simplify complex code and algorithms in Java, Scala or Python
. Ability to adapt and learn different technologies that best solves the problem regardless of whether it is written in Python, Java, Scala, etc.
. Ability to perform ad-hoc complex SQL queries and query optimization
. Team player with strong communication skills
. Desire to learn fast and pick up latest technologies and tools
. Experience with data visualization software (Tableau preferred) is a plus
. Experience with Kubernetes and Machine Learning is a plus

Skills and Qualifications

. Please visit to see Privacy Policy, which defaults according to your location. You can change Country/Language at the bottom of the page. If you are European Economic Resident, please click .