Job Description
The Data Engineer II will be responsible for designing, developing, and maintaining data pipelines and infrastructure for our organization. They will work closely with data scientists, analysts, and other stakeholders to ensure that data is properly collected, stored, and analyzed.
Responsibilities:
- Design and develop data pipelines and infrastructure using tools such as Apache Spark, Hadoop, and Kafka
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure that data is properly collected, stored, and analyzed
- Implement data quality checks and monitoring to ensure data accuracy and completeness
- Optimize data pipelines and infrastructure for performance and scalability
- Document data pipelines and infrastructure for future reference and maintenance
- Stay up-to-date with emerging trends and technologies in data engineering
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- 3+ years of experience in data engineering
- Strong programming skills in languages such as Python, Java, or Scala
- Experience with big data technologies such as Apache Spark, Hadoop, and Kafka
- Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform
- Strong problem-solving and analytical skills
- Excellent communication and collaboration skills
What We Offer:
- Civitas is an Equal Opportunity Employer
- Unlimited, flexible PTO
- Paid Company Holidays
- Anniversary recognition and event celebration
- Working in a Multicultural environment across the Globe
