Summary
We are seeking a Data Engineer to build and optimize data ingestion pipelines and cloud-based analytics infrastructure. The role ensures reliable data flow for reporting and insights across the organization. Candidates should have hands-on experience with AWS or Azure data platforms and collaborate closely with application owners, analysts, and data scientists to maintain scalable data delivery. This position requires a self-directed individual capable of supporting diverse data needs across multiple teams and systems.
Responsibilities
- Develop and manage efficient, scalable data pipeline architectures.
- Build large and complex data sets aligned with business needs.
- Design and implement data ingestion processes, automate workflows where possible, and enhance data delivery and infrastructure scalability.
- Create and maintain the systems needed for extracting, transforming, and loading data from diverse sources using SQL and AWS bigdata technologies.
- Collaborate with crossfunctional teams to troubleshoot ingestion issues, support data infrastructure requirements, ensure data security across regions, and enhance overall data system capabilities.
Qualifications
- At least 2 years of experience in a Data Engineer role and a Bachelor's degree in Computer Science, Information Systems, or a related quantitative field.
- Preferred experience with AWS services such as EC2, EMR, RDS, and Redshift.
- Familiarity with big data and streaming tools, including Hadoop, Spark, Kafka, Storm, or Spark Streaming.
- Proficiency in objectoriented or scripting languages such as Python, Scala, R, or Athena.
- Experience working with relational and NoSQL databases like Redshift, PostgreSQL, Cassandra, and DynamoDB.
