The Data Engineer is an early-career data professional responsible for supporting the design, development, and maintenance of data pipelines and infrastructure that enable data-driven decision-making across the organization. Reporting to the Data Engineering Manager, this role plays a key part in ensuring the reliability, accessibility, and performance of data systems.
The Associate supports the development of tools and processes that automate data ingestion, transformation, and storage from structured and unstructured sources. This includes working on scalable data pipelines, contributing to data system integration, and implementing the best data security and continuity practices.
The role requires proficiency in scripting, data modeling, and modern data platforms. Data Engineering Associates are passionate about working with data, eager to learn, and capable of translating technical tasks into meaningful data solutions that align with business needs.
WHAT IS THE JOB LIKE
Optimize Solution Performance
- Develop tools and scripts to improve data flow between internal systems, external sources, and the data warehouse
- Test and optimize data configurations and pipelines to improve system efficiency and throughput
- Automate components of the data collection, integration, and reporting processes
- Assist in integrating data systems with the existing data and IT infrastructure
Identify Business Needs
- Translate basic data needs from business stakeholders into technical system requirements
- Help evaluate suitable data structures based on usage patterns, availability, and access requirements
- Stay informed of emerging technologies and practices in databases, cloud data platforms, and processing tools
- Apply foundational business understanding to recommend improvements in data structure or process where appropriate
Build and Maintain Data Pipelines
- Assist in the development of scalable ETL/ELT pipelines for processing structured and unstructured data
- Write clean, testable scripts and prototype solutions to handle real-time and batch data processing
- Support the creation of secure, well-documented storage and archival solutions to ensure business continuity
- Monitor data systems and pipelines for performance and reliability, escalating issues as needed
- Support data logging, error handling, and exception tracking within data workflows
- Implement and monitor basic data security, privacy, and governance controls within existing solutions
- Test pipelines for reliability and scalability across different data volumes, sources, and formats
- Participate in building Proof-of-Concepts and prototypes for new data tools or workflows
Tactical Focus
- Execute development and support tasks assigned by senior engineers or managers
- Troubleshoot pipeline performance issues, data anomalies, and system integration concerns
- Apply coding, scripting, and database knowledge to build reliable data processes
- Contribute to continuous improvement by suggesting small enhancements to systems and processes
- Continuously develop technical and business knowledge in data engineering practices
WHO ARE YOU
Must-Haves
- Bachelor's or Master's degree in IT, Computer Science, or related field.
- Familiarity with SQL, Python, SAP BW, and data transformation techniques
- Strong technical writing and communication skills.
- Familiarity with data processing frameworks and/or other cloud data platforms
- Familiarity with data governance, security, and compliance standards. Understands basic principles of data quality, performance optimization, and security
- Collaborative and willing to learn from team members while contributing proactively
