Position Overview
We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data team. In this role, you will be responsible for designing, developing, and maintaining robust ETL/ELT pipelines while ensuring the highest standards of data quality, governance, and integrity. Our core ecosystem is built on Qlik Talend Cloud and Amazon RDS for PostgreSQL; however, we are open to talented engineers with strong expertise in equivalent, enterprise-grade data stack technologies who are ready to adapt their skills to our environment.
Key Responsibilities
- ETL/ELT Development: Design, build, and deploy scalable ETL/ELT jobs using Qlik Talend Cloud (or similar enterprise tools) hosted on AWS, with AWS RDS PostgreSQL (or equivalent cloud relational databases) as the target.
- Data Governance & Cataloging: Lead metadata harvesting, establish end-to-end data lineage, and maintain a comprehensive business glossary. Enforce data governance policies using Qlik Talend Data Catalog (or equivalent catalog tools).
- Data Quality Management: Design and implement data quality profiling, cleansing rules, and validation checks within data pipelines to identify, log, and resolve data anomalies.
- Technical Documentation: Author detailed technical specification documents, data mapping sheets, and architecture diagrams for all developed data pipelines.
- Testing & QA: Perform rigorous testing, debugging, and quality assurance on data pipelines to ensure data accuracy, consistency, and performance optimization.
Required Skills & Qualifications
- Experience: 5+ years of experience in data engineering, data warehousing, or a similar role.
- Data Integration & ETL: Strong experience with Qlik Talend Cloud (Studio, Management Console) OR equivalent enterprise ETL tools (e.g., Informatica, IBM DataStage, Microsoft SSIS/Data Factory, or SAS Data Integration Studio).
- Cloud & Databases: Proficiency with the AWS ecosystem (or equivalent cloud platforms like Azure/GCP), with a focus on managing and optimizing AWS PostgreSQL RDS targets, writing advanced SQL, and performance tuning.
- Data Governance & Quality: Hands-on experience with Qlik Talend Data CatalogOR equivalent data catalog/governance solutions (e.g., Alation, Informatica Enterprise Data Catalog). Deep understanding of data quality principles (profiling, deduplication, formatting, and validation).
- Software Lifecycle: Strong background in writing technical specifications, unit testing, and implementing QA best practices for data pipelines.
- Education: Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field (or equivalent practical experience).
Nice-to-Have Skills
- Client Engagement: Experience interacting with and managing customer counterparts, translating client business requests into data requirements, and guiding technical discussions.
- Experience or foundational knowledge in Master Data Management (MDM) concepts and implementation.
- Professional certifications in relevant technology areas:
- Qlik Talend Certifications (e.g., Qlik Talend Data Integration Certified Professional).
- Cloud certifications (e.g., AWS Certified Data Engineer, Solutions Architect, or equivalent Azure/GCP certifications).