Data Engineer
Data Engineer
Nicoll Curtin- Posted 3 hours ago
- Be among the first 10 applicants
Job Description
Data Engineer
We are looking for an experienced Data Engineer with strong Python and SQL skills to support the development, maintenance and production operations of data platforms and pipelines.
Key Responsibilities
- Work with business analysts, stakeholders and technology teams to understand business, functional and data requirements.
- Design, build, test and maintain scalable data pipelines, data models and integration solutions.
- Source, ingest, transform and curate data from multiple internal and external systems.
- Translate functional and data requirements into reliable and maintainable technical solutions.
- Validate data logic, business rules, mappings and transformation requirements.
- Perform data profiling, reconciliation, testing and root-cause analysis to ensure data quality and accuracy.
- Manage system enhancements, bug fixes, production issues and change requests.
- Develop and maintain technical documentation, including data flows, mappings, pipeline designs, data models and operational runbooks.
- Support data governance and ensure solutions comply with technology, security, risk and data standards.
- Perform BAU monitoring, incident investigation, remediation and production support for data platforms and pipelines.
- Monitor system and pipeline performance and identify opportunities for automation, optimisation and improved resilience.
Requirements
- Degree in Computer Science, Information Technology or a related field.
- At least 4 years of hands-on experience in data and application support.
- Strong hands-on experience with Python and SQL.
- Experience working with data pipelines, data integration and data transformation.
- Good understanding of data quality, troubleshooting and production support.
- Strong written and verbal communication skills.
- Agile, adaptable and able to learn quickly in a changing environment.
This is a 12 months rolling contract role.
More Info
Key Skills
data pipelines
reconciliation testing
root-cause analysis


