Responsible for migrating, Connect system data warehouse to Google's BigQuery and Google DataFlow / Apache Beam. To manage ongoing business intelligence needs and analyze and develop new requirements. Troubleshoot issues and ensure efficient and timely resolution to these, communicating with key stakeholders as needed
Key Performance Indicators:
- Job duties performed accurately and within strict timelines Secondary indicators will include:
- Clear, concise communication internally and externally
- Demonstrates a high degree of integrity and professionalism
Business Requirements & Analysis Experience:
- Migrate existing data warehouse and batch ETL process to BigQuery / DataFlow
- Works with internal and external customers and IT partners to develop and analyze business intelligence needs.
- Interprets business requirements and determines optimum BI solutions to meet need
- Scope and estimate work involved in producing new reports and dashboards
- Troubleshoots problems with existing reports / ETL process, develop solutions
Information and Quality Assurance:
- Creates data quality tickets, as needed
- Verifies the data collected is within required quality standards
- Recommend quality metrics and ensures quality metrics are documented and tracked
Research/Evaluation
- Identifies and provides input to new technology opportunities that will have an impact on the enterprise wide BI systems
- Provides input into business requirements for the design of solutions
- Provides input to the development of information quality metrics
Skills and Experience
- Strong experience of Google's BigQuery
- Strong experience with Google DataFlow / Apache Beam
- Experience migrating star schema data warehouses to BigQuery
- Experience migrating older ETL systems to Apache Beam
- Database extraction, analysis and testing as part of data assurance
- Experience with Microsoft Power BI or similar reporting applications
- Experience creating reports and analytical dashboards
- Data anonymization
- Continuous integration & deployment experience (GIT, JIRA, Atlassian, other)