Data Engineer

Role: Data Engineer

 Job Description:Strategic Analytics is a growing team at Client's team. The team develops innovative predictive models and analytical tools to improve profitability and growth. This position will help support the data engineering needs across a growing portfolio of high-profile analytics projects by developing complex data structures and pipelines leveraging a diverse set of tools and languages. This includes the following cloud based technologies: Databricks, Snowflake, Spark, Python and Azure Data Factory. As a key member of the Strategic Analytics team, you will advance our data engineering capabilities helping the team analyze data faster. Tasks/ Responsibilities:Responsibilities:

• Work closely with predictive modelers to assemble large, complex data sets that help solve business problems and increase profitability
• Perform data manipulation and transformation using SQL and Python
• Identify, design, and implement internal process improvements: automating manual processes and optimizing data pipelines
• Discover and explore new sources of data with curiosity and creativity
• Create and maintain optimal data pipeline architecture
• Author detailed and comprehensible documentation of data pipelines and technical solutions
• Ensure data quality and completeness

Required Skills / Experience:

• Advanced working SQL knowledge and experience working with relational databases, query authoring
• A successful history of manipulating, processing and extracting value from large, disconnected datasets
• Ideally, 3+ years of experience in a Data Engineer role or equivalent using SQL and/or Python
• Good organizational skills and attention to detail
• Excellent critical thinking skills to flag complex data challenges
• Experience with cloud technologies and Python is a plus
• Comfortable working in fast paced, highly collaborative environment
• Ability to effectively communicate to different target audiences

Technical Skills: Technical Skills                                                 Proficiency Level                                      Required (R) / Optional (O)
SQL                                                                            4                                                                      R
Relational SQL databases                                         3                                                                       R
Data integrations services
(SSIS, Azure Data Factory, etc.)                                 2                                                                      R
Microsoft Excel                                                           3                                                                       R
Python, Scala, C++, Java or similar                           2                                                                       O
Snowflake or other cloud-based data warehouse      3                                                                       O
NoSQL databases / unstructured data                       2                                                                       O
Azure cloud services                                                  1                                                                       O
 Education:

• BS in Computer Science, Information Technology degree, Data Analytics or equivalent