Data Engineer

Qualifications

• Designs and builds data storage solutions including database objects and data structures, data ingestion pipelines
• Develops data transformation, cleansing, and preparation processes.
• Perform job optimization/automation via code enhancement, configuration, or implementation of new tools/technology
• Perform unit testing and system integration testing.
• Maintain and monitor platform stability and performance of EDP. Execute updates, patches, and other activities required to maintain and enhance operations.
• Ensures compliance with governance standards of the platform, security policies, and SDLC processes.
• Collaborate with cross-functional teams to identify data needs and opportunities for improvement
• Develop and maintain documentation related to data engineering and analytics processes and procedures
• Perform Proof of Concept on new integration and analytic patterns and solutions
• Contribute to best practices and standards for the data engineering team

Must-Have Skills & Experience

• Experience on Data projects is a MUST (at least 1 end to end project)
• Experience in using Databricks and Azure (certifications preferred)
• Experience in SQL, Python (Pyspark)
• Knowledge in Data Warehouse and Data Mart concepts and query optimization techniques
• Preferably local resource that can report 5x onsite

Nice-To-Have Skills & Experience

• Familiarity with Power BI