Data Engineer

We are looking for a skilled Data Engineer to join our Product Solution team. As a member of this team, you would be keenly interested in using your data engineering powers to help corporate drive meaningful and material outcomes for their ESG ambitions.

As a technical and data expert in data ingestion, data transformation and data modelling, you will collect, manage and transform large, complex and disparate data from multiple data sources into required data models and datasets that support interactive dashboards and reports. You will work closely with various stakeholders to understand their data needs and deliver automated solutions that meet them.

Responsibilities:

1. Design, develop, and maintain Data pipelines, Data Warehouse and Data Marts
2. Perform data extraction, transformation, and loading (ETL) processes.
3. Collaborate with stakeholders to understand their data needs.
4. Ensure the accuracy and reliability of data that are ingested in the data lake and transformed in the data marts that support multiple dashboards.
5. Work with data source owners to determine the most efficient methods of data collection.
6. Work with the dashboard developers and analysts to make sure the data is transformed and processed in the required format and data model for dashboarding.
7. Troubleshoot data-related issues and maintain the data pipelines and data warehouse infrastructure.
8. Stay updated with the latest data engineering trends, features, updates, and best practices.

Requirements:

1. Proficiency in SQL and Python would be very important.
2. Familiarity with other ETL tools like Azure Data Factory, SSIS, AWS Glue, Airflow, Pentaho, Fivetran would be an advantage.
3. Familiarity with databases like MariaDB, MySQL, Azure SQL Server, PostgreSQL, Amazon Redshift, Google BigQuery would be an advantage
4. Strong knowledge of relational database theory, data modelling and architecture.
5. Strong understanding of data ingestion and data engineering principles.
6. Excellent problem-solving skills and attention to detail.
7. Strong communication skills and working well in a team.
8. Keen desire to use the power of analytics to drive ESG goals for corporates

Preferred qualifications:

1. At least 2-4 years of data engineering experience.
2. Experience in a similar role.
3. Knowledge of ETL processes and data modelling.
4. Familiarity with other data engineering tools.
5. Solid experience with AWS or other cloud platforms
6. Experienced in web-application development, both front-end and back-end
7. Experience with B2B product development
8. Experience in ESG or sustainability-related projects (Nice to have)