Job Description
We are hiring a Data Engineer focused on expanding and maintaining our data coverage. You will be responsible for connecting new data sources and ensuring they are reliably integrated into our pipelines.
We have a large and growing list of sources to onboard. Your role is to turn these into stable, recurring data flows that continuously deliver fresh, structured data.
Responsibilities
- Data ingestion and integration - Connect new data sources through APIs or scraping, transform them into our data model, and ensure they are reliably integrated into our pipelines.
- Automation and reliability - Build and maintain recurring pipelines that keep data up to date, monitor performance, and ensure stability across all connected sources.
- Data quality and structure - Ensure incoming data meets our quality standards, is properly structured, and fits seamlessly into our existing datasets.
- Scalability and maintenance - Continuously improve and maintain existing integrations, making them robust, reusable, and easy to extend as we scale coverage.
Qualifications
- 5+ years of hands-on experience in data engineering or backend development
- Strong experience with Python in production environments
- Proven experience with web scraping and API integrations
- Experience with Databricks or similar data platforms
- Ability to work pragmatically and deliver at a fast and steady pace
- Fluent in English (near-native level)
- High ownership and ability to work independently in a remote setup
Additional Information
- Homebased
- M to F, 1pm to 10pm PH Time