N
.Data Engineer
N
- Posted 10 days ago
- Be among the first 10 applicants
Job Description
Requirements
Minimum Qualifications:
- 3+ years of experience in Data Engineering or a related role.
- Hands-on experience with Databricks and Apache Iceberg.
- Strong SQL and Python skills.
- Experience with Spark/PySpark and distributed data processing.
- Strong understanding of Data Lake/Lakehouse architecture.
- Experience with cloud platforms such as AWS, Azure, or GCP.
- Knowledge of ETL/ELT, data modeling, and data pipeline development.
- Experience with Delta Lake, Kafka, or other data technologies is an advantage.
Minimum Qualifications:
- Design, build, and maintain scalable data pipelines and data platforms.
- Develop and optimize data processing workflows using Databricks and Apache Iceberg.
- Build and manage batch and streaming data pipelines.
- Work with data lake/lakehouse architectures and ensure data quality, reliability, and performance.
- Integrate data from multiple sources and transform it for analytics and business use.
- Implement data governance, security, monitoring, and optimization practices.
- Collaborate with Data Architects, Analysts, and other engineering teams to deliver data solutions.
More Info
Key Skills
About Company
Skills:
data quality assurance , Sql, FastAPI, Python, Cloud platforms, ETL data pipeline architecture, Data validation frameworks, Non-regression testing, Observability monitoring, GitHub Actions, CI CD pipelines, Backend APIs
Skills:
data engineering , snowflake , databricks, Apache Spark
Skills:
Pyspark, test automation, Kafka, Adobe Analytics, Sql, Apache Airflow, Gcp, DataFlow, Google Analytics, Azure, Python, AWS, Etl, CI CD, Pub Sub, Snowplow, dbt
Skills:
containerization , Cloud Technologies, Sql, Python, Etl, ELT
Skills:
Azure Data Factory, Data Lake, Databricks, SSIS, Azure Sql, Sql, Azure DevOps, ELT, Etl, CI CD pipelines