Data Engineer
- Posted a day ago
- Be among the first 10 applicants
Job Description
Data Engg Job description:
Experience and expertise in
- Pipeline/ETL (Extract, Transform, Load) processes, API integration, scripting languages (Python), and big data technologies (Trio, Iceberg, DuckDB/Parquet).
- Database design, data modeling, and data warehousing. SQL and at least one cloud platform.
- Analytical tools (Superset, Power BI), statistical analysis, and SQL. To derive insights from data.
- Data governance principles and data quality.
- Data management, data integration projects using IPAAS tools like IBM Sterling, Mulesoft, Dell Boomi
Location-Bangalore/Pune
Experience-5-10 yrs
More Info
Key Skills
data governance principles
Parquet
Trio
IPAAS tools
Iceberg
DuckDB
Superset
About Company
Skills:
Sqlalchemy, Yaml, Git, Pandas, MySQL, PostgreSQL, Python, Sql, Airflow
Skills:
snowflake , Automated Testing, ELT, Python, Java, BigQuery, Sql, Data Quality, Presto, Spark, Api, Databricks, Etl, Privacy, infrastructure automation, CI CD, Security, Trino, lineage governance, metadata, Retention, production observability, event-driven architectures, Regulatory Compliance
Skills:
Java, Git, Rest Apis, Gcp, Azure, Sql, Python, Kubernetes, CI/CD, Cognite Data Fusion®
Skills:
Google Cloud Platform (GCP), BigQuery, Dataproc, Sql, Cloud Storage, Terraform, DataFlow, Python, Cloud Functions, DevOps practices, ETL ELT pipeline development, Pub Sub, Cloud Composer, CI CD pipelines
Skills:
snowflake , SAP, Redshift, Sql, Python, Celonis, PQL