Hadoop, Pyspark, Kafka, Hive, Linux, Sqoop, Spark, Apache Beam, Python, data fusion, CI-CD pipelines, Google Cloud Storage

Java, Hadoop, Scala, AWS Glue, Data Quality, Emr, Data Modeling, Sql, ELT, Hive, Data Integration, Spark, Python, Etl, AI capabilities, data presentation, Data pipelines

databricks, Sql, aws, Azure, Etl, elt, Airflow

Apache Spark, Kafka, Apache Airflow, Pandas, Elasticsearch, MongoDB, pgvector, Polars, Vector databases, Qdrant, NoSQL databases, Data models and storage architectures, Distributed data systems, Data processing performance and optimisation, Data pipelines, Milvus

Python, Sql, Airflow, Temporal, Statistical Judgement, Dagster, Prefect

Java, T-sql, Hadoop, Scala, SQL Server, Kafka, Sql, Jenkins, Azure Data Factory, Docker, Terraform, Spark, Databricks, Azure, Kubernetes, Python, AWS, Airflow, ATLAS, Great Expectations, Glue, Delta Lake

snowflake , Github, Aws Redshift, Google Cloud Platform, Pyspark, Data Warehousing, Dimensional Modeling, Sql, Devops, Data Governance, Databricks, Microsoft Azure, Python, AWS, data pipelines, Google BigQuery, ETL processes