
Search by job, company or skills
Role** Data Engineer
Required Technical Skill Set** Python , Pyspark, GCP, BigQuery , Astronomer
Desired Experience Range** 6+ years
Location of Requirement Bangalore
Desired Competencies (Technical/Behavioral Competency)
Must-Have**
(Ideally should not be
more than 3-5)
· Development, Production Support and delivery of Python, BigQuery, SQL, GCP, Airflow based applications.
· Resource should have experience in Astronomer DAGS, Python, Pyspark, GCP, BigQuery.
· Collaborate with cross-functional teams including designers, product owners, managers, and stakeholders.
· Execute the unit testing to produce defect-free software.
· Ensuring test coverage and creating test methods.
· Creating documentation on modules/enhancements developed.
· Experience on Airflow, Python coding, BigQuery concepts.
· Functional knowledge of billing automations.
· Ensure high quality code standards, security, & performance optimization.
· Agile Methodology and prior experience of implementation with Agile way of working.
· Stay with current trends and new technologies.
Good-to-Have
· Strong knowledge of Python, BigQuery, SQL, GCP, Airflow, Pyspark, Astronomer, Git, Code Version Management
· Strong knowledge of data structures
· Hands on experience in working with NoSQL databases, Firebase, GCP.
· Excellent leadership and mentorship skills
· Strong communication skills
· Ability to work in fast paced and dynamic environment
· Strong problem-solving skills
· Strong commitment towards delivering high quality software solutions.
Job ID: 151863665
Skills:
Pyspark, Git, Gcp, Python, Sql, Firebase, Big Query, Airflow, NoSQL databases
Skills:
Spark, Sql, Spring Batch, Java, Python, Kubernetes, Elasticsearch, Kafka, Airflow, dbt
Skills:
secure coding , Sql, Spring Batch, Data Modeling, Java, Python, Elasticsearch, Airflow, dbt
Skills:
Unsupervised Learning, Tensorflow, MLops, Pytorch, Docker, Kubernetes, Python, data preprocessing, GANs, Hugging Face Transformers, autoregressive models, efficient optimized code, reinforcement learning, prompt engineering, end-to-end AI model deployment pipelines, VAEs, diffusion models
Skills:
Docker, Redis, ADO, FastAPI, Mssql, Python, Azure, Git, Celery, MongoDB