Search by job, company or skills

Sr Data Engineer

Sr Data Engineer

Dynatrace
6-8 Years
Not Disclosed
Early Applicant
  • Posted 12 days ago
  • Be among the first 10 applicants

Job Description

Your role at Dynatrace

We are seeking an experienced Data Engineer to design, build, and optimize scalable data ingestion pipelines for product telemetry and enterprise business applications data. This role operates in a fast‑paced environment, rapidly prototyping data pipelines to enable data exploration, analytics, and downstream consumption.

Responsibilities

  • Design and implement modern data ingestion pipelines for business systems data using Fivetran, Python and Bulk APIs, S3-based lakehouse architectures, and streaming ingestion (Kafka, Spark)
  • Build end-to-end automated pipelines from source systems to Snowflake, ensuring reliability, scalability, and observability
  • Apply advanced SQL in Snowflake for transformation, standardization, and preparation of analytics-ready datasets
  • Optimize ingestion performance for large-scale, high-volume datasets using API rate-limit handling, micro-batching, and incremental loading / CDC
  • Implement DevOps and CI/CD practices for data pipelines, including version control and deployment automation
  • Partner with analysts, SMEs, and platform teams to rapidly prototype pipelines supporting exploration and evolving requirements
  • Monitor, troubleshoot, and optimize ingestion jobs to ensure data freshness, accuracy, and performance

What Will Help You Succeed

  • 6+ years of hands-on experience in data engineering and ingestion automation in cloud or hybrid environments
  • Proven experience ingesting business application data (CRM, ERP, financial, consumption, renewals systems)
  • Advanced proficiency with Python and Fivetran (or similar ETL/ELT tool) for pipelines, automation, orchestration, and validation
  • Expertise with Kafka, Spark, and S3 / lakehouse-style storage architectures
  • Strong proficiency with Snowflake, ingestion, transformation, and performance optimization
  • Deep understanding of ingestion optimization, rate limits, micro-batching, incremental loads, and CDC
  • Experience applying DevOps / CI/CD practices to data pipelines
  • Ability to work independently and deliver solutions rapidly in a fast-paced, iterative environment

Desirable

  • Experience with additional open-source ingestion frameworks and connectors
  • Exposure to event-driven or telemetry-heavy architectures at scale

Why you will love being a Dynatracer

  • Dynatrace is a leader in unified observability and security.
  • We provide a culture of excellence with competitive compensation packages designed to recognize and reward performance.
  • Our employees work with the largest cloud providers, including AWS, Microsoft, and Google Cloud, and other leading partners worldwide to create strategic alliances.
  • You'll get to work at the forefront of innovation with Dynatrace Intelligence, the industry's first agentic operations system. Bringing together deterministic and agentic AI, it helps teams understand what's happening, why it matters, and what to do next, automatically.
  • Over 50% of the Fortune 100 companies are current customers of Dynatrace

More Info

Job Type:
Industry:
Employment Type:

Key Skills

deployment automation

micro-batching

incremental loading

S3-based lakehouse architectures

CI/CD

API rate-limit handling

About Company

Similar Jobs

5-10 yrs
Bengaluru, India
Skills:
Pyspark, Spark, Azure Databricks, Sql, Azure DevOps, Delta Lake, Event Hub
6-8 yrs
Bengaluru, India
Skills:
snowflake , Csv, AWS Glue, Json, Sql, Azure Data Factory, Pandas, Spark, Xml, Databricks, Python, Parquet, Polars, NoSQL databases, ETL workflow orchestration tools
5-8 yrs
Bengaluru, India
Skills:
BigQuery, Data Modeling, Sql, Data Quality, Cloud Storage, Git, Gcp, Testing, Python, Performance Optimization, Airflow, Cloud Functions, Code Reviews, CI CD, Pub Sub, Cloud Composer, Cloud Run
7-9 yrs
Bengaluru, India
Skills:
Nosql, Java, Lambda, Ec2, Scala, Dynamodb, Elastic Search, Nodejs, Python, Sql, AWS
5-7 yrs
Bengaluru, India
Skills:
Metadata Management, Data Lineage, Power Bi, Data Warehousing, Automated Testing, Sql, ELT, Gcp, Data Governance, Data Integration, Python, Etl, Source Control, Codex, Claude, Google BigQuery, data cataloging, medallion architecture