- Posted a month ago
- Over 200 applicants have applied
Job Description
- Design, develop, and optimize data pipelines using Azure Synapse Analytics, Spark Pools, and Azure Data Factory.
- Write efficient Python and SQL code with a focus on scalability, performance, and optimization.
- Manage Azure Data Lake for structured and unstructured data ingestion at scale (volume, variety, velocity).
- Implement CI/CD pipelines and follow Data Ops practices for automation and reliability.
- Optimize data partitioning, versioning, and storage/compute costs for large-scale workloads.
- Ensure high-quality solutions through unit testing frameworks and automated validation.
- Collaborate with business teams to support analytics, reporting, and data science initiatives.
- Mentor junior engineers, sharing knowledge and promoting engineering excellence.
- Bachelor s degree in computer science, IT, Data Engineering, or a related field.
- 5+ years of experience in data engineering roles with proven expertise in cloud data platforms.
- Expert in Python and SQL, with strong performance optimization skills.
- Proficiency in Azure Synapse Analytics, Spark Pools, and Azure Data Factory (ADF).
- Hands-on experience with Azure Data Lake and structured ingestion at scale.
- Experience in CI/CD pipelines and applying Data Ops principles.
- Ability to manage large datasets with diverse structures, velocity, and volume.
Good to Have Skills
- Experience with Delta Lake, versioned data, and advanced partitioning strategies.
- Knowledge of data governance and security implementations across platforms.
- Strong understanding of advanced data modelling (e.g., slowly changing dimensions).
- Exposure to cost optimization strategies for cloud storage and compute.
- Experience mentoring or providing technical leadership to junior engineers.
More Info
Key Skills
About Company
ProArch Technologies: Catalyzing Digital Transformation for Enterprise Advancement
ProArch Technologies LLC stands as a premier global provider of strategic information technology consulting and bespoke solutions, catering to organizations of all scales. We specialize in critical infrastructure development and seamless migrations, robust SAP and Oracle development and quality assurance, scalable cloud implementations, optimized network services, and insightful analytics. Our profound expertise empowers clients to capitalize on emerging technologies and refine core business processes, ensuring sustained success and competitive advantage in the dynamic digital economy.
At ProArch, our commitment is to drive innovation that yields tangible efficiencies and optimizes cost structures for our clientele. Our distinguished team of experts is dedicated to equipping businesses with transformative technologies and streamlined operational frameworks, positioning them as leaders within their respective sectors.
We are fundamentally guided by a strong appreciation for human capital, intellectual property, community engagement, and environmental stewardship, cultivating an organizational culture that champions continuous learning, collaborative knowledge exchange, and collective advancement. With a significant global footprint, we actively embrace the richness of diverse perspectives, cultures, and talents.
Integrity forms the bedrock of our corporate ethos, compelling us to uphold our commitments with unwavering honesty and an unyielding pursuit of excellence in every engagement
