Search by job, company or skills

Artech Infosystems Private Limited

Senior Data Engineer

Save
  • Posted 2 days ago
  • Be among the first 20 applicants
Early Applicant
Quick Apply

Job Description

Job Title: Sr. Data Engineer

Summary:

As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems. You will collaborate with cross-functional teams to enhance data accessibility and usability, contributing to the overall data strategy of the organization.

Roles & Responsibilities:

- Expected to be an SME.

- Collaborate and manage the team to perform.

- Responsible for team decisions.

- Engage with multiple teams and contribute on key decisions.

- Provide solutions to problems for their immediate team and across multiple teams.

- Develop and optimize data pipelines to ensure efficient data flow and processing.

- Monitor and troubleshoot data quality issues, implementing corrective actions as necessary.

- Document data processes and workflows to ensure clarity and compliance with best practices.

Professional & Technical Skills:

- Required Skill: Expert proficiency in Databricks Unified Data Analytics Platform.

- Additional Good To Have Skills: Experience with Python (Programming Language).

- Strong understanding of data modeling and database design principles.

- Experience with ETL tools and data integration techniques.

- Familiarity with cloud platforms and services related to data engineering.

- Proficient in data warehousing concepts and practices.

Must have and Good to have skills:

- Databricks (Unity Catalog, Delta Live Tables, Auto Loader)

-Python, Pyspark

-SQL

-Azure Data Factory

Bachelors/ Degree

About Company

Artech is the largest Women & Minority owned IT staffing firm in the US, with US$ 800 million annual revenue run rate in 2021 and a footprint across the globe. With nearly three decades of experience, Artech empowers businesses through applied human intelligence and offers a spectrum of services that include Workforce Solutions (Contingent Staffing, Bulk/ Project Staffing, Master Vendor, RPO, Direct Hire and Payroll Transition) and Project-Based Solutions (Digital Experience, Technical Operations, Technical Development, Business Operations & Digital Platforms). Artech works with over 90 Fortune 500 clients across USA, Canada, India, and China.

Job ID: 149219303

User Avatar
0 Active Jobs

Similar Jobs

Remote

Skills:

data engineering snowflake SqlETL/ELTAI/ML

Remote

Skills:

snowflake AdfTableauData WarehouseSql

Remote

Skills:

data engineering PythonPysparkAWS GlueDockerAWS Batch

Remote

Skills:

and query tuning.and optimize Snowflake-based data warehouse solutions.• Develop and maintain modular DBT models (stagingand marts).and Git-based workflows.and architecture teams to deliver reliable data solutions.Security & Performance Optimization ? DBT (Data Build Tool) ? Advanced SQL ? Data Modeling & Data Warehouse Architecture ? ETL / ELT Development ? SnowpipeStreams & Tasks ? Git & CI/CD ? Unix/Linux Shell Scripting ? Control-MStreamsClusteringAutosysOptimize Snowflake performance using SnowpipeTasksDesignDevelopIntermediateBuild scalable ETL/ELT pipelinesImplement CI/CD pipelinesAnalyticsBusinessenterprise data modelsincluding Star SchemaSnowflake Schemaand Fact/Dimension modelingSnowflake ArchitectureAirflowor similar orchestration tools

Remote

Skills:

Data GovernanceCollibraApache AtlasCloud Data ServicesMicrosoft PurView