Search by job, company or skills

Information Professionals, Inc. (IPI)

Senior Data Engineer (ETL & Analytics)

new job description bg glownew job description bg glownew job description bg svg
  • Posted a month ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, or related field.
  • 4 years of relevant experience inETL development,data integration, andsystem analysis, with strong expertise inSSISandT-SQL.
  • Advanced skills indata profiling,data modeling, anddata migration strategies; exposure tocloud ETL tools(AWS Glue, Azure Data Factory, Google Cloud Dataflow) is a plus.
  • Proficiency inPython (with Pandas)for scripting and automation; familiarity withC# for SSIS scriptingis desirable.
  • Strong knowledge ofdata warehousing principles,performance tuning, anddatabase concepts.
  • Experience withdata visualization tools(Power BI, SSRS, Tableau, Excel) for reporting and analytics.
  • Excellent analytical, problem-solving, and communication skills; ability to manage multiple tasks and work effectively under pressure.

Duties and responsibilities:

  • Collaborate with business stakeholders to gather, analyze, and document complex data requirements, translating them into technical specifications and data mapping documents.
  • Conduct comprehensive data profiling and analysis on source systems to assess data structures, content, quality, and integration challenges.
  • Validate ETL outputs through detailed data analysis, ensuring compliance with business rules and data quality standards.
  • Design scalable and efficient ETL architectures and data models (conceptual, logical, physical) to support reporting, analytics, and data migration initiatives.
  • Prepare and maintain IT documentation, including design specifications and data flow diagrams throughout the project lifecycle.
  • Develop, implement, and optimize ETL processes using SQL Server Integration Services (SSIS) or similar tools, ensuring data integrity and performance.
  • Write and optimize complex T-SQL queries, stored procedures, and functions for data extraction, transformation, and loading.
  • Perform unit testing and support integration and user acceptance testing (UAT) for ETL solutions.
  • Monitor, troubleshoot, and resolve ETL job failures, data discrepancies, and performance issues; conduct root cause analysis and recommend sustainable solutions.
  • Create and maintain data integration tools, utilities, and scripts to automate workflows.
  • Provide production support for ETL jobs related to Risk and Credit systems, ensuring timely and accurate data delivery for regulatory reporting and financial models.
  • Manage incident response and resolution in production environments.
  • Design and develop data visualizations, reports, and dashboards using Power BI, SSRS, or Excel to deliver actionable insights.
  • Apply best practices in data visualization for clarity and impact.
  • Ensure proper data management, including database permissions, backup/recovery strategies, security protocols, and performance monitoring.
  • Act as a subject matter expert in data integration and analysis, providing technical guidance to development teams and business users.
  • Participate in workshops and meetings to gather requirements, present technical solutions, and share data insights.
  • Collaborate effectively within a team environment, promoting knowledge sharing and best practice

More Info

Job Type:
Industry:
Employment Type:

Job ID: 139503283