Search by job, company or skills

N

Data Engineer Python , SQL

Save
  • Posted 5 days ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Job Specifications

  • Education – At least graduate with a Bachelor's or Master's Degree in IT, Computer Science, Engineering, or any related course.
  • Related Work Experience – at least 5 years of experience in data engineering, data analytics, or related fields.
  • Proficiency in Python and Java, with experience in other programming languages as a plus.
  • Hands-on experience with data manipulation tools (e.g., pandas, dplyr, or Spark).
  • Proficiency in Extract, Transform, and Load (ETL) processes for efficient data pipeline management.
  • Expertise in both SQL and NoSQL query languages for database interaction and management.
  • Experience with big data storage and processing solutions, such as MongoDB, Spark, Hive, Snowflake, Redshift, or similar technologies.
  • Experience with cloud-based or server-based data processing environments (e.g., AWS, Azure, GCP).
  • With experience in Apache Nifi (nice to have)

Knowledge – Knowledgeable In The Following

  • Comprehensive understanding of data manipulation tools such as pandas, dplyr, and Spark.
  • In-depth knowledge of big data frameworks and tools like Apache Spark and Hadoop.
  • Familiarity with data warehousing services like AWS Redshift, Snowflake, or similar solutions.
  • Proficiency in AWS Cloud Services, particularly AWS Glue and AWS Lake Formation.
  • Familiarity with business intelligence tools such as Tableau, Power BI, QuickSight, or Google Data Studio.
  • Awareness of data visualization libraries and packages like Dash, Plotly, Matplotlib, ggplot, and Folium.
  • Understanding of machine learning libraries and tools is a plus.
  • Knowledge of data governance, quality control, and security best practices.
  • Skills
  • Problem-Solving: Ability to address technical challenges and deliver efficient data solutions.
  • Communication: Clear and concise communication skills for collaborating with team members and stakeholders.
  • Collaboration: Ability to work effectively within a team environment to achieve shared goals.
  • Time Management: Capacity to manage tasks and meet deadlines in a structured and timely manner.
  • Attention to Detail: Careful and accurate handling of data to ensure quality and integrity.
  • Client-Focus: Ability to understand business needs and align data solutions to support decision-making and strategic objectives.
  • Adaptability: Flexible and open to learning new tools, technologies, and processes in a rapidly changing environment.

Minimum Qualifications

  • Design, build, and maintain scalable, secure data pipelines and storage systems; ensure data quality through ETL processes and regular checks.
  • Implement policies and practices to control, optimize, and secure data assets, ensuring data integrity and accessibility.
  • Develop and maintain data models, structures, and databases to meet business needs; communicate data architecture effectively.
  • Develop, test, and maintain scripts and programs to automate data processing and pipelines, adhering to industry standards.
  • Create and operationalize data visualization solutions to simplify complex data for stakeholders and decision-making.
  • Work with cross-functional teams to gather data requirements, optimize existing processes, and deliver ad hoc reports and insight

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 151334027

Similar Jobs

Taguig, Philippines

Skills:

Microsoft AzurePythonLangGraphLangChainAI ML concepts

Taguig, Philippines

Skills:

snowflake Java DevelopmentAws ServicesAmazon KinesisAWS GlueKafkaCursorSqlApache AirflowCloud InfrastructureRestful ApisDevOps practicesdata warehousing platformsGitHub CopilotAmazon QRelational Databasesmicroservices architectureAI-assisted development toolsCI CD pipelinesapplication and data integration toolsControl-Mmessaging and streaming technologiesServerless Architecture

Taguig, Philippines

Skills:

NunitSQL ServerData WarehousingSplunkCosmos DBApi IntegrationXunitSqlAzure SqlEtl

Taguig, Philippines

Skills:

Oracle Sql ServerMySQLPl SqlApiData BackupSqlSql Scriptingdatabase design documentationSnowflake Database Administrationdatabase standards

Taguig, Philippines

Skills:

oracle data pump GitOracle Pl SqlSql LoaderBashShell ScriptingSql Performance TuningJIRAUnix LinuxOracle Retail applicationsKornShell