Search by job, company or skills

GoTeam

Senior Data Engineer

5-7 Years
Save
new job description bg glownew job description bg glownew job description bg svg
  • Posted 20 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Senior Data Engineer – Web Scraping & Reliability (Up to ₱150K | Remote | Night Shift | FREE AI Certification)

Remote | Night Shift | 10:00 PM–7:00 AM | Monday–Friday

ROLE SNAPSHOT

You own the end-to-end reliability of a large-scale web data acquisition pipeline processing tens of millions of scrapes per month. You are responsible for maintaining system uptime, reducing failures, and building resilient infrastructure that bypasses sophisticated anti-bot protections and authentication walls.

We are looking for the missing piece in our client's engineering team—a specialist who genuinely enjoys the technical challenge of extracting large-scale data and navigating sophisticated bot protections. You will be the go-to expert who ensures our operations run smoothly, allowing the rest of the team to focus on core product features. You don't just wait for things to break; you proactively suggest and implement improvements to stay ahead of an ever-changing web landscape.

YOU'RE LIKELY A STRONG FIT IF YOU HAVE

  • 5+ years of software development experience with significant exposure to web scraping or data acquisition at scale.
  • Deep Scraping Expertise: Proficiency with headless browsers, CDP (Chrome DevTools Protocol), proxy management, and CAPTCHA mitigation.
  • Anti-Bot Evasion: Proven experience handling authenticated sessions and navigating complex anti-bot strategies.
  • Observability Skills: Experience building and maintaining monitoring, alerting, and observability systems for production infrastructure.
  • Technical Agility: Ability to pick up new languages quickly; while the core codebase is Ruby, we value the ability to work across diverse tools and libraries.
  • Structural Constraints: Proven reliability working a fixed night shift (10:00 PM – 7:00 AM) in a 100% remote capacity.

STRONG SIGNALS

  • A Scraping Enthusiast: Someone who truly wants to do this type of work on a regular basis and stays on top of best practices.
  • Proactive Ownership: A mindset that looks at operations and suggests better ways to build, rather than just waiting for tasks.
  • Resilience: The ability to handle firefighting days with urgency while using quiet days to experiment with new technologies and tackle the backlog.

RESPONSIBILITY PILLARS

Infrastructure Reliability & Uptime You own the heartbeat of the data acquisition pipeline—ensuring tens of millions of pages are scraped successfully.

  • Monitor scraping and API success rates to identify and resolve issues before they cascade.
  • Respond to system outages with urgency, diagnosing root causes and deploying fixes.
  • Build better alerting and redundancies to reduce manual intervention over time.

Platform Evolution & Research You ensure the scraping infrastructure stays ahead of an ever-changing web landscape.

  • Evaluate and experiment with new scraping technologies and anti-bot evasion libraries.
  • Proactively improve data retrieval resilience, including handling unique authentication wall challenges.
  • Build dashboards and tooling to provide clear visibility into system health and performance.

Architectural Collaboration & Ownership You operate as a technical lead for the data acquisition mission.

  • Collaborate with the senior team on major architectural decisions.
  • Exercise autonomy to move fast on day-to-day improvements without constant supervision.
  • Communicate technical failures and status updates clearly to both engineering and non-engineering stakeholders.

ABOUT THE COMPANY

A U.S.-based shipping spend management organization provides analytics and automation tools to help enterprise brands reduce inefficiencies. Known for long-term technical stability and a mature engineering culture, offshore teams operate with high autonomy, defined missions, and predictable review cycles within a remote-first structure.

WHAT THIS ROLE GIVES YOU (VALUE + PAY)

ACCELERATE YOUR PERSONAL GROWTH

  • Company-provided laptop + second monitor
  • Industry-best HMO for 1 dependent + extended dependents (₱200,000 coverage, private room, ₱10,000 meds reimbursement)
  • Option to enroll up to 4 additional dependents via salary deduction
  • ₱1M life insurance coverage
  • Membership in GoTeam Sports Club, Yoga, and Wellness Programs

UNLOCK YOUR POSSIBILITY

  • Prorated 5 days Vacation Leave + 5 days Sick Leave upon regularization
  • 5 service incentive leave (SIL) days after your first work anniversary
  • Salary loan access (post-regularization)
  • Employee discounts, raffles, and Day-1 welcome gift
  • Opportunity to win a trip to Bali through company programs

LIVE YOUR PURPOSE

  • Join GoTeam Cares volunteer programs
  • ₱10,000 referral bonus + Opportunity to win a trip to Bali
  • Monthly gratitude events, team dinners, and leadership talks

YOUR FAMILY'S BENEFITS

  • 24/7 financial, legal, and counseling support (up to 4 family members)
  • Free telemedicine consultations
  • Virtual family events and prize opportunities

OUR HIRING PROCESS

What Happens After You Click Apply

When you click Apply, you'll be taken to Multiplai Interview Room.

Our AI-powered, self-guided interview experience designed to be fair, flexible, and stress-free. You can start immediately or complete it later at a time that works for you.

What you'll need:

  • Stable internet connection
  • Desktop or laptop
  • Headset

You'll answer interview questions at your own pace—no live interviewers, no surprise questions, and no pressure. Once completed, the platform generates an AI-assisted summary of your responses, and one of our recruiters will follow up with next steps.

Go Beyond Employment: Build a Future-Proof Career

We're calling on 100,000 Filipino professionals to lead the AI revolution.

Get Your FREE AI Certification

Join Project 100K – AI Certification for the Philippines, powered by GoTeam.

Equip yourself with global-ready skills — 100% free.

Claim your spot now: Project 100K - AI Certification for the Philippines

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 147182099

Similar Jobs

Philippines

Skills:

google sheets Web ScrapingApisCsvJsData CleaningJsonSeleniumProxiesPythonAJAXdynamic contentLLMsNormalizationBeautifulSoupValidationAI frameworks