Senior Data Engineer

Senior Data Engineer – Web Scraping & Reliability (Up to ₱150K | Remote | Night Shift | FREE AI Certification)

Remote | Night Shift | 10:00 PM–7:00 AM | Monday–Friday

ROLE SNAPSHOT

You own the end-to-end reliability of a large-scale web data acquisition pipeline processing tens of millions of scrapes per month. You are responsible for maintaining system uptime, reducing failures, and building resilient infrastructure that bypasses sophisticated anti-bot protections and authentication walls.

We are looking for the missing piece in our client's engineering team—a specialist who genuinely enjoys the technical challenge of extracting large-scale data and navigating sophisticated bot protections. You will be the go-to expert who ensures our operations run smoothly, allowing the rest of the team to focus on core product features. You don't just wait for things to break; you proactively suggest and implement improvements to stay ahead of an ever-changing web landscape.

YOU'RE LIKELY A STRONG FIT IF YOU HAVE

• 5+ years of software development experience with significant exposure to web scraping or data acquisition at scale.
• Deep Scraping Expertise: Proficiency with headless browsers, CDP (Chrome DevTools Protocol), proxy management, and CAPTCHA mitigation.
• Anti-Bot Evasion: Proven experience handling authenticated sessions and navigating complex anti-bot strategies.
• Observability Skills: Experience building and maintaining monitoring, alerting, and observability systems for production infrastructure.
• Technical Agility: Ability to pick up new languages quickly; while the core codebase is Ruby, we value the ability to work across diverse tools and libraries.
• Structural Constraints: Proven reliability working a fixed night shift (10:00 PM – 7:00 AM) in a 100% remote capacity.

STRONG SIGNALS

• A Scraping Enthusiast: Someone who truly wants to do this type of work on a regular basis and stays on top of best practices.
• Proactive Ownership: A mindset that looks at operations and suggests better ways to build, rather than just waiting for tasks.
• Resilience: The ability to handle firefighting days with urgency while using quiet days to experiment with new technologies and tackle the backlog.

RESPONSIBILITY PILLARS

Infrastructure Reliability & Uptime You own the heartbeat of the data acquisition pipeline—ensuring tens of millions of pages are scraped successfully.

• Monitor scraping and API success rates to identify and resolve issues before they cascade.
• Respond to system outages with urgency, diagnosing root causes and deploying fixes.
• Build better alerting and redundancies to reduce manual intervention over time.

Platform Evolution & Research You ensure the scraping infrastructure stays ahead of an ever-changing web landscape.

• Evaluate and experiment with new scraping technologies and anti-bot evasion libraries.
• Proactively improve data retrieval resilience, including handling unique authentication wall challenges.
• Build dashboards and tooling to provide clear visibility into system health and performance.

Architectural Collaboration & Ownership You operate as a technical lead for the data acquisition mission.

• Collaborate with the senior team on major architectural decisions.
• Exercise autonomy to move fast on day-to-day improvements without constant supervision.
• Communicate technical failures and status updates clearly to both engineering and non-engineering stakeholders.

ABOUT THE COMPANY

A U.S.-based shipping spend management organization provides analytics and automation tools to help enterprise brands reduce inefficiencies. Known for long-term technical stability and a mature engineering culture, offshore teams operate with high autonomy, defined missions, and predictable review cycles within a remote-first structure.

WHAT THIS ROLE GIVES YOU (VALUE + PAY)

ACCELERATE YOUR PERSONAL GROWTH

• Company-provided laptop + second monitor
• Industry-best HMO for 1 dependent + extended dependents (₱200,000 coverage, private room, ₱10,000 meds reimbursement)
• Option to enroll up to 4 additional dependents via salary deduction
• ₱1M life insurance coverage
• Membership in GoTeam Sports Club, Yoga, and Wellness Programs

UNLOCK YOUR POSSIBILITY

• Prorated 5 days Vacation Leave + 5 days Sick Leave upon regularization
• 5 service incentive leave (SIL) days after your first work anniversary
• Salary loan access (post-regularization)
• Employee discounts, raffles, and Day-1 welcome gift
• Opportunity to win a trip to Bali through company programs

LIVE YOUR PURPOSE

• Join GoTeam Cares volunteer programs
• ₱10,000 referral bonus + Opportunity to win a trip to Bali
• Monthly gratitude events, team dinners, and leadership talks

YOUR FAMILY'S BENEFITS

• 24/7 financial, legal, and counseling support (up to 4 family members)
• Free telemedicine consultations
• Virtual family events and prize opportunities

OUR HIRING PROCESS

What Happens After You Click Apply

When you click Apply, you'll be taken to Multiplai Interview Room.

Our AI-powered, self-guided interview experience designed to be fair, flexible, and stress-free. You can start immediately or complete it later at a time that works for you.

What you'll need:

• Stable internet connection
• Desktop or laptop
• Headset

You'll answer interview questions at your own pace—no live interviewers, no surprise questions, and no pressure. Once completed, the platform generates an AI-assisted summary of your responses, and one of our recruiters will follow up with next steps.

Go Beyond Employment: Build a Future-Proof Career

We're calling on 100,000 Filipino professionals to lead the AI revolution.

Get Your FREE AI Certification

Join Project 100K – AI Certification for the Philippines, powered by GoTeam.

Equip yourself with global-ready skills — 100% free.

Claim your spot now: Project 100K - AI Certification for the Philippines