Primary Responsibilities:
- QE & Automation Foundations
- Solid QE fundamentals: test strategy, test planning, defect lifecycle
- Functional, integration, regression testing
- API testing (REST, JSON, Postman)
- Test automation using Python / JavaScript
- CI/CD awareness (Git, pipelines, build verification)
- Log analysis & debugging (CloudWatch / centralized logging)
- Conversational AI Testing
- Intent, utterance, slot/entity testing (Amazon Lex or similar)
- Multi turn conversation validation
- Context & session management testing
- Interruptions, re phrasing, intent switching
- Fallback, disambiguation, error handling scenarios
- Voice vs Chat behavior differences (ASR errors, latency, barge in)
- Bot → Agent handoff validation
- Agentic AI Testing
- Clear understanding of agentic behavior (plan → reason → act → observe)
- Testing non deterministic responses
- Multi step workflow validation
- Tool / API invocation correctness by agents
- Agent memory & state validation across turns
- Boundary based validation (acceptable vs unacceptable outcomes)
- Guardrail enforcement testing (what agent must NOT do)
- LLM & Prompt Quality Engineering
- Prompt structure understanding (system vs dynamic prompts)
- Prompt regression testing
- Prompt versioning & rollback validation
- Hallucination detection & containment
- Response tone, empathy, policy compliance validation
- Safety, toxicity, and unsafe response testing
- Production Readiness & Observability
- AI production defect RCA
- Monitoring AI KPIs:
- Containment rate
- Escalation rate
- Conversation success/failure
- Hallucination incidents
- Latency, retries, throttling, timeout scenarios
- Release readiness sign off for AI systems
- Security, Privacy & Compliance
- PII / PHI masking validation
- Data boundary validation (what is sent to LLM vs retained)
- Prompt leakage risk testing
- Secure handling of logs and conversation transcripts
- Compliance aware test scenarios (healthcare grade rigor)
- Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
Required Qualifications:
- Agentic AI & LLM Expertise (3–5+ years)
- Hands-on experience building AI agents using RAG, prompt engineering, and multi-step workflows
- Strong Programming & Full Stack Skills (5+ years)
- Proficiency in Python and Node.js/TypeScript with experience deploying production-ready applications
- AI/ML & NLP Foundation (3–5+ years)
- Solid background in machine learning, deep learning, and NLP/NLU
- AI Testing & Prompt Engineering (2–4+ years)
- Experience handling non-deterministic outputs, prompt optimization, and AI evaluation
- Cloud & Integration Experience (3–5+ years)
- Hands-on experience with AWS/Azure and integrating APIs and enterprise systems
What we offer
- Market Competitive Pay Levels
- Retirement Plan
- Medical Plan (HMO) from Day 1 of employment
- Dental, Medical, and Optical Reimbursements
- Life and Disability Insurance
- Paid Time-Off Benefits
- Sick Leave Conversion
- Tuition Fee Reimbursement
- Employee Assistance Program (EAP)
- Annual Performance Based Merit Increases
- Employee Recognition
- Training and Staff Development
- Employee Referral Program
- Employee Volunteerism Opportunity
- All Mandatory Statutory Benefits
Who we are
Optum is the health care technology and innovation company of the UnitedHealth Group enterprise along with UnitedHealthcare.
As part of a Fortune 5 enterprise, we are improving the health care experience of over 125 million people around the world.
We're a diverse team with operations across North America, South America, Europe, Asia Pacific and the Middle East. This includes our over 14,000 employees in the Philippines.
Elevate your career with a leading health care company while improving lives.
Join us in evolving health care so everyone can have the opportunity to live their healthiest life. This is your opportunity to be part of a team that's dedicated to Caring. Connecting. Growing together.
