General Overview of the Job:
A detail-oriented quality professional who owns testing across the delivery cycle and can challenge requirements before code is written. The role covers classic functional and regression work as well as the newer discipline of testing AI features, where correctness is probabilistic and edge cases matter more than happy paths.
Job Duties and Responsibilities:
- Design and build production AI agents in code on Azure AI Foundry and Azure OpenAI Service, using Python or C# and the relevant SDKs.
- Implement orchestration, tool and function calling, memory and retrieval-augmented generation with Semantic Kernel, the Azure AI Agent SDK or a comparable code framework.
- Integrate agents with Microsoft 365, SharePoint and line-of-business systems through Microsoft Graph and custom APIs, exposed as versioned, testable tools.
- Establish evaluation sets, grounding, guardrails and responsible-AI controls, together with monitoring and cost management in production.
- Work with business teams to turn process pain points into scoped agent use cases, and hand over documented, supportable code.
Required Skills and Proficiency:
- Azure AI Foundry and Azure OpenAI Service
- Agent tooling in code (function calling, Model Context Protocol, custom connectors)
- Agent orchestration frameworks (Semantic Kernel, AutoGen)
- Prompt engineering and retrieval-augmented generation
- Python and C# / .NET
- Azure data services (AI Search, Cosmos DB, Storage)
- Microsoft Graph and line-of-business API integration
- Evaluation, guardrails and responsible AI
- CI/CD and infrastructure as code (GitHub Actions, Bicep or Terraform)
Qualifications and Certifications:
- Bachelor's degree in computer science or information technology.
- At least three years of hands-on QA experience across web and API testing.
- ISTQB Foundation Level, or an equivalent testing certification, is an advantage.
