Introduction
A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.
Your Role And Responsibilities
The
AI Developer (B7) is responsible for designing, developing, and optimizing AIpowered solutionsprimarily through advanced
system prompt engineering, LLM workflow creation, and automation design. This role focuses on building
standalone AI assistants and decision-support tools that increase efficiency, reduce manual effort, and enhance user experience across Operations and Support teams.
The AI Developer will collaborate extensively with
HR, TAO, FSCT, Customer Transformation, and other support groups to understand processes, identify automation opportunities, and design AI solutions that support business transformation initiatives.
Roles And Responsibilities
AI Development & Prompt Engineering
- Craft, optimize, and maintain system prompts, reasoning frameworks, and AI agent instructions.
- Develop scalable, reusable prompt libraries and workflow templates for cross-team deployment.
- Conduct tuning cycles to improve accuracy, reduce errors, and align model behavior to business rules.
- Build standalone AI agents for summarization, classification, decision validation, and knowledge support.
AI Solution Design (Standalone Deployments)
- Design non-integrated, self-contained AI tools for operational teams (e.g., QA assistants, evaluators, knowledge bots, SOP bots).
- Build workflow-based LLM applications that operate without direct enterprise system integrations.
- Develop evaluation scripts, validation logic, and guardrails to ensure solution reliability.
Cross-Functional Collaboration
- Partner with HR, TAO, FSCT, Customer Transformation, and other support groups to define use cases.
- Translate operational needs into clear prompt logic, AI workflows, and task decomposition.
- Participate in workshops, pilot testing, and rollout activities to promote adoption and continuous improvement.
Performance Optimization & Governance
- Ensure outputs comply with AI safety, privacy, and governance standards.
- Perform root-cause analysis for AI errors and deploy corrective prompt or workflow adjustments.
- Monitor usage trends, performance metrics, and model behavior for continuous optimization.
Documentation & Enablement
- Maintain documentation for prompts, logic flows, constraints, reasoning patterns, and workflows.
- Provide user training, demo sessions, and knowledge transfers to partner teams.
- Support internal capability-building for prompt engineering and responsible AI use.
Preferred Education
Bachelor's Degree
Required Technical And Professional Expertise
Required / Technical Skills
Core Technical Skills
- Strong experience in system prompt engineering, task decomposition, reasoning structures, and LLM instruction design.
- Hands-on experience with LLM-based tools (OpenAI, Azure OpenAI, Anthropic, M365 Copilot Studio, etc.).
- Proficiency in designing workflow-driven AI assistants without requiring backend integrations.
- Basic scripting skills (preferably Python) for logic prototyping or lightweight orchestration.
AI & Automation Skills
- Understanding of LLM capabilities, memory patterns, guardrails, and error mitigation.
- Ability to build structured multi-step workflows for classification, summarization, and decision-making.
- Familiarity with prompt evaluation frameworks and AI output quality assessment.
Business & Analytical Skills
- Strong ability to analyze processes in HR, TAO, FSCT, operations, and transformation functions.
- Experience identifying automation opportunities and translating them into actionable LLM workflows.
- Strong attention to detail, analytical mindset, and solution-oriented thinking.
Soft Skills
- Excellent communication and stakeholder engagement, especially with cross-functional groups.
- Comfortable running workshops, demos, and user enablement sessions.
- Ability to work in an iterative, rapid-development environment with tight turnaround times.