AI Evaluation Specialist
innodata inc.- Posted 16 hours ago
- Be among the first 10 applicants
Job Description
Innodata Knowledge Services Inc. is looking for skilled and detail-oriented professionals to join our AI Evaluation Projects.
This is an exciting opportunity to contribute to the development and improvement of next-generation AI systems by applying your expertise to evaluate AI-generated content, responses, speech, code, and other AI outputs.
Available Positions:
1. Technical AI Evaluation Specialist – Code & Software Engineering
Qualifications:
- At least 2 years of programming experience
- Proficiency in any programming language
- Experience working with varied programming languages, technologies, or development environments
- Strong analytical and problem-solving skills
- Ability to evaluate and provide feedback on technical outputs
2. Speech & Audio Evaluation Specialist
Qualifications:
- C2 level proficiency in English/Pearson
- BPO or customer service experience is preferred
- Strong verbal communication and listening skills
- Comfortable interacting with AI systems and evaluating AI-generated responses
- Ability to identify differences in speech, language, tone, and response quality
3. Senior AI Evaluation & AI RLHF Specialist
Qualifications:
- Experience as a Frontier AI Data Annotator or in a similar AI evaluation role
- Familiarity with AI platforms such as ChatGPT, Claude, Copilot, or similar systems
- Strong understanding of AI-generated content and response evaluation
- Excellent analytical, writing, and critical-thinking skills
- Ability to provide clear and accurate feedback
4. ASR & Transcription QA Specialist
Qualifications:
- Professional experience in transcription, audio processing, or transcription quality assurance
- Excellent listening and comprehension skills
- Strong attention to detail
- Ability to identify transcription errors, inconsistencies, and audio-related issues
- Experience with transcription tools or platforms is an advantage
5. Spatial Reasoning Evaluation Specialist
Qualifications:
- Background in STEM, Video ML, Spatial RL, or related fields
- Graduates of Physics, Data Science, Mathematics, Engineering, or related disciplines are encouraged to apply
- Strong analytical and spatial reasoning skills
- Ability to interpret visual information and evaluate AI-generated outputs
- Strong attention to detail and problem-solving abilities
Employment Details
Work Setup: Remote/WFH – Philippines
Employment Type: Full-Time
Benefits:
- Health insurance
- Life insurance
- Work from home
Work Location: Remote
More Info
Key Skills
STEM Video ML Spatial RL
any programming language
programming experience
transcription quality assurance
transcription audio processing
