Conversation Quality Analyst

Conversation Quality Analyst (AI Training)

About The Role

What if your instinct for natural conversation could directly influence how AI communicates with millions of people We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they sound genuinely human, helpful, and clear.

This is a fully remote, flexible contract role open to anyone with strong communication instincts and a sharp eye for quality. No AI or linguistics background needed — just a reliable internet connection and the ability to recognize a good conversation when you see one.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week
  
  

What You'll Do

• Read and evaluate AI-generated conversations across a wide range of topics and contexts
• Rate responses for naturalness, tone, helpfulness, and conversational flow
• Identify awkward phrasing, off-topic replies, logical errors, or responses that feel robotic
• Compare multiple conversation paths and rank them by overall quality
• Provide structured, detailed feedback using evaluation rubrics and rating tools
• Work independently and asynchronously on your own schedule
  
  

Who You Are

• Strong reading comprehension and a natural feel for how conversations should flow
• Able to assess dialogue quality objectively and explain your reasoning clearly
• Detail-oriented and consistent — you apply the same standards across large volumes of work
• Self-motivated and reliable when working independently
• No prior AI, linguistics, or tech experience required
  
  

Nice to Have

• Background in writing, editing, communications, or customer-facing roles
• Experience with quality assurance, content moderation, or critical analysis
• Familiarity with AI tools or chatbots as an end user
  
  

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Contribute to AI development that has a direct impact on how technology communicates with the world
• Potential for ongoing work and contract extension as new projects launch