Human Signal is a forward-thinking company committed to advancing artificial intelligence through innovative design evaluation technologies. We operate in a dynamic remote work environment, focusing on projects that enhance AI's ability to understand and assess visual content quality, fostering groundbreaking progress in AI-driven design analysis.
Pay: By Milestone
Competitive hourly pay based on 120 tasks per 30 minutes of work. (Each tasks should take approximately 15 seconds to complete)
Job Responsibilities- Review and rate graphic design elements using our Label Studio Enterprise platform across multiple quality dimensions:
- Typography quality (readability, hierarchy, font pairing appropriateness)
- Visual hierarchy effectiveness (clarity, balance, focal point strength)
- Design element execution (icon quality, illustration polish, image selection)
- Color palette effectiveness (harmony, contrast, accessibility)
- Layout and composition quality (grid usage, spacing, alignment)
- Overall design effectiveness and professional polish
- Apply consistent 1-5 rating scales across hundreds of design examples
- Provide clear, objective assessments based on established design principles
- Follow detailed rating guidelines and rubrics to maintain consistency
- Process high volumes of design samples with sustained attention to detail
- Participate in weekly calibration sessions to align rating standards
- Meet quality benchmarks for rating consistency and inter-rater reliability
Required Experience- Formal training in graphic design, visual arts, or related field (degree, certificate, or bootcamp completion) OR 2-3 years of professional graphic design experience
- Strong proficiency in design principles (composition, color theory, typography, visual hierarchy)
- Ability to objectively critique and evaluate design work against industry standards
- Understanding of what constitutes effective vs. ineffective design choices
- Experience reviewing or providing design feedback
- Exceptional attention to detail and ability to maintain focus during repetitive tasks
Skills & Attributes- Comfort with highly repetitive workability to maintain quality and engagement while rating similar content for extended periods
- Strong visual discrimination and consistent aesthetic judgment
- Reliability and consistency in applying rating standards
- Self-motivated with ability to work independently on repetitive tasks
- Excellent focus and concentration for sustained periods
- Strong communication skills for flagging edge cases or unclear examples
- Comfortable with feedback and recalibration
- Minimum 10 hours per week availability for at least 3 months
