AI Quality Assurance Specialist

About The Role

We're looking for detail-driven QA professionals to evaluate, test, and improve AI-generated content and outputs. Your work will directly shape the quality and reliability of AI systems used by top research labs worldwide. If you have a sharp eye for errors, a methodical mindset, and a passion for doing things right --- this role is built for you.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10--40 hours/week

What You'll Do

• Review and evaluate AI-generated outputs against detailed quality guidelines and specifications
• Identify errors, inconsistencies, and edge cases in AI responses across text, code, and structured data
• Perform systematic constraint-checking to ensure outputs meet defined standards
• Document findings and deliver structured, actionable feedback
• Develop and refine test cases to probe AI system capabilities and surface limitations
• Collaborate asynchronously with distributed teams to maintain and improve quality benchmarks

Who You Are

• 2+ years of experience in QA, technical writing, test engineering, or annotation project management
• Exceptional attention to detail with a methodical, systematic approach
• Strong written communication skills --- you can articulate issues clearly and precisely
• Comfortable applying complex guidelines consistently at scale
• Analytical mindset with the ability to identify patterns and systemic issues
• Self-motivated and reliable --- you thrive working independently without micromanagement

Nice to Have

• Experience with data annotation, labeling, or content evaluation workflows
• Familiarity with AI/ML concepts or language model outputs
• Background in creating or maintaining test documentation and quality rubrics
• Experience managing or coordinating annotation or QA teams

Why Join Us

• Work on cutting-edge AI projects shaping the future of technology
• Collaborate with top research labs and global teams
• Fully remote and flexible --- set your own schedule and work from anywhere
• Autonomy and ownership over your work
• Build deep expertise in one of the fastest-growing fields in tech
• Potential for ongoing projects and contract extension