Search Quality Specialist - Remote Position

About the Role

We are looking for a Search Quality Specialist to join our team remotely. As a Search Quality Specialist, you will play a crucial role in evaluating AI-generated search responses for their factual accuracy, helpfulness, clarity, completeness, and overall quality. This is a fantastic opportunity to work with a leading AI research lab and contribute to the development of cutting-edge technology.

What You'll Do

• Evaluate AI-generated search responses for factual accuracy and overall quality.
• Assess the effectiveness of search queries and the appropriateness of model responses.
• Provide concise and defensible rationales for your evaluations.
• Write and refine prompts, golden answers, rubric criteria, and edge cases for search evaluations.
• Identify recurring failure modes and escalate unclear cases to project leads.
• Consistently apply project guidelines across various search tasks.

Requirements

• Excellent written English and strong online research skills.
• Strong judgment when synthesizing information from multiple sources.
• High attention to detail and comfort following structured guidelines.
• Reliable and self-directed in an asynchronous remote environment.
• Experience in search quality, fact-checking, or content evaluation is preferred.

Nice to Have

• Familiarity with search evaluation concepts such as factuality and helpfulness.
• Experience working with LLM evaluation workflows.
• Multilingual skills are a plus.
• Bachelor’s degree preferred; advanced degree or strong professional background is a plus.

What We Offer

• Flexible remote work opportunities.
• Competitive compensation ranging from $10 to $30 per hour.
• Daily application reviews to ensure timely feedback.
• Supportive team environment with resources for your success.
• Opportunity to work with elite creative and technical talent.