Senior Data Scientist - AI Evaluation (Remote)

About the Role

Join us as a Senior Data Scientist - AI Evaluation (Remote) at Learning Commons, where we aim to revolutionize education through AI. This role is pivotal in ensuring that AI and education products are grounded in rigorous, research-backed evaluation.

What You'll Do

• Define evaluation frameworks for AI-powered education tools, such as LLM-based systems and adaptive learning systems.
• Design and analyze experiments across structured and unstructured data, utilizing A/B testing, quasi-experimental methods, and causal inference.
• Translate findings into clear recommendations for product and research partners.
• Collaborate cross-functionally with Product, Engineering, Learning Science, and external partners.
• Contribute to best practices for responsible AI evaluation, focusing on bias, fairness, and reliability.

Requirements

• 5+ years of experience in data science, applied research, or quantitative analysis.
• Proficiency in the modern data science tech stack, including Python, SQL, and machine learning.
• Familiarity with the evaluation of generative AI systems, including rubric-based evaluation and human-in-the-loop evaluation.
• Ability to communicate complex findings to both technical and non-technical audiences.
• Experience collaborating with cross-functional teams in a fast-paced development environment.

Nice to Have

• Experience in educational technology or related fields.
• Knowledge of learning science principles.
• Previous work in AI evaluation projects.

What We Offer

• Competitive salary range of $190,000 - $261,800, based on skills and experience.
• Participation in our discretionary annual performance bonus program.
• Comprehensive relocation support for those moving to the United States.
• A generous employer match on 401(k) contributions.
• Paid time off to volunteer at an organization of your choice.