Software Engineer - Code Quality Assessment (Remote)

About the Role

We are seeking a Software Engineer - Code Quality Assessment (Remote) to join our innovative team at Crossing Hurdles. In this role, you will craft realistic developer prompts and evaluate AI outputs, ensuring they reflect real-world developer workflows. This is a fantastic opportunity for those interested in remote work in the Development & Programming field.

What You'll Do

• Craft realistic, chat-style developer prompts covering code review, debugging, error diagnosis, and configuration scenarios.
• Source and adapt real pull requests and engineering discussions to create authentic evaluation tasks.
• Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality.
• Evaluate AI outputs based on logic, clarity, and technical judgment rather than executable correctness.
• Apply your software engineering expertise to ensure prompts and responses reflect real-world developer workflows.
• Contribute to structured evaluation datasets used to assess AI reasoning and communication quality.
• Collaborate asynchronously with research teams to refine task quality and consistency.

Requirements

• Strong experience in software engineering, technical research, or educational content development.
• Bachelor’s degree in Software Engineering, Computer Science, or a related field.
• Strong proficiency in one or more programming languages such as Python, JavaScript, Java, or C++.
• Hands-on experience with debugging, testing, and validating code.
• Strong technical writing skills with high attention to detail.
• Ability to work independently in a fully remote, project-based environment.

Nice to Have

• Experience with AI and machine learning concepts.
• Familiarity with code quality assessment tools.

What We Offer

• Competitive hourly compensation ranging from $70 to $120.
• Flexible work hours, allowing you to choose your commitment between 10 to 40 hours per week.
• Fully remote work environment.
• Opportunity to work with a dynamic team and contribute to innovative projects.
• Professional development opportunities in AI and software engineering.