AI Quality Assurance (QA) Analyst - Remote Position

About the Role

We are seeking an experienced AI Quality Assurance (QA) Analyst to join our team in a fully remote capacity. As an AI QA Analyst, you will play a critical role in ensuring the quality, reliability, and regulatory compliance of AI-driven solutions that support business process automation and intelligent decision-making. This position is ideal for individuals who thrive in a fast-paced, collaborative environment and are passionate about AI and machine learning.

What You'll Do

• Design, document, and execute comprehensive test plans, test cases, and test scripts for web applications, APIs, and batch processes.
• Perform functional, regression, integration, system, and UAT testing across multiple environments, ensuring defects are logged, prioritized, and retested to closure.
• Validate end-to-end workflows from document intake to decision-ready application views, including queue indicators and evidence screens.
• Collaborate with product owners, business analysts, developers, and data scientists to clarify requirements and reproduce issues.
• Contribute to test automation efforts, maintaining stable regression suites and monitoring results.
• Develop and execute test strategies for AI/ML features that support business rule validation and recommendation engines.
• Assess AI outputs for correctness, consistency, and stability over time, focusing on recommendations and evidence presented to users.
• Track and analyze model defects, helping define quality metrics and acceptance thresholds.

Requirements

• 3+ years of software QA or QA analyst experience, particularly in testing web applications and APIs.
• Hands-on experience with test management tools such as Jira, Azure DevOps, or qTest.
• Basic SQL skills for test data setup and verification.
• Experience testing AI/ML systems, including model validation and data quality checks.
• Strong analytical skills with attention to detail, capable of interpreting complex guideline documents.

Nice to Have

• Experience with OCR or document-intelligence solutions.
• Familiarity with testing unstructured document flows.
• Domain experience in business process automation or data analytics.
• Experience designing tests for recommendation systems.

What We Offer

• Competitive salary range of $90,000 - $120,000 per year.
• Fully remote work environment with flexible hours.
• Opportunities for professional growth and development.
• Collaborative team culture focused on innovation.
• Access to cutting-edge AI technologies and tools.