Senior Automation Test Engineer - AI Focus (Remote)

About the Role

We are looking for a highly skilled Senior Automation Test Engineer to join our team remotely. In this role, you will leverage your extensive experience in software testing and test automation, particularly in the realm of AI Testing and Evaluation. As a Senior Automation Test Engineer, you will design, develop, and execute robust automated test frameworks and pipelines, ensuring the quality and reliability of AI/ML models and software systems.

What You'll Do

• Participate in requirement gathering and design discussions, translating functional requirements into comprehensive test plans and strategies.
• Design, develop, and maintain end-to-end test automation frameworks using Selenium and Playwright, ensuring extensive coverage of web application interfaces and API integration.
• Utilize your strong programming skills in Python and Java to create and optimize test scripts; employ SQL to set up and validate test data.
• Implement and integrate automated testing within CI/CD pipelines (e.g., using Jenkins, Azure DevOps) to enable continuous testing.
• Collaborate closely with software developers, data engineers, and DevOps engineers throughout the development lifecycle.
• Develop and execute a variety of automated tests (unit, integration, regression, performance, and security tests) to validate AI/ML models and data pipelines.
• Monitor and analyze test execution results for both traditional software and AI-specific metrics.
• Apply best practices in test data management and environment configuration to simulate real-world data scenarios for AI systems.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 8–10 years of hands-on experience in software Quality Assurance (QA) and test automation.
• Minimum 2 years of recent experience in AI/ML testing or evaluation.
• Strong proficiency in Python and Java.
• Extensive experience with test automation tools and frameworks, especially Selenium and Playwright.
• Solid understanding of SQL and relational databases.
• Hands-on experience with Continuous Integration/Continuous Delivery (CI/CD) processes and tools.
• Familiarity with DevOps practices and tools (Docker, Kubernetes).

Nice to Have

• Industry-recognized certifications in Quality Assurance or Testing (e.g., ISTQB).
• Experience with AI/ML frameworks (such as TensorFlow, PyTorch).
• Exposure to AI-specific testing tools or techniques.
• Experience in performance and load testing of web applications.
• Familiarity with cloud platforms (AWS, GCP, Azure).

What We Offer

• Competitive salary ranging from $91,700 to $137,500 per year.
• Comprehensive benefits package including medical, dental, and vision coverage.
• 401(k) Retirement Plan with pre-tax and Roth contributions.
• Flexible remote work environment.
• Opportunities for continuous learning and professional development.
• Supportive team culture focused on collaboration and innovation.
• Incentive programs like annual bonuses and profit sharing.
• Time Off/Leave (PTO, Vacation or Sick Leave).