Senior Manager of AI Safety and Validation Engineering - Remote Opportunity

About the Role

We are hiring a Senior Manager of AI Safety and Validation Engineering to join a leading bank in their Group Business Services division. This role is primarily a technical practitioner position focused on the design and implementation of technical measures to ensure the reliability and security of advanced AI solutions. As a Senior Manager of AI Safety and Validation Engineering, you will bridge the gap between cutting-edge AI development and rigorous risk standards while serving as a technical liaison to second-line risk functions.

What You'll Do

• Lead the creation of evaluation frameworks for both predictive Machine Learning and Generative AI.
• Define standardized monitoring protocols and automated guardrails to ensure compliance and performance.
• Provide hands-on execution support to various product teams to ensure all deployments meet high performance and compliance standards.
• Design comprehensive test cases covering deterministic logic and adversarial scenarios to stress test AI outputs.
• Implement automated evaluators such as LLM-as-a-judge and targeted small language models.
• Deploy explainability techniques like Shapley Values and Integrated Gradients to ensure model transparency and unfair bias detection in lending and fraud models.
• Partner with platform teams to build telemetry pipelines that capture embeddings and inputs while maintaining strict data privacy standards.
• Establish golden signals such as hallucination rates and semantic similarity to trigger automated circuit breakers when performance thresholds are breached.
• Analyze guardrail violations to identify emerging attack patterns and integrate human-in-the-loop corrections into model refinement cycles.
• Translate technical telemetry into actionable model health reports for second-line risk functions.
• Work with specialist software vendors to bring advanced safety capabilities into the internal AI ecosystem.

Requirements

• 7+ years of experience in Machine Learning Engineering, Data Science, or AI Safety and Testing.
• Bachelor’s Degree in Computer Science, Information Technology, or a related engineering discipline.
• Expert proficiency in Python and deep knowledge of statistical testing and XAI libraries.
• Hands-on experience with LLM evaluation frameworks such as Ragas, Giskard, or Arize.
• Proven ability to design observability and monitoring systems at scale.
• Prior experience in the financial sector is highly preferred.
• Strong leadership skills with the ability to act as a technical mentor across cross-functional initiatives.

What We Offer

• Competitive salary package of 45k-50k AED per month, tax-free.
• Comprehensive relocation support to help you settle in your new role.
• Opportunities for professional growth and development.
• Work in a dynamic and innovative environment focused on AI safety.
• Be part of a team that is at the forefront of AI technology in the financial sector.