Senior Manager of AI Safety and Validation Engineering

Senior Manager of AI Safety and Validation EngineeringLocation: Abu DhabiDuration: PermanentPackage: 45k-50k AED per month, TAX FREE + Relocation & benefitsDiscover the opportunityWe are hiring a Senior Manager of AI Safety and Validation Engineering to join a leading bank in their Group Business Services division. This is primarily a technical practitioner role focused on the design and implementation of technical measures to ensure the reliability and security of advanced AI solutions. You will bridge the gap between cutting edge AI development and rigorous risk standards while serving as a technical liaison to second line risk functionsDiscover the roleAs a Senior Manager of AI Safety and Validation Engineering, you will lead the creation of evaluation frameworks for both predictive Machine Learning and Generative AI. You will be responsible for defining standardised monitoring protocols and automated guardrails. Working as an individual contributor, you will provide hands on execution support to various product teams to ensure all deployments meet high performance and compliance standards.Discover the responsibilitiesDefine standardised evaluation rubrics and scoring systems for system performance and safety across various AI archetypes including RAG and agentic workflowsDesign comprehensive test cases covering deterministic logic and adversarial scenarios to stress test AI outputsImplement automated evaluators such as LLM-as-a-judge and targeted small language models Deploy explainability techniques like Shapley Values and Integrated Gradients to ensure model transparency and unfair bias detection in lending and fraud modelsPartner with platform teams to build telemetry pipelines that capture embeddings and inputs while maintaining strict data privacy standardsEstablish golden signals such as hallucination rates and semantic similarity to trigger automated circuit breakers when performance thresholds are breachedAnalyse guardrail violations to identify emerging attack patterns and integrate human-in-the-loop corrections into model refinement cyclesTranslate technical telemetry into actionable model health reports for second-line risk functions Work with specialist software vendors to bring advanced safety capabilities into the internal AI ecosystemDiscover the requirements7+ years of experience in Machine Learning Engineering, Data Science, or AI Safety and TestingBachelor’s Degree in Computer Science, Information Technology, or a related engineering disciplineExpert proficiency in Python and deep knowledge of statistical testing and XAI librariesHands-on experience with LLM evaluation frameworks such as Ragas, Giskard, or ArizeProven ability to design observability and monitoring systems at scalePrior experience in the financial sector is highly preferredStrong leadership skills with the ability to act as a technical mentor across cross-functional initiatives