AI Tester

🤖 AI Tester ⏳ 6-month initial contract - with extensions 📍 Abu DhabiWe are seeking AI Testers to ensure the quality, accuracy, and reliability of our next-generation AI platform. In this role, you will design and execute testing strategies that validate AI behaviour, improve user experience, and ensure compliance with internal governance and regulatory standards. You will focus on evaluating LLM outputs, prompt behaviour, and end-to-end AI user journeys, while helping to build robust automated testing frameworks for a production-grade AI system.Key ResponsibilitiesDesign and execute comprehensive test plans to assess prompt accuracy, hallucination control, and response completeness.Build and maintain automated test scripts covering end-to-end user journeys within the AI platform.Validate compliance with internal knowledge governance, data handling, and quality standards.Identify usability and functional issues, log defects, and produce clear, detailed test reports.Develop, maintain, and enhance automation frameworks and QA tooling.Collaborate with engineers and product teams to ensure continuous improvement of AI system quality.Required Skills & ExperienceExperience with test automation tools such as Selenium, Playwright, or Cypress.Familiarity with test management tools like TestRail or Zephyr.Strong understanding of software testing principles, QA methodologies, and defect lifecycle management.Experience working in Agile/Scrum environments with CI/CD pipelines and Git-based workflows.Strong attention to detail with experience using JIRA or similar issue tracking systems.Nice to HaveExperience evaluating AI / LLM outputs, including accuracy, relevance, hallucination detection, and response quality.Understanding of AI/ML systems or Generative AI applications.ISTQB certification or equivalent QA qualification.Exposure to testing conversational AI, chatbots, or agent-based systems.QualificationsBachelor’s degree in Computer Science, Software Engineering, Information Technology, or a related discipline.2–5 years of experience in software quality assurance, ideally with exposure to AI/ML or data-driven systems.Please apply to be contacted with further information.