About Sutherland: 

Artificial Intelligence. Automation. Cloud engineering. Advanced analytics. For business leaders, these are key factors of success. For us, they’re our core expertise.

We work with iconic brands worldwide. We bring them a unique value proposition through market-leading technology and business process excellence.

We’ve created over 200 unique inventions under several patents across AI and other critical technologies. Leveraging our advanced products and platforms, we drive digital transformation, optimize critical business operations, reinvent experiences, and pioneer new solutions, all provided through a seamless “as a service” model.

For each company, we provide new keys for their businesses, the people they work with, and the customers they serve. We tailor proven and rapid formulas, to fit their unique DNA. We bring together human expertise and artificial intelligence to develop digital chemistry. This unlocks new possibilities, transformative outcomes and enduring relationships.

Sutherland

Unlocking digital performance. Delivering measurable results

We are seeking a detail-oriented and analytical Test AI Interview professional to join our team in Bogotá, Colombia. In this role, you will be responsible for designing, executing, and analyzing comprehensive tests for our AI-powered interview systems. You will work to ensure that our interview platforms deliver accurate, fair, and reliable assessments while maintaining the highest standards of quality and performance. This position requires a methodical approach to identifying system vulnerabilities, evaluating user experience, and documenting findings with precision.

• Design and develop comprehensive test cases and scenarios for AI interview systems, ensuring thorough coverage of functionality and edge cases
• Execute manual and automated testing protocols to evaluate system performance, accuracy, and reliability
• Analyze AI responses and interview outcomes to identify inconsistencies, biases, or errors in the system
• Document test results, defects, and recommendations in a clear and organized manner using established quality assurance standards
• Collaborate with development and product teams to communicate findings and track resolution of identified issues
• Evaluate the user experience and interface of interview platforms to ensure usability and accessibility
• Conduct regression testing to verify that updates and fixes do not negatively impact existing functionality
• Monitor and report on key performance metrics related to system quality and interview accuracy
• Stay current with industry best practices in AI testing and quality assurance methodologies
• Participate in continuous improvement initiatives to enhance testing processes and efficiency

• Proven experience in quality assurance testing, with a focus on software or AI systems
• Strong knowledge of artificial intelligence and machine learning concepts and their applications
• Proficiency with test automation tools and frameworks
• Experience testing natural language processing (NLP) or conversational AI systems
• Solid understanding of interview assessment methodologies and evaluation criteria
• Excellent analytical and problem-solving skills with strong attention to detail
• Proficiency in documenting test cases, defects, and technical findings
• Experience with test management and bug tracking tools
• Strong organizational skills and ability to manage multiple testing initiatives simultaneously
• Excellent written and verbal communication skills in English
• Familiarity with agile development methodologies and testing practices
• Preferred: Experience with AI bias detection and fairness testing
• Preferred: Knowledge of statistical analysis and data interpretation
• Preferred: Experience in the recruitment technology or HR tech industry