Agentic AI QA Engineer (m/f/d)
- Full-time
- Department: TECH & Engineering
- Legal Entity: Sixt Research Development Services, Lda.
Company Description
Job Description
As a Customer Service Agentic AI QA Engineer (m/f/d), you ensure that SIXT’s virtual agents and Generative-AI–powered workflows deliver reliable, safe, and delightful support across all customer service channels. You design and run intelligent test strategies for LLM- and agent-based systems, combining classic QA skills with a deep understanding of agentic automation, conversational AI, and customer service KPIs.
YOUR ROLE AT SIXT
- Design and execute end-to-end test plans for customer service virtual agents (voice, chat, email). Build and maintain agentic AI test suites validating autonomous workflows (e.g., booking changes, billing, damages).
- Define and monitor AI quality metrics such as resolution rate, deflection, CSAT, and safety violations. Develop test data and synthetic scenarios for edge cases, ambiguous queries, and multilingual requests.
- Evaluate agent behavior through reasoning traces, tool-use decisions, and memory usage.
- Implement and improve automated testing frameworks for conversational flows, APIs, and integrations. Contribute to LLMOps / CI/CD pipelines to automatically detect regressions.
- Perform bias, fairness, and safety testing in line with SIXT policies and regulatory expectations. Collaborate with cross-functional teams to refine requirements and acceptance criteria.
- Document defects, test results, and insights clearly for stakeholders.
YOUR SKILLS MATTER
- Foundations Several years of experience in software QA / test engineering. Strong understanding of testing principles: functional, regression, integration, performance.
- AI Testing Hands-on experience testing AI or ML systems such as LLM chatbots or recommendation engines. Familiarity with key concepts of multi-agentic systems, agentic frameworks (e.g., LangChain), AWS AgentCore.
- Automation Scripting skills in Python and experience with REST API testing.
- LLMOps: Understanding of LLMOps / MLOps: versioning, monitoring, rollback strategies.
- Customer Focus Experience or interest in customer service processes and KPIs.
- Communication Excellent analytical, documentation, and communication skills. Fluency in English; German or additional languages a plus.
WHAT WE OFFER
- Generous Time Off Enjoy 28 days of vacation, an additional day off for your birthday, and 1 volunteer day per year
- Work-Life Balance & Flexibility Benefit from a hybrid working model, flexible working hours, and no dress code
- Great Employee Benefits Access discounts on SIXT rent, share, ride, and SIXT+, along with partner discounts
- Training & Development Participate in training programs, external conferences, and internal dev & tech talks designed for your personal growth and development
- Health & Well-being Private health insurance to support your well-being
- Additional Perks Enjoy the Coverflex advantage system to enhance your employee experience
Additional Information
About us:
We are a globally leading mobility service provider with a revenue of €4.00 billion and around 9,000 employees worldwide. Our mobility platform ONE combines our products SIXT rent (car rental), SIXT share (car sharing), SIXT ride (taxi, ride, and chauffeur services), and SIXT+ (car subscription), giving our customers access to our fleet of 350,000 vehicles, the services of 4,000 cooperation partners, and around 5 million drivers worldwide. Together with our franchise partners, we are present in more than 110 countries at 2,000 rental stations. At SIXT, top-tier customer experience and outstanding customer service are our highest priorities. We believe in true entrepreneurship and long-term stability and align our corporate strategy with foresight. Get started with us and apply now!