Senior Test Engineer / Software Development Engineer in Test (SDET)

We are seeking a senior-level software-test professional whose strength lies in principled, context-driven testing. You will champion risk-based, exploratory testing and purposeful automation across UI and API layers, while leveraging our modern toolset to make informed decisions and keep our products reliable, secure, and performant. Strong Python skills, hands-on load- and performance-testing, and experience evaluating AI outputs are central to the role.

1. Purpose of the Role

Support product teams in delivering high-quality features and making informed decisions by:

• Leading risk-oriented testing initiatives.
• Integrating exploratory methods with purposeful UI and API automation.
• Validating system performance under load and surfacing critical issues early.

2. Main Tasks

Test Design & Automation

• Identify high-value automation opportunities and implement them in Python, automating across both UI (e.g., Playwright) and API layers.
• Build reusable test cases and test scenarios in AIO Tests.

Load & Performance Testing

• Design, run, and analyse load- and performance-tests to validate scalability, responsiveness, and stability under realistic conditions.

Risk-Based & Exploratory Testing

• Adjust test concepts as needed.
• Create test cases and scenarios grounded in requirements, risk models, and user journeys.

AI Evaluations

• Contribute to our AI-output scoring framework to measure correctness, relevance, and safety of generated content.

Agile Collaboration & Delivery

• Partner with product and engineering during sprint planning, backlog grooming, and retrospectives.
• Translate evolving specs into concrete acceptance criteria and automated checks written in Python.

Metrics, Reporting & Governance

• Define and collect quality indicators; publish dashboards that surface test execution results, defect trends, coverage metrics, and AI-output risk scores.
• Document test strategies, findings, and lessons learned in Confluence for cross-team visibility.

Thought Leadership & Continuous Learning

• Stay current on generative-AI breakthroughs, emerging testing techniques, and security trends.
• Share insights through short demos, concise documentation, and regular knowledge-sharing sessions.

3. Skills & Competencies

Core Technical Skills

• University degree in IT—or any field with relevant work experience (career changers welcome).
• Deep experience with risk analysis, exploratory testing, and automation.
• Python: strong skills for building robust, maintainable test frameworks and automated checks. Other programming languages are also acceptable with the willingness to learn Python.
• UI and API test automation: hands-on experience (e.g., Playwright for end-to-end UI testing plus API-level testing)—or a solid automation foundation and a willingness to learn our stack.
• Load and performance testing: proven experience designing, running, and interpreting tests of scalability and responsiveness.
• AI evaluations: familiarity with systematic AI-output evaluation (e.g., Promptfoo, Langfuse) to evaluate agentic capabilities. Optionally including AI red-team testing. Experience with other AI-evaluation/red-team tools are also valuable.
• Experience with Spec-Driven Development
• Experience with AIO Tests for test management—or a similar tool.
• Comfortable using Confluence as a central knowledge hub.

Nice to Have / Advantages

Exposure to any of the following would be an advantage:

• Confidential computing.
• Cloud / IaaS / Infrastructure-as-Code (IaC) validation.
• Dynamic Application Security Testing (DAST).
• Usability testing.
• Chaos engineering, fault-injection, and resilience experiments.
• Agentic testing and generative-AI tooling.
• SRE-adjacent activities (logging, monitoring, observability).

Adaptability

• Ability to switch between tools and languages with minimal ramp-up time.
• Proven track record of learning new technologies and languages quickly.

Analytical Thinking

• Diagnose root causes, design repeatable processes, and communicate findings clearly to both technical and non-technical stakeholders.

Collaboration & Influence

• Excellent communicator who builds trust across cross-functional teams and promotes a principle-first mindset.

Continuous Learning

• Keeps abreast of AI trends, testing innovations, and security developments; actively disseminates knowledge.

Language

• Fluent in English; German or additional languages are a plus.

4. Experience