Performance QA Engineer - R01557576

About BrillioBorn digital in 2014, Brillio is a powerhouse of digital transformations. Orchestrated around the superpowers of technology – Cloud, AI, Mobile, IoT, we are a partner of choice for leading companies around the world, helping them leverage digital technologies. We have a global workforce of 6000+ people present in 15 locations across 6 countries – USA, Canada, Mexico, UK, Romania, and India. We have been consistently certified by Great Place To Work® institute in USA, India, UK, and Romania for our strong foundational values and employee-centric culture. 
Brillio RomaniaWe are a dynamic and rapidly growing company with over 250 colleagues country wide and offices in Cluj, Oradea and Bucharest. With its fast-paced growth, the company has consistently demonstrated an unwavering commitment to client satisfaction. At Brillio Romania, we know our success comes from the innovative contributions and brilliant work of our people. So, we make fostering a positive work environment our top priority. Our colleagues not only thrive, but they also have the chance to build long and fulfilling careers, fostering a sense of stability and dedication that ultimately benefits both the company and our valued clients.
Accelerate YOU at Brillio!!
Consultant

Responsibilities:

• Design and implement performance test strategies for LLM-driven workflows, MCP-compliant tool orchestration, and streaming APIs
• Develop modular, reusable test scripts using JMeter / Gatling / Locust with Groovy/Bash/Python integration
• Build polling loops and timing extractors to measure end-to-end latency across multiple layers
• Simulate concurrent user flows across mobile, web, and desktop interfaces
• Validate scalability of components like Chat API, LLM Gateway, Planner Agent, Actor Agents, Tool Registry, and MCP Server
• Integrate performance tests with CI/CD pipelines and APM tools (Dynatrace, AppDynamics, Grafana)
• Analyze test results, identify bottlenecks, and provide actionable recommendations
• Collaborate with engineering and DevOps to tune infrastructure and optimize response times
• Document test plans, scenarios, and results with clarity and auditability

Requirements:

• Experience 6+ years
• Performance Engineering: JMeter, Gatling, Locust for load tests
• Observability & Monitoring: Prometheus, Grafana, Open Telemetry or similar monitoring tools
• Performance testing of LLM-based systems or AI orchestration platforms
• Experience with MCP-compliant tool orchestration and sandboxed tool execution
• Experience with LoadRunner and Neo Load for enterprise-grade performance testing
• Streaming Protocol Testing: Web Sockets, HTTP/2, SSE
• Strong understanding of HTTP/HTTPS, REST APIs, WebSocket protocols LLM
• Performance and Profiling: Tool orchestration, Streaming architectures, Token latency and Context window impact
• Scripting & Automation: Groovy/Bash/Python, Go (for custom load scripts)
• Kafka Performance Tuning: Consumer lag, partition balancing
• CI/CD integration with Jenkins, GitLab, or Azure DevOps
• Root-cause analysis and iterative debugging across distributed systems
• Clear, concise documentation and audit trail creation

Perks and Benefits·       We value your time and lifestyle preferences, so you can choose whether you want to work entirely remotely or from our offices in Cluj-Napoca, Oradea and Bucharest.·       Access to learning through our internal platform - Percipio.·       Private health insurance is provided by Medicover.·       Work from home fixed monthly budget.·       A monthly budget you can use to purchase flexible benefits through the Edenred Benefit platform.·       Sports benefit: We encourage you to have a healthy lifestyle. We'll reimburse you within budget for your favorite sporting activity: whether it's football, climbing, gym or other sports.

Take the next step with Brillio. Accelerate What Matters. Be a Catalyst for Tomorrow. Be a Brillian!