Senior QA Automation Engineer - AI Agents (JavaScript/TypeScript)
We are seeking a skilled Senior QA Automation Engineer with strong experience in both manual and automated testing, particularly using JavaScript/TypeScript and Playwright. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable, accurate, and meet business requirements, while also contributing to the development of our automation capabilities.
Responsibilities
- Design, develop, and execute automated tests using Playwright (JavaScript/TypeScript)
- Perform manual testing as needed to validate new features, integrations, and user stories
- Build and maintain test cases from requirements and user stories
- Test applications that may include AI agents, APIs, databases, and other integrations
- Collaborate with product, engineering, and operations teams to understand requirements and deployment environments
- Review and improve existing test frameworks and practices
- Perform peer reviews of test cases and scripts
- Track and report test results, defects, and quality metrics
- Assist with troubleshooting production issues and escalate risks as needed
- Stay current with new testing tools and technologies
- Guide and support team members, including onshore and offshore consultants
Requirements
- 3+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions, or LLM-based systems
- Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows
- Strong programming skills in JavaScript or TypeScript, with experience in Playwright, WebdriverIO, or similar frameworks
- Experience testing REST APIs, databases, and microservices
- Familiarity with AI agent frameworks, prompt engineering, and evaluation metrics for LLM-based systems
- Experience with issue and test management tools (e.g., Jira, QMetry, TestRail)
- Experience with version control systems and integrating tests into CI/CD pipelines
- Experience using AI-powered tools for QA (e.g., GitHub Copilot, LLM-based test generation)
- Understanding of cloud environments, particularly AWS
- Excellent communication, collaboration, and leadership skills
- Ability to work independently in a fast-paced, evolving environment and guide teams through ambiguity
- Strong English communication skills (B2+ level)
Nice to have
- Experience with agentic AI platforms (e.g., LangChain, OpenAI Function Calling, or similar)
- Expertise in AI safety, bias, and reliability testing
- Skills in test data generation for AI/ML systems
