Senior Software QA Engineer

About the role

Crimson Education is seeking a Senior Software QA Engineer to lead the design, implementation, and scaling of automated testing solutions for our AI‑driven admissions platform. You will work closely with engineering, data science, and product teams to ensure high‑quality releases.

Key responsibilities

• Develop, maintain, and scale end‑to‑end automation frameworks for UI, API, and integration testing.
• Integrate automated test suites into CI/CD pipelines for rapid, reliable deployments.
• Define and track test‑coverage metrics, focusing on critical UI paths and high‑purity API coverage.
• Perform API performance, load, and stress testing to validate system scalability.
• Design testing strategies for AI/LLM components, evaluating accuracy, bias, safety, and hallucination rates.
• Establish prompt regression benchmarks to detect hidden breaks after model updates.
• Collaborate with Data Scientists and ML Engineers to monitor model drift and production performance.
• Simulate adversarial inputs (prompt injections, jailbreaks) to safeguard AI features.

Required profile

• 4+ years of software QA automation experience, including 1–2 years testing AI/ML‑powered applications.
• Strong programming proficiency in Python (preferred) or JavaScript/TypeScript.
• Hands‑on experience with modern automation tools such as Playwright, Cypress, or Selenium.
• Expertise in API testing tools and performance testing frameworks.

Required skills

• Python
• JavaScript / TypeScript
• Playwright
• Cypress
• Selenium
• API testing (e.g., Postman, REST Assured)
• CI/CD pipeline integration
• Performance & load testing
• AI/LLM validation techniques