AI Test Automation Engineer
Madiff.com
Hybrid
Remote
Full Time
This is a remote position.
We are looking for an AI Test Automation Engineer to join innovative projects within the AI Engineering division, focused on next-generation automation for enterprise AI systems. The role combines hands-on test automation using Playwright and TypeScript with exposure to AI-powered QA tools and LLM model validation, ensuring quality and reliability across advanced AI-driven platforms.Responsibilities
• Design and implement intelligent automation frameworks using Playwright and TypeScript
• Apply AI tools such as GitHub Copilot, Cursor, and other GenAI assistants for code generation and defect prediction
• Execute and maintain automated UI, API, and performance tests in cloud environments (Azure/AWS)
• Test AI-driven components, ensuring accuracy, consistency, and reliability of model behaviour
• Integrate AI-based test generation and regression analysis into QA pipelines
• Mentor other automation engineers and promote AI-driven QA best practices
• Collaborate with AI and product engineering teams on test coverage for LLM modules
Requirements
• Minimum 4 years’ experience in automation testing (enterprise-level systems)• Strong experience with Playwright and TypeScript/JavaScript
• Exposure to AI-powered coding tools (Copilot, Cursor, TabNine, etc.)
• Solid understanding of testing AI/ML systems and APIs
• Experience in CI/CD and version control (Git, Azure DevOps, or GitHub Actions)
• Good English and Polish communication skills (B2+/C1)
Nice to have
• Hands-on experience testing AI agents, pipelines, or LLM models
• Familiarity with LangChain, OpenAI APIs, or Azure AI Services
• Experience using AI-based test generation tools or observability frameworks
• ISTQB certification
• Knowledge of Docker, Kubernetes, or DevOps principles
Benefits
- Solid, competitive salary
- Work in multilingual, multinational and multicultural environment on international projects
- Comprehensive healthcare
- Long-term B2B contract with stable project pipeline
- Fully remote model