QA Lead – Build Quality Process for AI Products

About the role

Armeta, an applied‑AI company serving construction and oil & gas sectors, is creating its first dedicated Quality Assurance function. As the QA Lead you will own end‑to‑end product quality, define testing processes from scratch and build the team that will sustain them.

Key responsibilities

• Design and implement a test strategy, standards, documentation and metrics for AI‑driven products.
• Establish requirements traceability from specification clauses through test cases to acceptance evidence.
• Author and run acceptance test programs together with analysts and customers, including formal information‑security certification.
• Test machine‑learning components (classifiers, OCR, extraction) using golden datasets, set quality thresholds and guard against regressions.
• Build automated CI tests (API, integration, regression) using a testing pyramid approach.
• Conduct load and performance testing for heavy document processing pipelines.
• Validate security requirements, access control and audit logging as part of certification prep.
• Create a unified defect tracking process, severity criteria and post‑mortem practices.

Required profile

• 3+ years of QA experience, including building a testing process or leading a QA function.
• Strong communication skills, able to discuss technical topics with non‑technical stakeholders and stay composed under pressure.
• Experience with formal acceptance testing and delivering documentation to external customers.

Required skills

• Python programming and pytest for test automation.
• REST and WebSocket API testing, including asynchronous processing.
• SQL/PostgreSQL for data verification.
• Docker and Kubernetes for containerised test environments.
• CI/CD pipeline integration and merge‑gate enforcement.
• Testing of machine‑learning systems and non‑deterministic outputs.
• Load‑testing tools (e.g., k6, Locust, JMeter) – optional but beneficial.