Agent QA

Agent QA (agent-qa), developed by Vostride, is an open-source testing harness and agent orchestrator built to automate software quality assurance and verification workflows using AI agents. Operating through a command-line interface, Agent QA evaluates applications against structured test definitions, validation schemas, and modular agent skills. Daily workflows rely on declarative configuration files such as agent-qa.config.yaml and hooks.yaml alongside Markdown-based instructions (agent-rules.md), allowing developers to execute test suites and validate configurations directly from the terminal or CI environments. What distinguishes Agent QA from general-purpose coding agents is its dedicated harness architecture focused specifically on QA execution, rule enforcement, and lifecycle hook integration. It standardizes web and application testing with deterministic validation steps and reproducible Docker execution environments rather than unstructured free-form code editing. Agent QA is distributed as open-source software under active development (v0.1.x release line) with containerization support for CI/CD pipelines.

Tags: agent harness, ai agent, cli, coding agent, developer tools, OpenSource

Visit Agent QA

Key features

• CLI Test Orchestration — Run and validate agent test suites from the command line using commands like agent-qa run and agent-qa validate. - Declarative YAML Configuration — Define test targets, validation rules, and agent settings using agent-qa.config.yaml. - Lifecycle Hooks Engine — Configure granular pre- and post-test hooks with unique IDs via hooks.yaml to manage test setups and validations. - Rule-Based Agent Steering — Guide agent decisions and testing boundaries through dedicated agent-rules.md files. - Modular Skills System — Extend agent capabilities using packaged skill definitions tailored to specific testing tasks. - Dockerized Execution — Execute testing runs inside isolated Docker containers for reproducible test outcomes across environments.

Use cases

Use Case: Automated Web and Codebase Verification QA engineers and developers execute agent-led test suites against web interfaces and application endpoints to catch regressions and validate functional behavior against written test specifications.

Use Case: Hook-Driven Test Lifecycle Management Teams define custom lifecycle triggers in hooks.yaml to handle environment initialization, data seeding, and post-test reporting automatically during agent test runs.

Use Case: CI/CD Pipeline Test Automation DevOps engineers integrate Agent QA into GitHub Actions workflows and Docker environments to run autonomous test validation gates before merging pull requests.

Who it is for

Agent QA is designed for QA engineers, developers, and DevOps practitioners seeking a structured, CLI-based harness to run agentic tests and enforce QA rules. It is not intended for non-technical users or developers looking for a conversational interactive chat assistant.

Install guide

Installation Clone the repository and install dependencies locally, or install the package if using a packaged release: bash git clone https://github.com/vostride/agent-qa.git cd agent-qa npm install

First Run Ensure your project contains the required configuration files (agent-qa.config.yaml, hooks.yaml, and agent-rules.md), then validate the configuration: bash npx agent-qa validate

Example Session Execute an automated test run using your project configuration: bash npx agent-qa run --config agent-qa.config.yaml

Part of CLI Coding Agents

Categories: AI Coding Agents, Code Assistants, Developer Tools

Related CLI agents

• SWE-agent — SWE-agent is an open-source autonomous software engineering agent harness built and maintained by researchers from Princeton University and Stanford University.…
• Agent Runbook — Agent Runbook is an open-source contract-based multi-agent skill framework developed by KnoxOps. It acts as an orchestrator and compiler that…
• Weaver — Weaver is an open-source agent harness and orchestration framework maintained by sean35mm on GitHub. Built on top of the Bun…
• Context Bridge — Context Bridge is an open-source CLI agent harness and context orchestration utility developed by serdardb. It is built to facilitate…
• Hivelore — Hivelore is an open-source agent harness and contextual memory orchestrator created by Doucs91. It provides persistent project memory, decision tracking,…
• Agentic Engineering Framework — Agentic Engineering Framework is an open-source orchestration harness and governance layer developed by Dimitri Geelen. It is designed to constrain,…