Build and shipClaude apps and Claude Code

Anthropic / webapp-testing

How do you stop an agent claiming a web change works?

Make checking part of the job, not an optional extra step.

What to remember

  1. The failure it prevents is the confident false report, which is the costliest one.
  2. It needs a running application. It is not static analysis.
  3. Ask for observations, not conclusions. What appeared on screen is checkable, what worked is not.
  4. It pairs with verification-before-completion, which turns the habit into a rule.

01What it changes in practice

The default failure mode of coding agents is not writing bad code. It is writing plausible code and then reporting that the task is done without ever running it. Every hour lost to that pattern is spent discovering the failure later, in a worse place.

Driving the actual application changes the report from a claim into evidence. The useful output is not the words the agent used but the sequence of actions and what the page did in response.

02Where it disappoints

It verifies behaviour, not intent. A flow can pass every step and still be the wrong flow, which is a product question the skill cannot answer.

Flaky selectors and timing issues also carry over from ordinary browser automation, so expect to make the checks specific rather than broad.

Install and first run

  1. Install it from anthropics/skills under Apache 2.0.
  2. Have the application running locally first, because the skill drives a real app rather than imagining one.
  3. Ask for the check to be described as a user action and an expected observation, not as a claim of success.

Questions people actually ask

Does it replace a test suite?
No. It verifies work in progress. A durable test suite still belongs in the repository.
Does the app have to be running?
Yes. It drives a real application, so the server has to be up before it can check anything.
What should I ask it to report?
Actions and observations. What was clicked, and what appeared afterwards. Conclusions without observations are the failure it exists to stop.

Sources

  1. anthropics/skills on GitHubrepository
  2. anthropics/skills, webapp-testing skill directorydocumentation

Machine readable versions of this page