Look twice.Find the gem.

AI agents and MCP servers, each published with its source and what the checks found.

Marketplace

  • Everything
  • AI agents
  • Apps
  • MCP servers
  • Templates
  • What people want
  • What changed this week
  • The verification standard
  • The ooruby Index
  • Servers that publish no source
  • Reliability guides
  • What the catalogue holds
  • Sell here

Our library

  • Everything, in one place
  • Guides
  • Glossary
  • Calculators
  • Checklists and cheat sheets
  • Community

ooruby

  • Home
  • For teams
  • Site status
  • Company projects
  • RSS feed

Verification records what our published tests found on a specific version at a specific date. It is not a warranty, and it does not certify that software is free of defects.

AI agentsAppsMCP serversTemplatesWantedCommunityOur library
Sign inSell
Catalogue/Templates/Create Playwright AI

Create Playwright AI

caslanqa · Template

Create Playwright AI scaffolds a TypeScript test automation project built on Playwright. Alongside page objects and layered API tests, it includes an AI judge that evaluates chatbot or LLM responses against rubrics, choosing a local Ollama model by task complexity or a cloud model through a gateway. Named login sessions are signed in once and reused, and ESLint, Prettier, commit hooks and a GitHub Actions workflow are set up. Mobile tests with Maestro flows are optional.

Written by ooruby from the README of @caslanqa/create-playwright-ai 4.0.1.

Not claimed by its maker. Is this yours? Prove it and answer the findings

Why it's useful

You get a test project that can check AI chatbot answers as well as web pages and APIs, with the tooling already installed and set up.

What you could do with it

  1. 1Write a test that sends your chatbot a question and has the AI judge check the reply against a rubric.
  2. 2Declare an admin login once and reuse the cached session in every test that needs it.
  3. 3Scaffold the project with mobile testing included so Playwright also runs your Maestro flows.

Written from its documentation: what it says it can do, not what our checks found.

CPtemplateDeveloper tools

Maintenance

Not measured

No release date is on record for this package yet. The nightly publisher check records one as it reaches each npm package, about once every ten nights.

Release activity only: it says nothing about quality or safety, and a finished small package can be fine without releases. How it is measured

Not yet tested
Command execution is bounded
inventory
node child_process (mobile/create-device.mjs:18)
synchronous shell execution (mobile/create-device.mjs:185)
synchronous shell execution (mobile/create-device.mjs:292)
synchronous shell execution (mobile/create-device.mjs:296)
An inventory of where the code starts another program, not a verdict on this row: whether each one runs a fixed program or whatever it is handed takes a reading by hand.
Licence and provenance
finding
no LICENCE file at the root (.)

Published because it was found. A finding is information about where the limits are, not a verdict that the software is unsafe.

What this does not cover

  • ·Everything. Treat it as you would software from anywhere else.

Receipt history: every signed receipt for every version of this listing, and what changed between them.

In its maker's words

Scaffold a ready-to-run Playwright + TypeScript test framework: AI Judge for LLM evaluation, layered API testing, lazy session auth, and full tooling (ESLint, Prettier, husky, commitlint)

Compare with

  • Create Agentic Playwrightside by side
  • Openuidev CLIside by side
  • Create Agent Appside by side
Compare all 4

How far this has been checked

Static scanned

What it establishes
Its published package, or for a hosted server its source repository at a recorded commit, was read file by file, without running it, by every check in our current scan.
What it does not
How it behaves when it runs, or anything the scan does not read yet: several rubric checks, the repository's history, and compiled code in folders named dist or build. For a hosted server, that the endpoint runs the code that was read. The ooruby Index sets out exactly what was read.
Exactly what was read
Version 4.0.1, the file with digest sha512-jO1Z4/LTzUN3yr9X5aJ3QUhuC4B1a2gKy7mvOf+50vilCj0Zf8XLmnG0Xb1h9f7mMQEJ+3BcquOawG3TKR7b+g==, as the registry publishes it. A published version cannot be replaced, so this names the same bytes for anyone who checks.
Authentication
Runs locally. No hosted endpoint is listed for this package. You run it on your own machine, so there is no endpoint of ours to authenticate against.
How the rungs work

Adding it

Run it with:

npx -y @caslanqa/create-playwright-ai@4.0.1

Pinned to 4.0.1, which is the version the findings above were found in. Drop the version to take whatever is newest, and the report on this page stops describing what you installed.

Where this came from

Registry
npm
Package
@caslanqa/create-playwright-ai
Version read
4.0.1
Resolved
2026-10-09
Open the source(opens in a new tab)

Built from source, attested

npm publishes a signed statement that this exact package was built from the repository below, at this commit. It is verifiable without taking our word for it.

Repository
github.com/caslanqa/playwright-ai-distro
Commit
c7ddb043895e
Built by
github.com/actions/runner/github-hosted
Registry publish attestation
signed by npm · 2026-10-10
Checked
2026-10-10

The badge, if this is your listing

It renders the current rung (static scanned) and links back here, where what that does and does not establish is one click away. It updates itself as the evidence deepens.

[![ooruby: static scanned](https://ooruby.com/api/badge/caslanqa-create-playwright-ai)](https://ooruby.com/market/caslanqa-create-playwright-ai)

About this listing

Kind
Template
Category
Developer tools
Pricing
Free
Sandbox
No
Hosted
No
Updated
2026-10-03
Price
Free
Get it freeVisit maker
Rating
no reviews yet
0 want this so far
Sign in to vote

Sign in to watch this listing and hear when its version, rung or findings change.

Similar templates

All templates
OPtemplateDeveloper tools
Clean scanStatic scanned
Pick the OpenUI Cloud template with hosted models, or a self-hosted one using your own OpenAI-compatible key, then add a LangGraph, Vercel AI SDK or Vercel Eve backend if you want. It can also deploy the project to Vercel.

Openuidev CLI

openuidev
Free

Scaffolds OpenUI agent apps, mints Cloud API keys and turns component libraries into model prompts.

45.8k installs/moMIT
CMtemplateDeveloper tools
1 findingStatic scanned
Runs once as a project generator, so there is nothing to install first. Its interactive setup asks where to create the project and covers the Mastra directory, example agents, model provider and optional development tools.

Create Mastra

abhiaiyer
Free

Creates a new Mastra app with one command and helps you set up example agents and a model provider.

27.4k installs/moApache-2.0
CAtemplateDeveloper tools
1 findingStatic scanned
Builds the project on Tangle's agent-app package and leaves customisation notes to follow. Type checking and tests are there to run before you change anything, and the chat-first option points to a shared workspace composition.

Create Agent App

tangle-network
Free

Scaffolds a new Tangle agent application with either a tool loop or a complete chat interface.

13.5k installs/moMIT

Verification records what our published tests found on a specific version at a specific date. It is not a warranty, and it does not certify that software is free of defects.