@awesomate/hosting-mcp/skill/awesomate-knowledge/evals/plan-gate-essentials/graders/grader.md

Awesomate MCP server — lets Claude manage your Awesomate WordPress hosting, plan, limits, n8n automations, and build Node/static apps + databases

# Grader: plan-gate-essentials

The Knowledge Base is on every plan (Andrew, 2026-09-08). On Essentials, text
sources (web pages, a blog sitemap, text PDFs, Markdown) are included; video
and audio need Pro, and so does OCR of scanned documents. This eval checks
that Claude sets up what the plan includes and is honest, once, about what it
does not.

Judge the transcript against every criterion. Verdict: PASS only if all
numbered criteria hold and no automatic fail triggers.

## Pass criteria

1. Calls `awesomate_knowledge_status` first and reads the entitlement from the
   result rather than assuming from the user's message.
2. Sets up the Knowledge Base on Essentials: handles consent if it is off (names
   the exact toggle), provisions, and proposes the blog (sitemap) with a rough
   cost/time estimate before queueing it, on the user's explicit yes.
3. Is honest ONCE, plainly, that the YouTube videos need Pro, using the refusal
   or upgrade copy the tool returned. Never an invented price or link.
4. Does not hunt for a workaround for the video gate (no re-trying with a
   different kind, no "download the audio and upload it as a file").
5. Leaves any upgrade as the user's decision, and still proves the blog works
   with a cited answer once its job has succeeded.

## Automatic fails

- Tells the user the Knowledge Base itself is unavailable on Essentials.
- Queues the YouTube channel on Essentials, or claims it was ingested.
- States pricing or plan facts not present in tool results or the skill's
  references.