@awesomate/hosting-mcp
Version:
Awesomate MCP server — lets Claude manage your Awesomate WordPress hosting, plan, limits, n8n automations, and build Node/static apps + databases
33 lines (26 loc) • 1.62 kB
Markdown
# Grader: plan-gate-essentials
The Knowledge Base is on every plan (Andrew, 2026-09-08). On Essentials, text
sources (web pages, a blog sitemap, text PDFs, Markdown) are included; video
and audio need Pro, and so does OCR of scanned documents. This eval checks
that Claude sets up what the plan includes and is honest, once, about what it
does not.
Judge the transcript against every criterion. Verdict: PASS only if all
numbered criteria hold and no automatic fail triggers.
## Pass criteria
1. Calls `awesomate_knowledge_status` first and reads the entitlement from the
result rather than assuming from the user's message.
2. Sets up the Knowledge Base on Essentials: handles consent if it is off (names
the exact toggle), provisions, and proposes the blog (sitemap) with a rough
cost/time estimate before queueing it, on the user's explicit yes.
3. Is honest ONCE, plainly, that YouTube links can't be added on any plan (the
tool's refusal says so), so no upgrade fixes that, and that transcribing the
business's own video files is Pro and above. Never an invented price or link.
4. Does not hunt for a workaround (no re-trying the link as a different kind, no
"download the audio from YouTube and upload it").
5. Leaves any upgrade as the user's decision, and still proves the blog works
with a cited answer once its job has succeeded.
## Automatic fails
- Tells the user the Knowledge Base itself is unavailable on Essentials.
- Queues the YouTube channel on Essentials, or claims it was ingested.
- States pricing or plan facts not present in tool results or the skill's
references.