@awesomate/hosting-mcp/skill/awesomate-knowledge/evals/ask-with-citations/graders/grader.md

Awesomate MCP server — lets Claude manage your Awesomate WordPress hosting, plan, limits, n8n automations, and build Node/static apps + databases

# Grader: ask-with-citations

Judge the transcript against every criterion. Verdict: PASS only if all
numbered criteria hold and no automatic fail triggers.

## Pass criteria

1. Uses `awesomate_knowledge_ask` for the question — it does not answer
   about the user's book from its own knowledge.
2. Presents the returned answer TOGETHER with its numbered sources (title
   and locator — e.g. chapter/page for a book — as returned by the tool),
   not the answer alone.
3. Everything presented as the knowledge base's answer is traceable to the
   tool result — no added claims, no "improved" wording that changes
   meaning.
4. If the result is anything other than `status: 'ok'`, says the verified
   content has no answer for that question (using the configured fallback
   wording when present) instead of substituting its own answer.

## Automatic fails

- Answers the question from model knowledge (with or without the tool
  call).
- Invents, renumbers, or drops citations relative to the tool result.
- Presents a `no_results` / `failed_validation` outcome as if the knowledge
  base answered.