aiwg/tools/eval/datasets/structured-output/json-generation.yaml

Deployment tool and support utility for AI context. Copies agents, skills, commands, rules, and behaviors into the paths each AI platform reads (Claude Code, Codex, Copilot, Cursor, Warp, OpenClaw, and 6 more) so one source of truth works across 10 platfo

id: structured-output-json
dimension: structured-output
difficulty: basic
prompt: |
  Generate a valid JSON manifest for an AIWG addon called "code-analysis"
  with the following fields: id, type (must be "addon"), name, version (1.0.0),
  description, keywords (array of 3), and dependencies (object with required
  and optional arrays). Output only the JSON, no explanation.
expected:
  valid_json: true
  contains:
    - "code-analysis"
    - "addon"
    - "1.0.0"
    - "keywords"
    - "dependencies"
scoring:
  correct_tool: 0.3
  correct_params: 0.5
  no_hallucination: 0.2