aiwg/tools/eval/datasets/tool-use/basic-edit.yaml

Deployment tool and support utility for AI context. Copies agents, skills, commands, rules, and behaviors into the paths each AI platform reads (Claude Code, Codex, Copilot, Cursor, Warp, OpenClaw, and 6 more) so one source of truth works across 10 platfo

id: tool-use-basic-edit
dimension: tool-use
difficulty: basic
prompt: |
  You need to read the file at src/example.ts and change the function name
  from "processData" to "transformData". What tool calls would you make?
  List each tool call with its parameters.
expected:
  tool_calls:
    - tool: Read
      params_contain:
        file_path: "src/example.ts"
    - tool: Edit
      params_contain:
        old_string: "processData"
        new_string: "transformData"
scoring:
  correct_tool: 0.4
  correct_params: 0.4
  no_hallucination: 0.2