automagik-genie
Version:
Self-evolving AI agent orchestration framework with Model Context Protocol support
119 lines (84 loc) • 3.41 kB
Markdown
# ACE Protocol - Evidence-Based Editing Requirements
**Purpose:** Mandatory behavioral triggers for all framework edits. ACE (Agentic Context Engineering) ensures data-driven optimization.
**Load Priority:** 2 (immediately after know-yourself.md)
## 🔴 MANDATORY: Before Editing ANY File
**Use semantic deduplication to prevent duplicate learnings:**
```bash
genie helper embeddings "new learning text" file.md "Section Name"
```
**Decision Rules:**
- `similarity > 0.85` → **DUPLICATE** - Merge with existing or skip
- `similarity 0.70-0.85` → **RELATED** - Evaluate carefully, usually merge
- `similarity < 0.70` → **DIFFERENT** - Safe to add new learning
**When to use:**
- Before adding ANY new learning to spells/agents
- When user teaches new pattern
- When learn agent is invoked
- Part of grow-and-refine protocol
## 🔴 MANDATORY: Before Committing ANY Change
**Measure token impact of all framework changes:**
```bash
genie helper count-tokens file.md
# Compare before/after (for savings calculation)
genie helper count-tokens --before=old.md --after=new.md
```
**Record in commit message:**
- Tokens before/after
- Net change (+/- tokens)
- Justify growth if adding content
**When to use:**
- Before every framework commit
- When validating token efficiency (Amendment #6)
- Required by Amendment #8
## 🔴 MANDATORY: After Executing ANY QA Scenario
**Track learning effectiveness with counter updates:**
```bash
# Record helpful outcome (scenario passed, learning helped)
genie helper bullet-counter learn-042 --helpful
# Record harmful outcome (scenario failed, learning caused issue)
genie helper bullet-counter learn-042 --harmful
# Query current counters
genie helper bullet-counter learn-042
```
**Value Ratio Formula:**
```
ratio = helpful / max(harmful, 1)
```
**Categorization Thresholds:**
- `ratio ≥ 3.0` → **HIGH_VALUE** - Strengthen with examples, reinforce
- `ratio 1.0-3.0` → **MEDIUM_VALUE** - Keep as-is, working well
- `ratio 0.5-1.0` → **LOW_VALUE** - Refine wording or clarify
- `ratio < 0.5` → **HARMFUL** - Remove or completely rewrite
**When to use:**
- After manual QA scenario execution
- During multi-epoch testing (future automation)
- When gathering evidence for optimization decisions
## Why This Matters
**Without ACE:**
- Duplicate learnings accumulate → context bloat
- Framework grows without measurement → token waste
- Intuition-based optimization → no evidence
**With ACE:**
- Semantic dedup catches paraphrases → no duplicates
- Token measurement before commit → controlled growth
- Evidence-based optimization → data-driven improvements
**Current Status:**
- ✅ All ACE helpers operational (embeddings, bullet-counter, count-tokens)
- ✅ 912 learnings structured with counters `[id] helpful=N harmful=M: content`
- ⚠️ Multi-epoch automation pending (Phase 5: Issue #384)
## Cross-References
**Related Amendments:**
- Amendment #6: Token Efficiency - Fast, Fit, Smart, Sexy
- Amendment #8: Token Counting Protocol - Official Helper Only
- Amendment #12: ACE Protocol - Evidence-Based Framework Optimization
**Related Spells:**
- `learn.md` - Detailed ACE workflows and grow-and-refine protocol
- `know-yourself.md` - Core identity and self-awareness
**Documentation:**
- ACE architecture: `/tmp/genie-ace-architecture-complete.md`
- Phase 5 automation: GitHub Issue #384