pjt222/forage-solutions

Loesungen erkunden

Erkunden a solution space using ant colony optimization principles — deploying independent hypotheses as scouts, reinforcing promising approaches durch evidence, detecting diminishing returns, and knowing when to abandon a strategy and explore elsewhere.

Wann verwenden

• Facing a problem with multiple plausible approaches and no clear winner
• When the first approach tried ist nicht working but alternatives are unclear
• Debugging with no obvious root cause — multiple hypotheses need parallel investigation
• Searching a codebase for die Quelle of a behavior when the location is unknown
• When previous solution attempts have converged prematurely on a suboptimal approach
• Complementing build-coherence when die Loesung space muss explored vor a decision is made

Eingaben

• Erforderlich: Problem description or goal (what are we foraging for?)
• Erforderlich: Current state of knowledge (what is already known?)
• Optional: Previous approaches tried and their outcomes
• Optional: Constraints on exploration (time budget, tool availability)
• Optional: Urgency level (affects exploration-exploitation balance)

Vorgehensweise

Schritt 1: Abbilden the Solution Landscape

Before deploying scouts, characterize the shape of die Loesung space.

Solution Distribution Types:
┌────────────────────┬──────────────────────────────────────────────────┐
│ Type               │ Characteristics and Strategy                     │
├────────────────────┼──────────────────────────────────────────────────┤
│ Concentrated       │ One correct answer exists (bug fix, syntax       │
│ (one right fix)    │ error). Deploy many scouts quickly to locate     │
│                    │ it. Exploit immediately when found               │
├────────────────────┼──────────────────────────────────────────────────┤
│ Distributed        │ Multiple valid approaches (architecture choice,  │
│ (many valid paths) │ implementation strategy). Scouts assess quality  │
│                    │ of each. Use `build-coherence` to choose         │
├────────────────────┼──────────────────────────────────────────────────┤
│ Ephemeral          │ Solutions depend on timing or sequence (race     │
│ (time-sensitive)   │ conditions, order-dependent bugs). Fast scouting │
│                    │ with immediate exploitation. Cannot revisit       │
├────────────────────┼──────────────────────────────────────────────────┤
│ Nested             │ Solving the surface problem reveals a deeper one │
│ (layers of cause)  │ (config issue masking an architecture problem).  │
│                    │ Scout at each layer before committing to depth   │
└────────────────────┴──────────────────────────────────────────────────┘

Classify the current problem. The distribution type determines how many scouts to deploy and how quickly to switch from exploration to exploitation.

Erwartet: A clear characterization of die Loesung landscape that informs scouting strategy. The classification should feel accurate to das Problem, not forced.

Bei Fehler: If the landscape is vollstaendig unknown, that itself is the classification — treat it as potentially distributed and deploy broad scouts. The first round of scouting will reveal the landscape character.

Schritt 2: Bereitstellen Scout Hypotheses

Generieren independent hypotheses as scouts. Each scout probes die Loesung space in a different direction.

1. Generieren 3-5 independent hypotheses about das Problem or its solution
2. Fuer jede hypothesis, define one cheap test — a single file read, one grep, one specific check
3. Rate initial promise basierend auf available evidence (not gut feeling)
4. Bereitstellen scouts independently: nicht let the assessment of hypothesis A influence der Test of hypothesis B

Scout Deployment Template:
┌───────┬──────────────────────┬──────────────────────┬──────────┐
│ Scout │ Hypothesis           │ Test (one action)    │ Promise  │
├───────┼──────────────────────┼──────────────────────┼──────────┤
│ 1     │                      │                      │ High/Med/│
│ 2     │                      │                      │ Low      │
│ 3     │                      │                      │          │
│ 4     │                      │                      │          │
│ 5     │                      │                      │          │
└───────┴──────────────────────┴──────────────────────┴──────────┘

Key principle: scouts assess, they nicht exploit. The goal is a quick signal on each hypothesis, not a deep investigation of the first one that looks promising.

Erwartet: 3-5 independent hypotheses with cheap tests defined. No hypothesis wurde deeply explored yet — this is a breadth-first pass.

Bei Fehler: If fewer than 3 hypotheses kann generated, das Problem is either very constrained (concentrated type — good, scout aggressively) or understanding is too shallow (read more context vor hypothesizing). If hypotheses sind nicht independent (they are all variations of the same idea), the exploration is too narrow — force mindestens one hypothesis that contradicts the others.

Schritt 3: Trail Reinforcement — Follow the Evidence

After scout results return, reinforce promising trails and let weak ones decay.

1. Ueberpruefen scout results: which hypotheses found supporting evidence?
2. Strong evidence found → reinforce the trail: invest more investigation effort here
3. No evidence found → let the trail decay: nicht investigate further ohne new signals
4. Contradicting evidence found → mark as inhibition signal: actively avoid this path
5. Ueberwachen for premature convergence: if all effort flows to the first trail reinforced, force one scout into unexplored territory

Trail Reinforcement Decision:
┌───────────────────────────┬──────────────────────────────────────┐
│ Scout Result              │ Action                               │
├───────────────────────────┼──────────────────────────────────────┤
│ Strong supporting evidence│ REINFORCE — deepen investigation     │
│ Weak supporting evidence  │ HOLD — one more cheap test before    │
│                           │ committing                           │
│ No evidence               │ DECAY — deprioritize, scout elsewhere│
│ Contradicting evidence    │ INHIBIT — mark as dead end           │
│ Ambiguous result          │ REFINE — hypothesis was too vague,   │
│                           │ sharpen and re-scout                 │
└───────────────────────────┴──────────────────────────────────────┘

Erwartet: A clear prioritization of trails basierend auf evidence, not preference. The strongest trail gets the most attention, but mindestens one alternative stays alive.

Bei Fehler: If all scouts return empty, the hypotheses were wrong — not der Ansatz. Reframe the question: "What assumptions am I making that could be wrong?" Generieren new hypotheses from a different angle. If all scouts return strong signals, das Problem kann distributed (multiple valid answers) — switch to build-coherence for approach selection.

Schritt 4: Marginal Value Theorem — Know When to Leave

Ueberwachen the yield of the current approach. When the information gained per unit of effort drops unter the average across all approaches, it is time to switch.

Marginal Value Assessment:
┌────────────────────────┬──────────────────────────────────────────┐
│ Signal                 │ Action                                   │
├────────────────────────┼──────────────────────────────────────────┤
│ New information per    │ CONTINUE — this trail is productive      │
│ action is high         │                                          │
├────────────────────────┼──────────────────────────────────────────┤
│ New information per    │ PREPARE TO SWITCH — squeeze remaining    │
│ action is declining    │ value, begin scouting alternatives       │
├────────────────────────┼──────────────────────────────────────────┤
│ Last 2-3 actions       │ SWITCH — the trail is depleted. The cost │
│ yielded nothing new    │ of staying exceeds the cost of switching │
├────────────────────────┼──────────────────────────────────────────┤
│ Information contradicts│ SWITCH IMMEDIATELY — not just depleted   │
│ earlier findings       │ but misleading. Cut losses               │
└────────────────────────┴──────────────────────────────────────────┘

Important: factor in switching cost. Moving to a new hypothesis means loading new context, which has a cost. Do not switch for marginal gains — switch when the current trail is clearly depleted.

Erwartet: A deliberate decision to continue or switch basierend auf yield assessment, not habit or frustration. Switches are evidence-based, not impulse-driven.

Bei Fehler: If switching happens too frequently (oscillation zwischen hypotheses), the switching cost is being undervalued. Commit to the current trail for N more actions vor reassessing. If switching never happens (stuck on one trail despite declining yield), set a hard cap: nach N unproductive actions, switch unabhaengig von sunk cost.

Schritt 5: Adapt Strategy to Results

Based on the foraging results, select the appropriate next phase.

1. Most scouts empty, one trail weak → das Problem is likely misframed. Step back and reframe: what question should we be asking?
2. One strong trail, others empty → concentrated problem. Exploit the strong trail with full attention
3. Multiple competing trails → distributed problem. Anwenden build-coherence to select among them
4. Clear winner emerging → transition from exploration to exploitation. Reduzieren scouting budget to 10-20% (keep one scout active for alternatives), commit primary effort to the winning approach
5. All trails exhausted → die Loesung may not exist in the current search space. Expand: different tools, different assumptions, ask der Benutzer

Erwartet: A strategic decision about the next phase that follows logically from the foraging results. The decision should feel like a conclusion, not a guess.

Bei Fehler: If no strategy feels right, the foraging has revealed genuine uncertainty — and that is a valid outcome. Communicate the uncertainty to der Benutzer: "I explored N approaches and found X. The most promising is Y because Z. Shall I pursue it, or do you have additional context?"

Validierung

• [ ] Solution landscape was characterized vor scouting began
• [ ] At least 3 independent hypotheses were generated and tested
• [ ] Scout tests were cheap (one action each) and independent
• [ ] Trail reinforcement was basierend auf evidence, not preference
• [ ] Marginal value was assessed vor committing to deep investigation
• [ ] The strategy adapted to results anstatt following a fixed plan

Haeufige Stolperfallen

• Premature exploitation: Diving deep into the first hypothesis that shows any promise ohne scouting alternatives. This is the most common failure — the first good idea is often not the best idea
• Perpetual scouting: Generating hypotheses endlessly ohne ever committing to one. Set a budget: nach N scouts, commit to the best trail regardless
• Non-independent hypotheses: "Maybe it's in file A" and "maybe it's in file B, which is imported by file A" sind nicht independent — they share assumptions. Force genuine diversity of approach
• Ignoring inhibition signals: When evidence contradicts a hypothesis, let it go. Continuing to invest in a contradicted trail because of effort already spent is the foraging equivalent of sunk cost fallacy
• Scouting ohne recording: If scout results sind nicht recorded, later scouts will repeat earlier work. Briefly note what each scout found vor moving to the next

Verwandte Skills

• forage-resources — the multi-agent foraging model that this skill adapts to single-agent solution search
• build-coherence — used when foraging reveals multiple valid approaches that need evaluation
• coordinate-reasoning — manages the information flow zwischen scout hypotheses and exploitation phases
• awareness — monitors for premature convergence and tunnel vision waehrend foraging