Skip to content

test(agent_patterns): S5 scenario diversification — categories beyond coding + C16 spread#80

Merged
dongwhee merged 2 commits into
developfrom
test/s5-scenario-diversification
Jun 7, 2026
Merged

test(agent_patterns): S5 scenario diversification — categories beyond coding + C16 spread#80
dongwhee merged 2 commits into
developfrom
test/s5-scenario-diversification

Conversation

@dongwhee

@dongwhee dongwhee commented Jun 6, 2026

Copy link
Copy Markdown
Collaborator

Summary

Roadmap S5 (시나리오 다양화) — the last open item from docs/superpowers/plans/2026-06-05-trawl-improvement-roadmap.md. Catalog-only change (no harness code), as the S5 gate requires.

New patterns (6)

pattern shard category scenario
hermes_bbc_tech_repeat_check workflows repeat_visits news-section monitoring loop (3 visits, cache_hit + visit-3 suggest_profile)
openclaw_coingecko_eth_repeat_check workflows repeat_visits crypto price polling loop
openclaw_error_dead_news_article news error_handling dead yna.co.kr article URL, graceful
hermes_error_yahoo_invalid_ticker finance error_handling hallucinated ticker, graceful
hermes_wiki_en_world_war_ii_large wiki_reference large_page huge en article, n_chunks_max 12 + output_chars_max 8000
openclaw_wiki_ko_korea_large wiki_reference large_page large CJK article, same budgets

Multi-op repeat_visits patterns stay in workflows.yaml per the README convention so the stateful catalog-unique-URL rule (S1 lesson) remains auditable in one file; both use catalog-unique URLs (/innovation, /coins/ethereum).

C16 enrichment spread (5 existing single_fetch patterns, all non-coding)

  • excerpts_min_count: hermes_hn_front_page, hermes_fred_cpi, claude_code_wiki_en_yi_sunsin
  • chain_hints_has_key: wiki en/ko yi_sunsin (search_template), ja sushi (recommended_followup_filter)
  • page_entities_contain_any: ko yi_sunsin (probe-observed 임진왜란/해전)
  • outbound_links_contain_any deliberately unused — live probes found no drift-stable surface (HN links rotate, GitHub 1 top-k-dependent link, wikipedia fetcher 0 links)

Gate evidence (pre-registered in roadmap S5)

  • 신규 패턴 전부 live PASS: 6/6 individually + in the full shared-state run
  • Full 110-pattern run: 101 PASS + 9 SKIP, exit 0 — all 9 SKIPs are from the known pre-S5 live:optional family (Reuters x2, MarketWatch, NBA scores, DDG x4, arxiv-to-DDG compositional; naver host_transfer drew a good VLM selector and PASSed this run) → coding 24/24 preserved
  • --dry-run: 110/110 schema valid
  • 하네스 코드 변경 없음 (S1-(b),(c) 위에서 카탈로그만)

lyla added 2 commits June 6, 2026 20:22
… coding + C16 spread

Roadmap S5 (2026-06-05). Catalog-only change (no harness code), built on
S1's live:optional + multi-op groundwork.

New patterns (6, all live PASS individually and in the full run):
- repeat_visits x2 in workflows.yaml (stateful multi-op stays in one file
  so the catalog-unique-URL rule remains auditable): BBC /innovation news
  monitoring loop, CoinGecko ETH price polling loop. Both assert C8
  cache_hit on revisit + visit-3 suggest_profile (threshold verified
  deterministic in pipeline.VISIT_HINT_THRESHOLD=3).
- error_handling x2 in domain shards: dead yna.co.kr article URL (news),
  hallucinated Yahoo Finance ticker (finance). Graceful no-crash only.
- large_page x2 in wiki_reference: en World_War_II (observed 7.2-9.0 s),
  ko 대한민국 CJK large article (observed 5.8-8.2 s); both carry the
  n_chunks_max=12 / output_chars_max=8000 budgets from the existing
  Korean_War pattern.

C16 enrichment assertions spread to 5 existing single_fetch patterns,
all non-coding so the coding 24/24 surface is untouched:
- excerpts_min_count: hermes_hn_front_page, hermes_fred_cpi,
  claude_code_wiki_en_yi_sunsin
- chain_hints_has_key: wiki en/ko yi_sunsin (search_template), ja sushi
  (recommended_followup_filter)
- page_entities_contain_any: ko yi_sunsin (probe-observed 임진왜란/해전;
  en wiki entities observed empty — title not in heading_paths — so en
  asserts excerpts/chain_hints instead)
- outbound_links_contain_any left unused: live probes found no stable
  surface (HN links rotate with stories, GitHub had 1 top-k-dependent
  link, wikipedia fetcher yields 0)

Gate: full 110-pattern shared-state run 101 PASS + 9 SKIP (same
live:optional set as before S5), exit 0. dry-run schema 110/110.
@dongwhee dongwhee merged commit 1bf35d3 into develop Jun 7, 2026
4 checks passed
@dongwhee dongwhee deleted the test/s5-scenario-diversification branch June 7, 2026 11:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant