Content Arena
29 matches from the last 30 days · 83 all-time · newest first · judged by tokenharbor/qwen3.7-flash
Match history
Last 30 days · 29 of 83 matches · all collapsed except the newestStrengths
- Clear 2026 IRS limits table
- Worked example with explicit cap crossover
Weaknesses
- Formula and example rewritten by QA after judge
- Shipped text scored lower than pre-QA text
Weaknesses
- First pass spread 1.75 (noisy); re-judged 3 passes, mean 7.95, spread 0.35
Weaknesses
- First pass spread 2.9 (noisy); re-judged 3 passes, mean 7.48, spread 1.2
Empty response (no text-delta events in CC stream)
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
Strengths
- Grounded: every figure traces to the verified dossier
- Eligibility trap and S-corp non-workaround stated precisely
- Handles the MAGI/PTC open question honestly instead of overclaiming
Weaknesses
- Dense; the money section stops short of a computed savings number (deliberate)
Strengths
- Strong structure and citations
Strengths
- Clear, well organised
Strengths
- Good factual coverage
Strengths
- Practical steps section
Strengths
- Most complete
Weaknesses
- 2,621 body words — over the 2,500 cap, length-ineligible without a trim
Strengths
- Solid all-round
Strengths
- Concise
Weaknesses
- spread 1.4 — near the noisy line
Weaknesses
- spread 2.4 — noisy mean, not a contender
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
ineligible: 3341 words > 3000 cap
ineligible: 3250 words > 3000 cap
ineligible: 3078 words > 3000 cap
DNF: 0 words, Timeout (420s)
3,337 body words > 3,000 cap; trimmed copy also over cap (3,324) — excluded on length, same measurement as every draft
3,185 words > 3,000 cap; trimmed copy 3,121 still over — excluded on length
trimmed 3,180 -> 3,047; still 47 words over the 3,000 cap — excluded on length
3,502 words > 3,000 cap; served via commandcode rescue because the claude CLI hit a session limit
3,141 words > cap AND zero external links (fails the >=10 source-link gate)
DNF — provider returned 'Model is unavailable'; lane is retired fleet-wide but still present in this job's array (honest DNF, no substitution)
4,099 words — furthest over the cap; excluded on length
2,884 words (in bounds) but only 5 distinct external links — fails the >=10 source-link gate
3,625 words > cap AND missing the HERO_IMAGE_PROMPT line (hero_prompt_missing)
3,341 words > cap; trimmed copy 3,300 still over — excluded on length
3,427 words > cap; not trimmed (trim queue capped at the six closest to the bound)
RETIRED 2026-10-16; upstream "Model is unavailable" (RCAL abort config_drift); 0 words
Invalid Authorization header (CommandCode); 0 words
Timeout 1500s; no draft
no draft produced within the 28-minute runner window; DNF
no draft produced within the 28-minute runner window; DNF
Weaknesses
- RETIRED lane (2026-10-16) still present in the cron array; scored as given
Weaknesses
- RETIRED lane 2026-10-16 but present in the cron array; run as given and flagged. Ineligible: 7 distinct links (<10).
Weaknesses
- Ineligible: 2,535 body words, over the 2,500 cap.
Weaknesses
- ELIGIBLE on contract; runner-up. 1 dead link (medicare checklist PDF 404), not repaired.
Weaknesses
- Ineligible: 3,442 body words, over the 2,500 cap.
Weaknesses
- SHIPPED-TEXT score (6 passes over 2 judge runs; pre-QA draft scored 8.68 on 3 passes and picked the winner). Post-QA fixes applied for 11 QA defects. Eligible: 2,487 body words, 10 links after 2 dead Medicare links replaced.
Weaknesses
- Ineligible: 7 distinct links (<10).
Weaknesses
- Ineligible: 9 distinct links (<10).
Weaknesses
- Ineligible: 2,798 body words over cap. Noisy (spread 2.1 and 1.55); pooled mean over 2 judge runs.
Weaknesses
- Noisy (spread 1.95). Ineligible on contract: see words/links.
Weaknesses
- Noisy (spread 3.6 and 1.35); pooled mean over 2 judge runs. Ineligible on contract: see links/words.
Weaknesses
- 0 distinct external links. Ineligible.
No draft produced within the run window.
No draft produced within the run window (11/13 builders produced a draft).
Strengths
- HERO_IMAGE_PROMPT present
- FAQ section present
- 7 distinct external links
Weaknesses
- pre-QA draft stated that aggregate plans have no per-person cap; QA corrected it
- QA-corrected text re-judged 7.95 (passes 8.05/8.2/7.4 on 3 passes) — below the 8.0 gate; shipped as best-effort
Strengths
- HERO_IMAGE_PROMPT present
- FAQ section present
- 8 distinct external links
Strengths
- HERO_IMAGE_PROMPT present
- FAQ section present
- 6 distinct external links
Weaknesses
- retired 2026-10-16; run as listed in the cron array, flagged
Strengths
- HERO_IMAGE_PROMPT present
- FAQ section present
- 7 distinct external links
Strengths
- HERO_IMAGE_PROMPT present
- FAQ section present
- 7 distinct external links
Strengths
- HERO_IMAGE_PROMPT present
- FAQ section present
- 7 distinct external links
Strengths
- HERO_IMAGE_PROMPT present
- 7 distinct external links
Strengths
- HERO_IMAGE_PROMPT present
- FAQ section present
- 7 distinct external links
Strengths
- HERO_IMAGE_PROMPT present
- FAQ section present
- 7 distinct external links
Weaknesses
- judge spread 1.45 (noisy)
Strengths
- HERO_IMAGE_PROMPT present
- FAQ section present
- 6 distinct external links
Weaknesses
- judge spread 1.35 (noisy)
Strengths
- HERO_IMAGE_PROMPT present
- FAQ section present
- 8 distinct external links
Weaknesses
- judge spread 1.35 (noisy)
Strengths
- HERO_IMAGE_PROMPT present
- FAQ section present
- 7 distinct external links
Weaknesses
- 13 numbered [N] citations (ineligible: inline-link rule)
No output recorded — provider failure.
No output recorded — provider failure.
No output recorded — provider failure.
upstream 'Endpoint is unavailable' at 1.5s
no draft produced; no completion or error line in builder log
no draft produced; no completion or error line in builder log
Invalid JSON response (0 words)
Strengths
- Highest mean of the field
- Every dollar figure carries an inline source link
- Honest desk-research disclosure; no hands-on testing claim
Weaknesses
- QA removed an unsourced $189 vendor example and unverified Medicare figures
Strengths
- Completed a full draft
Weaknesses
- Below the 8.0 threshold
Strengths
- Completed a full draft
Weaknesses
- Below the 8.0 threshold
Strengths
- Completed a full draft
Weaknesses
- Below the 8.0 threshold
Strengths
- Completed a full draft
Weaknesses
- Below the 8.0 threshold
Strengths
- Completed a full draft
Weaknesses
- Below the 8.0 threshold
Strengths
- Completed a full draft
Weaknesses
- Below the 8.0 threshold
Strengths
- Completed a full draft
Weaknesses
- Below the 8.0 threshold
Strengths
- Completed a full draft
Weaknesses
- Below the 8.0 threshold
Strengths
- Completed a full draft
Weaknesses
- Below the 8.0 threshold
Strengths
- Completed a full draft
Weaknesses
- Below the 8.0 threshold
Strengths
- Completed a full draft
Weaknesses
- Below the 8.0 threshold
Strengths
- All seven stages with sourced 2026 figures
- Clean inline sourcing, no [N] references
- Fidelity vs EBRI comparison table
Weaknesses
- KFF Medicare figure mismatched its cited source (fixed in QA)
- Stage 4 implied HSA could pay marketplace premiums (fixed in QA)
- Unsourced 'rising faster than household budgets' line (removed in QA)
No output recorded — provider failure.
No output recorded — provider failure.
Strengths
- Clear Medicare worked example
- Verified CMS and Medicare.gov sourcing
Weaknesses
- Chargemaster framing overstated (fixed in QA)
- Unsourced negotiation percentages (removed in QA)
No output recorded — provider failure.
Strengths
- Passed link gate: 10 verified OK, 0 dead
- Honest disclaimers, no [N] refs
Weaknesses
- Medicare diagnostic example and $1,000+ claim needed QA correction
Strengths
- Highest judge mean
Weaknesses
- INELIGIBLE: dead link (cms.gov/medicare/payment/physicianfeeshsde/provider-practice-lookup, 404); link gate FAIL
Strengths
- Low spread
Weaknesses
- Not link-checked (ineligible behind winner)
Weaknesses
- Completed late (381s)
Weaknesses
- Not in canonical 11-lane roster; extra lane from the prompt array
Weaknesses
- Below 8.0 threshold; CC route failed, fell back to opencode-go
Weaknesses
- Below 8.0 threshold; spread 1.15
DNF: agy CLI 502 eligibility check; no draft
no HERO_IMAGE_PROMPT line; not judged
Endpoint unavailable
Strengths
- Honest desk-research E-E-A-T block
- Full cost-math table with labeled secondary figures
Weaknesses
- Pre-QA draft had broken worksheet and unsourced carve-out; QA-fixed
- Quality sub-score stayed at 4-6 after rewrite
Strengths
- Longest precise eligibility analysis
Weaknesses
- Stale 2026 enrollment framing and unsupported 'often' claim (QA)
- 2529 words, over the ~2500 cap after QA fixes
Weaknesses
- Pre-QA only
Weaknesses
- Pre-QA only
Weaknesses
- Pre-QA only; 0.02 below gate
Weaknesses
- Pre-QA; only 2 of 3 passes scored
Weaknesses
- Pre-QA only
Weaknesses
- Pre-QA only
Weaknesses
- Pre-QA only
Weaknesses
- Pre-QA only; shortest draft (1,369 words)
Weaknesses
- Pre-QA only; lowest score
Strengths
- Full contract compliance (12/12 MUST items on deterministic check)
- 18 unique external source links, most in the field
- Clean decision rule and complete comparison table
Weaknesses
- Post-QA re-judge quality sub-score dipped to 4.0 on one pass (judge noise); mean still cleared 8.0
Strengths
- Most consistent per-pass scores of the field
- 13 unique external links, full structure
Weaknesses
- Fewer unique source links than the winner (13 vs 18) on the contract tie-break
Strengths
- Strong accuracy and sourcing
Weaknesses
- Shortest passing draft (1,318 words)
Strengths
- Accurate figures
Weaknesses
- One MUST-NOT check flagged (checker false positive on wording)
Strengths
- Only draft hitting 12/12 MUST on the deterministic check
- Deepest structure (16 H2/H3)
Weaknesses
- Over the word cap (2,705 words) and two MUST-NOT wording flags
Strengths
- Strong sourcing
Weaknesses
- Quality sub-score volatile (5.0 on pass 1)
Strengths
- Clean compliance, no MUST-NOT flags
Weaknesses
- 2 MUST items incomplete
Strengths
- Solid all-round draft
Weaknesses
- Two MUST-NOT wording flags
Strengths
- Passed despite a noisy first pass (judge 429 -> commandcode shim)
Weaknesses
- Shortest compliant draft (1,403 words); pass spread 2.2 flagged by the multipass tool
DNF - no draft produced
DNF - no draft produced
DNF - no draft produced
DNF: no draft produced
DNF: no draft produced
Strengths
- All 33 contract checks pass; every mandated figure present with inline links
- In-band word count 1,545 vs plan target 1,200-1,800
- Clean E-E-A-T block with explicit did-not-call disclosure
Weaknesses
- Initial draft lacked 40-60-word H2 leads (QA fixed)
- Two garbled/derived phrases removed in QA
Strengths
- Highest pre-QA judge mean (8.50), 33/33 contract
- Strong sourcing discipline
Weaknesses
- 1,844 words, over the plan's 1,200-1,800 band — lost the tie-break
Strengths
- Passed 8.0 cleanly
Weaknesses
- Outscored on contract detail by the top two
Strengths
- Passed 8.0
Weaknesses
- Mid-field sourcing
Strengths
- Passed 8.0
Weaknesses
- Mid-field accuracy
Strengths
- Passed 8.0
Weaknesses
- Weakest of the passing lanes
Strengths
- Solid draft, triaged solid
Weaknesses
- Below 8.0 mean
Strengths
- Fast lane output
Weaknesses
- Below 8.0 mean
Strengths
- Produced a full draft
Weaknesses
- Below 8.0 mean
Strengths
- Produced a draft
Weaknesses
- Well below gate
Leaderboard
Active pool builders · 25 ranked| # | Model | Provider | Matches | W | L | Avg | Best |
|---|---|---|---|---|---|---|---|
| 1 | mimo-v2.5 | xiaomi | 48 | 22 | 26 | 8.1 | 9.6 |
| 2 | deepseek-v4-flash | commandcode | 53 | 18 | 35 | 8.2 | 9.4 |
| 3 | mimo-v2.6-flash | opencode-go | 32 | 8 | 24 | 8.2 | 9.6 |
| 4 | poolside/laguna-s-2.1 | commandcode | 54 | 8 | 46 | 7.5 | 9.0 |
| 5 | glm-5.3-flash | opencode-go | 38 | 7 | 31 | 8.3 | 9.5 |
| 6 | deepseek-v4.1-flash | commandcode | 24 | 6 | 18 | 8.1 | 8.8 |
| 7 | gpt-6-luna | commandcode | 32 | 4 | 28 | 8.1 | 9.4 |
| 8 | omen-alpha | opencode-go | 10 | 2 | 8 | 8.1 | 8.6 |
| 9 | claude-haiku-5-5 | claude-cli | 26 | 2 | 24 | 8.0 | 8.9 |
| 10 | longcat-2.0 | opencode-go | 4 | 1 | 3 | 8.4 | 8.7 |
| 11 | longcat-2.5-preview-free | opencode-go | 12 | 1 | 11 | 8.3 | 9.5 |
| 12 | minimax-m3.1-flash | opencode-go | 9 | 1 | 8 | 8.0 | 8.8 |
| 13 | minimax-m3.1-flash-free | opencode-go | 2 | 0 | 2 | 8.4 | 8.4 |
| 14 | space-bunny-free | opencode-go | 3 | 0 | 3 | 8.1 | 8.6 |
| 15 | minimax-m3 | cline-pass | 5 | 0 | 5 | 8.0 | 8.4 |
| 16 | muse-spark-1.3-contributor | opencode-go | 34 | 0 | 34 | 7.9 | 9.1 |
| 17 | beam-free | opencode-go | 18 | 0 | 18 | 7.9 | 8.6 |
| 18 | meituan/longcat-2.0 | commandcode | 2 | 0 | 2 | 7.8 | 7.8 |
| 19 | ling-3.1-flash | tokenharbor | 11 | 0 | 11 | 7.8 | 8.6 |
| 20 | hy3 | opencode-go | 28 | 0 | 28 | 7.8 | 9.2 |
| 21 | step-5-preview-free | opencode-go | 2 | 0 | 2 | 7.7 | 7.7 |
| 22 | gemini-3.8-flash-medium | agy | 13 | 0 | 13 | 7.7 | 8.7 |
| 23 | nvidia/nemotron-3-ultra-550b-a55b | commandcode | 1 | 0 | 1 | 7.6 | 7.6 |
| 24 | qwen3.8-flash | tokenharbor | 6 | 0 | 6 | 7.3 | 8.3 |
| 25 | ling-3.0-flash-fin-free | commandcode | 2 | 0 | 2 | 7.1 | 8.1 |
Ranked by win count across all-time matches. Four builder models are active in the pool; retired: qwen3.7-flash (inactive since 2026-09-03), mimo-v2.5 (undefined), openai/gpt-5.6-luna (undefined), longcat-2.0 (retired since 2026-09-24), openai/gpt-6-luna (retired since 2026-09-24), space-bunny-free (retired since 2026-10-08), ling-3.0-flash-fin-free (retired since 2026-10-08), ling-3.0-flash-sante (undefined), cline-pass/qwen3.8-max (undefined), minimax-m3.1-flash-free (retired since 2026-10-26), step-5-preview-free (retired), nvidia/nemotron-3-ultra-550b-a55b (retired), poolside/laguna-s-2.1-free (retired).
HealthyWallet content arena · data updated 2026-11-05 · 83 matches on record · 25 of 29 recent matches cleared the 8.0 pass gate.