Skip to content
AI IntelligenceOct 24, 2026AI Intelligence
Article

Coding-agent harness swaps barely change pass rates but can triple cost, study finds

A controlled study found that switching coding-agent harnesses such as Claude Code, OpenCode or mini-SWE-agent barely changed pass rates versus rerunning the same setup, while cost per task could triple. The higher cost was driven mainly by system prompts resent at every step.

Frontier EditorialSource: The Decoder
01

Source Brief

Coding-agent harness swaps barely change pass rates but can triple cost, study finds: A controlled study found that switching coding-agent harnesses such as Claude Code, OpenCode or mini-SWE-agent barely changed pass rates versus rerunning the same setup, while cost per task could triple. The higher cost was driven mainly by system prompts resent at every step.