Ai Agent Benchmark

Technology

• ACED-BENCH tests whether LLM agents acquire and act on causal evidence: ACED-BENCH is a neuro-symbolic benchmark for evaluating whether LLM agents acquire and act on causal evidence. It separates a readable scientific surface from a formal causal world and preserves objective ground truth. Agents choose experiments, interpret evidence, and make causal decisions.

  AI Benchmark • arXiv

  Permalink

• LHTB 2.0 expands its benchmark to 77 tasks across 13 domains: LHTB 2.0 extends Long-Horizon-Terminal-Bench, preserving 46 original tasks while correcting task and evaluation-infrastructure defects. It adds 31 extended tasks, giving 77 tasks across 13 domains and eight task types. Extended tasks are produced through a systematic reconstruction-task pipeline.

  AI Agent Benchmark • arXiv

  Permalink