Ai Agent Benchmark

DeepSeek releases open-weight V4.1-Flash-1017, with search APIs at $0.75 per 1,000 calls: Deepseek released V4.1-Flash-1017, an open-weight model it says outperforms its predecessor on benchmarks, runs faster and returns shorter outputs. It also opened its search engine via Search and Fetch APIs at $0.75 per 1,000 calls; users in Claude Code and Codex get free access for now.

AI Models • The Decoder

ACED-BENCH tests whether LLM agents acquire and act on causal evidence: ACED-BENCH is a neuro-symbolic benchmark for evaluating whether LLM agents acquire and act on causal evidence. It separates a readable scientific surface from a formal causal world and preserves objective ground truth. Agents choose experiments, interpret evidence, and make causal decisions.

AI Benchmark • arXiv

LHTB 2.0 expands its benchmark to 77 tasks across 13 domains: LHTB 2.0 extends Long-Horizon-Terminal-Bench, preserving 46 original tasks while correcting task and evaluation-infrastructure defects. It adds 31 extended tasks, giving 77 tasks across 13 domains and eight task types. Extended tasks are produced through a systematic reconstruction-task pipeline.

AI Agent Benchmark • arXiv

Tsinghua researchers release SRHarness for formula discovery, MechBench for mechanism recovery: Tsinghua researchers released SRHarness, an open-source runtime for agentic symbolic regression, and MechBench, a benchmark that tests whether AI can recover the mechanisms behind formulas. SRHarness targets formula discovery, while MechBench evaluates mechanism recovery.

AI Research • Pandaily

MagicLab's EchoPolicy-0 tops AI2's MolmoSpaces board with 75.4% manipulation success: MagicLab said its VLM agent framework EchoPolicy-0 averaged 75.4% across four MolmoSpaces tasks, and AI2's published leaderboard data lists it first. Its MagicBrain component reached 94.4% on the pick task.

AI & Robotics • Pandaily

NVIDIA

NVIDIA article covers rewriting Spark UDFs for GPU acceleration with AI agents