Evaluation & BenchmarksAndrew Bo Liu et al.
Liu et al. release ABC-Bench
AIMade by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made
Released ABC-Bench — a benchmark that evaluates agentic LLMs' ability to carry out biology experiments (writing code for liquid-handling robots, designing DNA fragments for in vitro assembly, evading DNA synthesis screening)
Why it matters
The arrival of a new family of benchmarks in which bio-risk evaluation moves from knowledge Q&A to evaluating an agent's ability to run an actual experimental loop
Source — Primary sources first; secondary reports are labelled “Press”
Paperarxiv.orghttps://arxiv.org/html/2606.11150v1Added in Week 35, 2026 · See that week
On the map — ⑯ Evaluation line
- Previous stopARC-AGI-3
- This recordABC-Bench
- Next stopRealSWE