LifeSciBench turns 750 expert biology tasks into an AI test bed
Original: LifeSciBench puts 750 real biology tasks in front of AI models View original →
Life-science AI is moving from trivia-style testing toward work that looks closer to the lab and research desk. OpenAI wrote on X that LifeSciBench is designed to measure how well AI supports “real-world life science research.” The benchmark’s center of gravity is concrete: 173 scientists from biotechnology and pharmaceutical research contributed 750 expert-authored tasks across seven biological research workflows.
OpenAI’s account is usually reserved for official model, product, and research updates, so this post matters less as a social-media update than as evidence of where the company wants evaluation to go. Biology research often requires chaining literature review, hypothesis formation, assay design, protocol reasoning, and interpretation of noisy results. A benchmark split across seven workflows can expose whether a model is broadly useful or merely strong on narrow question-answering formats.
The linked OpenAI page was not accessible to this crawler because it required JavaScript and cookies, so the factual base here is the public tweet and FxTwitter metadata. That still gives enough signal to separate this from ordinary marketing: the tweet names the number of scientists, the number of tasks, and the workflow structure. For researchers, the next question is whether LifeSciBench will publish enough task and scoring detail for third-party replication, and whether model comparisons will show domain-specific failure modes rather than a single leaderboard number. The source tweet is available on X.
Related Articles
A peer-reviewed study published in Science tested OpenAI's o1 on 76 real ER triage cases and found it achieved exact or near-exact diagnoses 67% of the time, versus 55% and 50% for two attending physicians who received identical patient data.
OpenAI’s next major model family, Astra, is being tested through research outputs rather than only benchmarks. The company says an internal version produced 10 results and that finding them would cost roughly $2,000 at Sol API rates.
Biology agents are being judged on research judgment, not just factual answers. GeneBench-Pro puts 129 computational-biology problems in front of agents, and indexed coverage says GPT-5.6 Sol reaches 28.7% at the highest reasoning level and 31.5% in Pro mode.