CellFateBench is a scientific software and benchmark-engineering project for evaluating reasoning...
CellFateBench is a scientific software and benchmark-engineering project for evaluating reasoning over single-cell genomics workflows.
The project was designed around a practical question:
How can single-cell analysis outputs be turned into reproducible benchmark tasks with public prompts, hidden answer keys, oracle outputs, scoring, calibration, Docker validation, and CI?
What CellFateBench does
Single-cell genomics workflows often produce outputs such as:
OpenAI launched LifeSciBench with 750 expert-authored tasks and 19,020 evaluation criteria to benchmark AI models like…
OpenAI's LifeSciBench grades AI models on 750 expert-authored life-science tasks using rubrics; the strongest model passes only…
AstaBench’s latest update adds new frontier-model results, including GPT-5.5, and highlights growing adoption from groups…
Applications vary wildly in what they demand from a system, making it difficult for a single benchmark to provide a broadly…
To fix the way we test and measure models, AI is learning tricks from social science.
Cognition Labs launches FrontierCode, a benchmark testing AI coding agents on real-world maintainability. The top model scores…
OpenAI launches LifeSciBench to evaluate AI in life sciences
OpenAI Releases LifeSciBench, a 750-Task Benchmark Grading AI Models on Real Life-Science Research With Expert-Written Rubric
Enterprise AI benchmarks: head-to-head comparison of Falconer, Notion, Atlassian Rovo, Claude Code, and Codex
New benchmark exposes how badly AI struggles with real knowledge work
