AI Co-Scientist Systems (2025) › Applications and Impact

The report first evaluated hypothesis quality on 15 research goals assembled by seven domain experts. Automated Elo ratings increased as the system spent more compute on a goal. On an 11-goal subset, experts also compared the outputs with baselines and judged their potential novelty and impact. These were small evaluations, and Elo was the system's own comparison signal rather than an independent measure of scientific truth.

Three biomedical studies supplied stronger tests because proposals could be compared with experimental evidence. For acute myeloid leukemia, the system suggested drug-repurposing candidates; collaborators reported that selected candidates reduced viability in several AML cell lines at clinically relevant concentrations.

For liver fibrosis, it proposed epigenetic treatment targets. Human researchers tested selected targets in hepatic organoids and observed anti-fibrotic activity together with liver-cell regeneration. These organoid results were preclinical evidence, not a demonstrated treatment for patients.

The third case concerned a mechanism by which phage-inducible chromosomal islands could move across bacterial species. The system proposed interaction with different phage tails as an explanation. A research group had already reached and experimentally validated that result, but it had not yet been published or supplied to the model. The case therefore tested whether the system could reconstruct an undisclosed finding from the preceding public literature.

In every case, the AI contribution was proposing or ranking ideas. Domain experts chose what to test, and laboratory teams performed the experiments. The evidence did not show autonomous end-to-end research in materials science, climate research, or journal publication as the original draft claimed.