Identify unsuitable MRM peaks

Instrument analysis15 tasks

Identify peptide peaks that are unsuitable for reliable protein quantification in a liquid chromatography–multiple reaction monitoring (LC–MRM) batch.

Targeted protein measurements depend on distinguishing genuine peptide signals from interference and unreliable peaks. Reviewing each peak in isolation can miss problems that become apparent only when comparing related signals, standards, and samples across a batch.

Agents examine recorded chromatograms for all measured targets in acquisition order and assign each peak a probability of being unsuitable for quantification. Their judgments are compared with the analyst’s recorded labels. The task tests interpretation of analytical measurements and the ability to use batch-wide context to assess individual peaks.

Scoring

Achieve an F1 score of at least 80% on peak rejection decisions against the analyst's labels, balancing precision and recall within each batch.

RESULTS

Identify peptide peaks that are unsuitable for reliable protein quantification in a liquid chromatography–multiple reaction monitoring (LC–MRM) batch.

Model	Pass@1		Cost ($)
Grok 4.6xhigh	4.4%		$3.00
Claude Opus 5xhigh	0.0%		$12.67
Gemini 3.8 Flashhigh	0.0%		$2.49
GPT–6 Astraxhigh	0.0%		$8.19
Claude Fable 5.1xhigh	0.0%		$15.71
GPT–5.6 Solxhigh	0.0%		$2.60
		0%50%100%

Whiskers show ±1 standard error from repeats.

Model trajectories

One example per model.