Brief
GAVEL compares clinical timelines against case reports; merged timelines preferred in 77.0% of comparisons
A preprint describes GAVEL, an LLM judge protocol that compares two clinical timelines with the case report and returns a discrepancy type, verdict, and report passage for each difference. It reports that merged timelines were preferred in 77.0% of comparisons across 126 reports.
The abstract says GAVEL was evaluated by reviewing 2,738 findings from GPT5.6sol and DeepSeek V3.2, ranking six LLM extractors and two human annotators, and testing GAVEL guided merging. True match rates were 60% immediately below and 48% immediately above a 0.10 cutoff. Manual review confirmed 89.4% and 88.6% of findings. Across 126 reports, merged timelines were preferred in 77.0% of comparisons (95% CI, 69.8 to 84.1%) and reduced discrepancies attributed to the evaluated timeline from 7.63 to 0.85 per report. The abstract states GAVEL supports report-based comparison and revision without treating either timeline as ground truth.
Our reading
Our reading is that this is a methods preprint with internal evaluation metrics, so the preference result is promising but not a settled clinical finding.
Source details and supporting facts
Each line is stated by the page named above it.
Stated by arXiv
- GAVEL is an LLM judge protocol that compares two timelines with the case report and returns a discrepancy type, verdict, and report passage for each difference.
- The evaluation reviewed 2,738 findings from GPT5.6sol and DeepSeek V3.2, ranked six LLM extractors and two human annotators, and tested GAVEL guided merging.
- True match rates were 60% immediately below and 48% immediately above the 0.10 cutoff.
- Manual review confirmed 89.4% and 88.6% of findings.
- Across 126 reports, merged timelines were preferred in 77.0% of comparisons (95% CI, 69.8 to 84.1%) and reduced discrepancies attributed to the evaluated timeline from 7.63 to 0.85 per report.
- GAVEL supports report-based comparison and revision without treating either timeline as ground truth.
Sources
- arXivText stored 16 September 2026
How this story was checked. Written from the 1 page listed above, stored 16 September 2026; claims checked against that stored text on 16 September 2026.
What that means
- 6 of 6 reported statements were confirmed against the page that carries them; the rest were removed rather than published.
- Figures in the text were required to appear in the stored source text: yes. Identifiers: yes.
- The check reads stored text only: no claim rests on a fresh look that did not happen.
- Where the reporting was silent, the text says so instead of filling the gap.