← All research

2026 · Preprint · medRxiv : the preprint server for health sciences

SPIRIT-CONSORT-ELM: Element-Level Annotated Dataset and Large Language Model Approach for Assessing Randomized Controlled Trial Reporting

Lan Jiang; Xiangji Ying; Andrew W Brown; Mengfei Lan; Wenxuan Song; Joe D Menke; Colby J Vorland; Evan Mayo-Wilson; Halil Kilicoglu

Develops detailed reporting annotations and an evidence-retrieval plus language-model pipeline to assess whether trial protocols and results report individual SPIRIT and CONSORT elements.

Preprint; this version has not been peer reviewed.

Open-science resources

Resource verification & source notes
  • Free full text (PMC): The complete article body was retrieved from the public NCBI PMC JATS endpoint. This confirms free access; reuse permissions depend on the individual article license.
  • Preprint: PubMed identifies this record as a preprint and PMC serves its full manuscript.
  • Annotated data: The preprint names this repository in separate data and code availability sections; its public file inventory includes the dataset and assessment/evaluation notebooks.
  • Assessment code: The preprint names this repository in separate data and code availability sections; its public file inventory includes the dataset and assessment/evaluation notebooks.
  • Reporting instrument: Live public OSF file inventory contains: ReportingCompletenessInstrument.pdf.

Publication details

Research themes

Research toolsReporting transparency

clinical-trials · research-software

Author affiliations & identifiers
  • Lan Jiang: School of Information Sciences, University of Illinois Urbana-Champaign, IL, USA. · ORCID 0009-0004-2764-0697
  • Xiangji Ying: Department of Epidemiology, University of North Carolina Gillings School of Global Public Health, Chapel Hill, NC, USA. · ORCID 0000-0002-1713-3788
  • Andrew W Brown: Department of Biostatistics, University of Arkansas for Medical Sciences, Little Rock, AR, USA.; Arkansas Children's Research Institute, Little Rock, AR, USA. · ORCID 0000-0002-1758-8205
  • Mengfei Lan: School of Information Sciences, University of Illinois Urbana-Champaign, IL, USA. · ORCID 0000-0002-0237-0406
  • Wenxuan Song: School of Information Sciences, University of Illinois Urbana-Champaign, IL, USA. · ORCID 0009-0006-0718-6882
  • Joe D Menke: School of Information Sciences, University of Illinois Urbana-Champaign, IL, USA. · ORCID 0000-0002-7374-7549
  • Colby J Vorland: Department of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, Bloomington, IN, USA. · ORCID 0000-0003-4225-372X
  • Evan Mayo-Wilson: Department of Epidemiology, University of North Carolina Gillings School of Global Public Health, Chapel Hill, NC, USA. · ORCID 0000-0001-6126-2459
  • Halil Kilicoglu: School of Information Sciences, University of Illinois Urbana-Champaign, IL, USA. · ORCID 0000-0003-3987-9393

Versions & associated materials

These items belong to this research work. Their individual titles, author lists, and source identifiers are preserved below.

SPIRIT-CONSORT-ELM: Element-Level Assessment of Randomized Controlled Trial Reporting Using Large Language Models

Project · 2026 · OSF Preprints (OSF Preprints)

Joe Menke; Evan Mayo-Wilson; Colby J. Vorland; Mengfei Lan; Xiangji Ying; Halil Kilicoglu; Lan Jiang; Andrew W. Brown

Leveraging Large Language Models for Assessing the Adherence of Randomized Controlled Trial Publications to Reporting Guidelines

Conference Abstract · 2025 · International Congress on Peer Review and Scientific Publication, Chicago

Lan Jiang; Xiangji Ying; Mengfei Lan; Andrew Brown; Colby Vorland; Evan Mayo-Wilson; Halil Kilicoglu

Related materials

Metadata sources: PubMed, OpenAlex, Google Scholar, CV. Classification is an editorial interpretation of the title, abstract, and supplied CV.