Evaluating the Quality of Guidelines Using the AGREE II Tool by a Large Language Model vs Human Appraisers

Bingyi Wang; Xufei Luo; Jie Zhang; Qianling Shi; Honghao Lai; Hui Liu; Yuanyuan Yao; Long Ge; Jiayi Liu; Haodong Li; Yanfang Ma; Lu Zhang; Zhaoxiang Bian; Ivan D Florez; Yaolong Chen; Janne Estill

doi:10.1001/jamanetworkopen.2025.12621

Evaluating the Quality of Guidelines Using the AGREE II Tool by a Large Language Model vs Human Appraisers

Bingyi Wang, Xufei Luo, Jie Zhang, Qianling Shi, Honghao Lai, Hui Liu, Yuanyuan Yao, Long Ge, Jiayi Liu, Haodong Li, Yanfang Ma, Lu Zhang, Zhaoxiang Bian, Ivan D Florez^*, Yaolong Chen^*, Janne Estill

^*Corresponding author for this work

Research output: Contribution to journal › Letter › peer-review

Original language	English
Article number	e2512621
Pages (from-to)	e2512621
Number of pages	5
Journal	JAMA network open
Volume	8
Issue number	5
DOIs	https://doi.org/10.1001/jamanetworkopen.2025.12621
Publication status	Published - 1 May 2025

Access to Document

10.1001/jamanetworkopen.2025.12621

Cite this

Wang, B., Luo, X., Zhang, J., Shi, Q., Lai, H., Liu, H., Yao, Y., Ge, L., Liu, J., Li, H., Ma, Y., Zhang, L., Bian, Z., Florez, I. D., Chen, Y., & Estill, J. (2025). Evaluating the Quality of Guidelines Using the AGREE II Tool by a Large Language Model vs Human Appraisers. JAMA network open, 8(5), e2512621. Article e2512621. https://doi.org/10.1001/jamanetworkopen.2025.12621

@article{9c60d9278ab04815b0846304b8fb8824,

title = "Evaluating the Quality of Guidelines Using the AGREE II Tool by a Large Language Model vs Human Appraisers",

author = "Bingyi Wang and Xufei Luo and Jie Zhang and Qianling Shi and Honghao Lai and Hui Liu and Yuanyuan Yao and Long Ge and Jiayi Liu and Haodong Li and Yanfang Ma and Lu Zhang and Zhaoxiang Bian and Florez, {Ivan D} and Yaolong Chen and Janne Estill",

year = "2025",

month = may,

day = "1",

doi = "10.1001/jamanetworkopen.2025.12621",

language = "English",

volume = "8",

pages = "e2512621",

journal = "JAMA network open",

issn = "2574-3805",

publisher = "American Medical Association",

number = "5",

}

TY - JOUR

T1 - Evaluating the Quality of Guidelines Using the AGREE II Tool by a Large Language Model vs Human Appraisers

AU - Wang, Bingyi

AU - Luo, Xufei

AU - Zhang, Jie

AU - Shi, Qianling

AU - Lai, Honghao

AU - Liu, Hui

AU - Yao, Yuanyuan

AU - Ge, Long

AU - Liu, Jiayi

AU - Li, Haodong

AU - Ma, Yanfang

AU - Zhang, Lu

AU - Bian, Zhaoxiang

AU - Florez, Ivan D

AU - Chen, Yaolong

AU - Estill, Janne

PY - 2025/5/1

Y1 - 2025/5/1

UR - http://www.scopus.com/inward/record.url?scp=105007053031&partnerID=8YFLogxK

U2 - 10.1001/jamanetworkopen.2025.12621

DO - 10.1001/jamanetworkopen.2025.12621

M3 - Letter

C2 - 40434777

SN - 2574-3805

VL - 8

SP - e2512621

JO - JAMA network open

JF - JAMA network open

IS - 5

M1 - e2512621

ER -

Evaluating the Quality of Guidelines Using the AGREE II Tool by a Large Language Model vs Human Appraisers

Access to Document

Other files and links

Cite this