The Chatbot Assessment Reporting Tool (CHART) is a reporting guideline developed to provide reporting recommendations for studies evaluating the performance of generative artificial intelligence (AI)-driven chatbots when summarizing clinical evidence and providing health advice, referred to as Chatbot Health Advice (CHA) studies. CHART was developed in several phases after performing a comprehensive systematic review to identify variation in the conduct, reporting and methodology in CHA studies. Findings from the review were used to develop a draft checklist that was revised through an international, multidisciplinary modified asynchronous Delphi consensus process of 531 stakeholders, three synchronous panel consensus meetings of 48 stakeholders, and subsequent pilot testing of the checklist. CHART includes 12 items and 39 subitems to promote transparent and comprehensive reporting of CHA studies. These include Title (subitem 1a), Abstract/Summary (subitem 1b), Background (subitems 2ab), Model Identifiers (subitem 3ab), Model Details (subitems 4abc), Prompt Engineering (subitems 5ab), Query Strategy (subitems 6abcd), Performance Evaluation (subitems 7ab), Sample Size (subitem 8), Data Analysis (subitem 9a), Results (subitems 10abc), Discussion (subitems 11abc), Disclosures (subitem 12a), Funding (subitem 12b), Ethics (subitem 12c), Protocol (subitem 12d), and Data Availability (subitem 12e). The CHART checklist and corresponding methodological diagram were designed to support key stakeholders including clinicians, researchers, editors, peer reviewers, and readers in reporting, understanding, and interpreting the findings of CHA studies.

IMPORTANCE: The rise in chatbot health advice (CHA) studies is accompanied by heterogeneity in reporting standards, impacting their interpretability. OBJECTIVE: To provide reporting recommendations for studies evaluating the performance of generative artificial intelligence (AI)-driven chatbots when summarizing clinical evidence and providing health advice. DESIGN, SETTING, AND PARTICIPANTS: CHART was developed in several phases after performing a comprehensive systematic review to identify variation in the conduct, reporting, and methodology in CHA studies. Findings from the review were used to develop a draft checklist that was revised through an international, multidisciplinary modified asynchronous Delphi consensus process of 531 stakeholders, 3 synchronous panel consensus meetings of 48 stakeholders, and subsequent pilot testing of the checklist. RESULTS: CHART includes 12 items and 39 subitems to promote transparent and comprehensive reporting of CHA studies. These include title (subitem 1a), abstract or summary (subitem 1b), background (subitems 2ab), model identifiers (subitem 3ab), model details (subitems 4abc), prompt engineering (subitems 5ab), query strategy (subitems 6abcd), performance evaluation (subitems 7ab), sample size (subitem 8), data analysis (subitem 9a), results (subitems 10abc), discussion (subitems 11abc), disclosures (subitem 12a), funding (subitem 12b), ethics (subitem 12c), protocol (subitem 12d), and data availability (subitem 12e). CONCLUSIONS AND RELEVANCE: The CHART checklist and corresponding methodological diagram were designed to support key stakeholders including clinicians, researchers, editors, peer reviewers, and readers in reporting, understanding, and interpreting the findings of CHA studies.

BACKGROUND: The Chatbot Assessment Reporting Tool (CHART) is a reporting guideline developed to provide reporting recommendations for studies evaluating the performance of generative artificial intelligence (AI)-driven chatbots when summarizing clinical evidence and providing health advice, referred to as Chatbot Health Advice (CHA) studies. METHODS: CHART was developed in several phases after performing a comprehensive systematic review to identify variation in the conduct, reporting, and methodology in CHA studies. Findings from the review were used to develop a draft checklist that was revised through an international, multidisciplinary modified asynchronous Delphi consensus process of 531 stakeholders, three synchronous panel consensus meetings of 48 stakeholders, and subsequent pilot testing of the checklist. RESULTS: CHART includes 12 items and 39 subitems to promote transparent and comprehensive reporting of CHA studies. These include Title (subitem 1a), Abstract/Summary (subitem 1b), Background (subitems 2ab), Model Identifiers (subitems 3ab), Model Details (subitems 4abc), Prompt Engineering (subitems 5ab), Query Strategy (subitems 6abcd), Performance Evaluation (subitems 7ab), Sample Size (subitem 8), Data Analysis (subitem 9a), Results (subitems 10abc), Discussion (subitems 11abc), Disclosures (subitem 12a), Funding (subitem 12b), Ethics (subitem 12c), Protocol (subitem 12d), and Data Availability (subitem 12e). CONCLUSION: The CHART checklist and corresponding methodological diagram were designed to support key stakeholders including clinicians, researchers, editors, peer reviewers, and readers in reporting, understanding, and interpreting the findings of CHA studies.

IMPORTANCE: The protocol of a randomized trial is the foundation for study planning, conduct, reporting, and external review. However, trial protocols vary in their completeness and often do not address key elements of design and conduct. The SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) statement was first published in 2013 as guidance to improve the completeness of trial protocols. Periodic updates incorporating the latest evidence and best practices are needed to ensure that the guidance remains relevant to users. Herein, we systematically update the SPIRIT recommendations for minimum items to address in the protocol of a randomized trial. OBSERVATIONS: We completed a scoping review and developed a project specific database of empirical and theoretical evidence to generate a list of potential changes to the SPIRIT 2013 checklist. The list was enriched with recommendations provided by lead authors of existing SPIRIT/CONSORT (Consolidated Standards of Reporting Trials) extensions (harms, outcomes, nonpharmacological treatment) and other reporting guidelines (Template for Intervention Description and Replication [TIDieR]). The potential modifications were rated in a 3-round Delphi survey followed by a consensus meeting. Overall, 317 individuals participated in the Delphi consensus process and 30 experts attended the consensus meeting. The process led to the addition of 2 new protocol items, revision to 5 items, deletion/merger of 5 items, and integration of key items from other relevant reporting guidelines. Notable changes include a new open-science section, additional emphasis on the assessment of harms and description of interventions and comparators, and a new item on how patients and the public will be involved in trial design, conduct, and reporting. The updated SPIRIT 2025 statement consists of an evidence based checklist of 34 minimum items to address in a trial protocol, along with a diagram illustrating the schedule of enrollment, interventions, and assessments for trial participants. To facilitate implementation, we also developed an expanded version of the SPIRIT 2025 checklist and an accompanying explanation and elaboration document. CONCLUSIONS AND RELEVANCE: Widespread endorsement and adherence to the updated SPIRIT 2025 statement have the potential to enhance the transparency and completeness of trial protocols for the benefit of investigators, trial participants, patients, funders, research ethics committees, journals, trial registries, policy makers, regulators, and other reviewers.

IMPORTANCE: The protocol of a randomised trial is the foundation for study planning, conduct, reporting, and external review. However, trial protocols vary in their completeness and often do not address key elements of design and conduct. The SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) statement was first published in 2013 as guidance to improve the completeness of trial protocols. Periodic updates incorporating the latest evidence and best practices are needed to ensure that the guidance remains relevant to users. OBJECTIVE: To systematically update the SPIRIT recommendations for minimum items to address in the protocol of a randomised trial. DESIGN: We completed a scoping review and developed a project specific database of empirical and theoretical evidence to generate a list of potential changes to the SPIRIT 2013 checklist. The list was enriched with recommendations provided by lead authors of existing SPIRIT/CONSORT (Consolidated Standards of Reporting Trials) extensions (Harms, Outcomes, Non-pharmacological Treatment) and other reporting guidelines (TIDieR). The potential modifications were rated in a three-round Delphi survey followed by a consensus meeting. FINDINGS: Overall, 317 individuals participated in the Delphi consensus process and 30 experts attended the consensus meeting. The process led to the addition of two new protocol items, revision to five items, deletion/merger of five items, and integration of key items from other relevant reporting guidelines. Notable changes include a new open science section, additional emphasis on the assessment of harms and description of interventions and comparators, and a new item on how patients and the public will be involved in trial design, conduct, and reporting. The updated SPIRIT 2025 statement consists of an evidence-based checklist of 34 minimum items to address in a trial protocol, along with a diagram illustrating the schedule of enrolment, interventions, and assessments for trial participants. To facilitate implementation, we also developed an expanded version of the SPIRIT 2025 checklist and an accompanying explanation and elaboration document. CONCLUSIONS AND RELEVANCE: Widespread endorsement and adherence to the updated SPIRIT 2025 statement have the potential to enhance the transparency and completeness of trial protocols for the benefit of investigators, trial participants, patients, funders, research ethics committees, journals, trial registries, policymakers, regulators, and other reviewers.

BACKGROUND: Well designed and properly executed randomised trials are considered the most reliable evidence on the benefits of healthcare interventions. However, there is overwhelming evidence that the quality of reporting is not optimal. The CONSORT (Consolidated Standards of Reporting Trials) statement was designed to improve the quality of reporting and provides a minimum set of items to be included in a report of a randomised trial. CONSORT was first published in 1996, then updated in 2001 and 2010. Here, we present the updated CONSORT 2025 statement, which aims to account for recent methodological advancements and feedback from end users. METHODS: We conducted a scoping review of the literature and developed a project-specific database of empirical and theoretical evidence related to CONSORT, to generate a list of potential changes to the checklist. The list was enriched with recommendations provided by the lead authors of existing CONSORT extensions (Harms, Outcomes, Non-pharmacological Treatment), other related reporting guidelines (TIDieR) and recommendations from other sources (e.g., personal communications). The list of potential changes to the checklist was assessed in a large, international, online, three-round Delphi survey involving 317 participants and discussed at a two-day online expert consensus meeting of 30 invited international experts. RESULTS: We have made substantive changes to the CONSORT checklist. We added seven new checklist items, revised three items, deleted one item, and integrated several items from key CONSORT extensions. We also restructured the CONSORT checklist, with a new section on open science. The CONSORT 2025 statement consists of a 30-item checklist of essential items that should be included when reporting the results of a randomised trial and a diagram for documenting the flow of participants through the trial. To facilitate implementation of CONSORT 2025, we have also developed an expanded version of the CONSORT 2025 checklist, with bullet points eliciting critical elements of each item. CONCLUSIONS: Authors, editors, reviewers, and other potential users should use CONSORT 2025 when writing and evaluating manuscripts of randomised trials to ensure that trial reports are clear and transparent.

The protocol of a randomized trial is the foundation for study planning, conduct, reporting and external review. However, trial protocols vary in their completeness and often do not address key elements of design and conduct. The SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) statement was first published in 2013 as guidance to improve the completeness of trial protocols. Periodic updates incorporating the latest evidence and best practices are needed to ensure that the guidance remains relevant to users. Here, we aimed to systematically update the SPIRIT recommendations for minimum items to address in the protocol of a randomized trial. We completed a scoping review and developed a project-specific database of empirical and theoretical evidence to generate a list of potential changes to the SPIRIT 2013 checklist. The list was enriched with recommendations provided by lead authors of existing SPIRIT/CONSORT (Consolidated Standards of Reporting Trials) extensions (Harms, Outcomes, Non-pharmacological Treatment) and other reporting guidelines (TIDieR). The potential modifications were rated in a three-round Delphi survey followed by a consensus meeting. Overall, 317 individuals participated in the Delphi consensus process and 30 experts attended the consensus meeting. The process led to the addition of two new protocol items, revision to five items, deletion/merger of five items, and integration of key items from other relevant reporting guidelines. Notable changes include a new open science section, additional emphasis on the assessment of harms and description of interventions and comparators, and a new item on how patients and the public will be involved in trial design, conduct and reporting. The updated SPIRIT 2025 statement consists of an evidence-based checklist of 34 minimum items to address in a trial protocol, along with a diagram illustrating the schedule of enrollment, interventions and assessments for trial participants. To facilitate implementation, we also developed an expanded version of the SPIRIT 2025 checklist and an accompanying explanation and elaboration document. Widespread endorsement and adherence to the updated SPIRIT 2025 statement have the potential to enhance the transparency and completeness of trial protocols for the benefit of investigators, trial participants, patients, funders, research ethics committees, journals, trial registries, policymakers, regulators and other reviewers.

IMPORTANCE: The protocol of a randomised trial is the foundation for study planning, conduct, reporting, and external review. However, trial protocols vary in their completeness and often do not address key elements of design and conduct. The SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) statement was first published in 2013 as guidance to improve the completeness of trial protocols. Periodic updates incorporating the latest evidence and best practices are needed to ensure that the guidance remains relevant to users. OBJECTIVE: To systematically update the SPIRIT recommendations for minimum items to address in the protocol of a randomised trial. DESIGN: We completed a scoping review and developed a project specific database of empirical and theoretical evidence to generate a list of potential changes to the SPIRIT 2013 checklist. The list was enriched with recommendations provided by lead authors of existing SPIRIT/CONSORT (Consolidated Standards of Reporting Trials) extensions (Harms, Outcomes, Non-pharmacological Treatment) and other reporting guidelines (TIDieR). The potential modifications were rated in a three-round Delphi survey followed by a consensus meeting. FINDINGS: Overall, 317 individuals participated in the Delphi consensus process and 30 experts attended the consensus meeting. The process led to the addition of two new protocol items, revision to five items, deletion/merger of five items, and integration of key items from other relevant reporting guidelines. Notable changes include a new open science section, additional emphasis on the assessment of harms and description of interventions and comparators, and a new item on how patients and the public will be involved in trial design, conduct, and reporting. The updated SPIRIT 2025 statement consists of an evidence based checklist of 34 minimum items to address in a trial protocol, along with a diagram illustrating the schedule of enrolment, interventions, and assessments for trial participants. To facilitate implementation, we also developed an expanded version of the SPIRIT 2025 checklist and an accompanying explanation and elaboration document. CONCLUSIONS AND RELEVANCE: Widespread endorsement and adherence to the updated SPIRIT 2025 statement have the potential to enhance the transparency and completeness of trial protocols for the benefit of investigators, trial participants, patients, funders, research ethics committees, journals, trial registries, policymakers, regulators, and other reviewers.

Critical appraisal of the quality of randomised trials is possible only if their design, conduct, analysis, and results are completely and accurately reported. Without transparent reporting of the methods and results, readers will not be able to fully evaluate the reliability and validity of trial findings. The CONSORT (Consolidated Standards of Reporting Trials) statement aims to improve the quality of reporting and provides a minimum set of items to be included in a report of a randomised trial. CONSORT was first published in 1996 and was updated in 2001 and 2010. CONSORT comprises a checklist of essential items that should be included in reports of randomised trials and a diagram for documenting the flow of participants through a trial. The CONSORT statement has been updated (CONSORT 2025) to reflect recent methodological advancements and feedback from end users, ensuring that it remains fit for purpose. Here, we present the updated CONSORT explanation and elaboration document, which has been extensively revised and describes the rationale and scientific background for each CONSORT 2025 checklist item and provides published examples of good reporting. The objective is to enhance the use, understanding, and dissemination of CONSORT 2025 and provide guidance to authors about how to improve the reporting of their trials and ensure trial reports are complete, and transparent.

IMPORTANCE: Well-designed and properly executed randomized trials are considered the most reliable evidence on the benefits of health care interventions. However, there is overwhelming evidence that the quality of reporting is not optimal. The CONSORT (Consolidated Standards of Reporting Trials) statement was designed to improve the quality of reporting and provides a minimum set of items to be included in a report of a randomized trial. CONSORT was first published in 1996, then updated in 2001 and 2010. Herein, we present the updated CONSORT 2025 statement, which aims to account for recent methodological advancements and feedback from end users. OBSERVATIONS: We conducted a scoping review of the literature and developed a project-specific database of empirical and theoretical evidence related to CONSORT to generate a list of potential changes to the checklist. The list was enriched with recommendations provided by the lead authors of existing CONSORT extensions (harms, outcomes, nonpharmacological treatment), other related reporting guidelines (Template for Intervention Description and Replication [TIDieR]), and recommendations from other sources (eg, personal communications). The list of potential changes to the checklist was assessed in a large, international, online, 3-round Delphi survey involving 317 participants and discussed at a 2-day online expert consensus meeting of 30 invited international experts. We have made substantive changes to the CONSORT checklist. We added 7 new checklist items, revised 3 items, deleted 1 item, and integrated several items from key CONSORT extensions. We also restructured the CONSORT checklist, with a new section on open science. The CONSORT 2025 statement consists of a 30-item checklist of essential items that should be included when reporting the results of a randomized trial and a diagram for documenting the flow of participants through the trial. To facilitate implementation of CONSORT 2025, we have also developed an expanded version of the CONSORT 2025 checklist, with bullet points eliciting critical elements of each item. CONCLUSIONS AND RELEVANCE: Authors, editors, reviewers, and other potential users should use CONSORT 2025 when writing and evaluating manuscripts of randomized trials to ensure that trial reports are clear and transparent.