United States

&lt;p&gt;Helena Van Beersel Krejcikova,&lt;sup&gt;1,2&lt;/sup&gt; Christoffer Bruun Korfitsen,&lt;sup&gt;1,2&lt;/sup&gt; Lisa Bero,&lt;sup&gt;3&lt;/sup&gt; Jason Dana,&lt;sup&gt;4&lt;/sup&gt; David C. Dorman,&lt;sup&gt;5&lt;/sup&gt; Quinn Grundy,&lt;sup&gt;6&lt;/sup&gt; Ibo van de Poel,&lt;sup&gt;7&lt;/sup&gt; Morten Rosenmeier,&lt;sup&gt;8&lt;/sup&gt; Asbjørn Hróbjartsson,&lt;sup&gt;1,2&lt;/sup&gt; Andreas Lundh&lt;sup&gt;1,2,9&lt;/sup&gt;&lt;/p&gt;
&lt;h4&gt;Objective&lt;/h4&gt;
&lt;p&gt; Conflicts of interest can undermine the trustworthiness of research if they are not adequately prevented or managed. Our objective was to (1) map and analyze conflict of interest policies of important international and national scholarly organizations within 5 selected scholarly disciplines and (2) describe cross-disciplinary differences and commonalities.&lt;/p&gt;
&lt;h4&gt;Design&lt;/h4&gt;
&lt;p&gt; This was a cross-sectional study and content analysis of conflict of interest policies for research in economics, engineering, environmental toxicology and chemistry, law, and medicine. We used purposive sampling to include international and national policies in English from: (1) 100 top scholarly journals (20 per discipline) and the 20 largest publishers (both based on rankings in Clarivate’s Journal Citation Reports 2022); (2) major journal and publisher associations and international multidisciplinary scholarly organizations (identified via targeted web search); (3) top universities (2 per continent based on ranking in Times Higher Education World University Rankings 2023); and (4) public funding agencies with the largest amount of annual funding (up to 2 per continent and discipline, identified via targeted web search). One researcher identified potentially eligible policies (April 2025), and 2 researchers independently included policies and extracted data. In this preliminary analysis, we report descriptive statistics stratified by type of scholarly discipline and organization.&lt;i&gt; &lt;/i&gt;The protocol and study registration can be found online.&lt;sup&gt;1&lt;/sup&gt;&lt;/p&gt;
&lt;h4&gt;Results&lt;/h4&gt;
&lt;p&gt; We screened 1008 organizations and included policies from 170 scholarly organizations: 100 journals, 20 publishers, 6 journal and publisher associations, 14 international multidisciplinary scholarly associations, 12 universities, and 18 funding agencies. From these organizations, we included 400 policies targeting different stakeholders (&lt;b&gt;Table 25-0987&lt;/b&gt;): 159 policies (40%) relevant for researchers (eg, manuscript authors or grant applicants), 126 (32%) for peer reviewers, and 115 (29%) for editors or grant committee members. A total of 369 policies (92%) addressed both financial and other interests, 13 (3%) addressed exclusively&lt;i&gt; &lt;/i&gt;financial interests, and 18 (5%) addressed exclusively other interests. A total of 350 policies (88%) addressed disclosure of interests and 287 (72%) addressed the management of conflicts of interest. Content describing both disclosure requirements and management of disclosed conflicts of interest could be found in 71 of 159 policies (45%) for researchers, 87 of 126 (69%) for peer reviewers, and 79 of 115 (69%) for editors or grant committee members. Enforcement strategies (eg, consequences of violating policies) to ensure the compliance with both disclosure and management requirements were addressed in 16 of 159 policies (10%) for researchers, 19 of 126 (15%) for peer reviewers, and 7 of 115 (6%) for editors or grant committee members.&lt;/p&gt;

![](https://assets.underline.io/markdown_image/1/image/15a985017b4dfb4960ba01d974d26462.png)

&lt;h4&gt;Conclusions&lt;/h4&gt;
&lt;p&gt; Most of the top scholarly organizations have conflict of interest policies addressing both financial and other types of interests. While almost all policies addressed disclosure of conflicts of interest, only slightly more than one-half addressed both disclosure of conflicts of interest and how disclosed conflicts of interest should be managed. Few policies described how they should be enforced.&lt;/p&gt;
&lt;h4&gt;Reference&lt;/h4&gt;
&lt;p&gt;1. Krejcikova HVB, Korfitsen CB, Bero L, et al. Conflicts of interest in research across scholarly disciplines: cross-sectional study and qualitative content analysis of policies. October 16, 2023. Accessed July 15, 2023. &lt;a href=&quot;https://osf.io/vwn6c&quot;&gt;&lt;span class=&quot;Hyperlink CharOverride-6&quot;&gt;https://osf.io/vwn6c&lt;/span&gt;&lt;/a&gt;&lt;/p&gt;
&lt;sup&gt;1&lt;/sup&gt;Centre for Evidence-Based Medicine Odense (CEBMO) and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, Odense, Denmark, hkrejcikova@health.sdu.dk; &lt;sup&gt;2&lt;/sup&gt;Open Patient Data Explorative Network (OPEN), Odense University Hospital, Odense, Denmark; &lt;sup&gt;3&lt;/sup&gt;Center for Bioethics and Humanities, University of Colorado Anschutz Medical Campus, Aurora, CO, US; &lt;sup&gt;4&lt;/sup&gt;Yale School of Management, New Haven, CT, US; &lt;sup&gt;5&lt;/sup&gt;North Carolina State University College of Veterinary Medicine, Raleigh, NC, US; &lt;sup&gt;6&lt;/sup&gt;Lawrence Bloomberg Faculty of Nursing, University of Toronto, Toronto, Ontario, Canada; &lt;sup&gt;7&lt;/sup&gt;School of Technology, Policy and Management, Delft University of Technology, Delft, the Netherlands; &lt;sup&gt;8&lt;/sup&gt;Centre for Information and Innovation Law (CIIR), Faculty of Law, University of Copenhagen, Copenhagen, Denmark; &lt;sup&gt;9&lt;/sup&gt;Department of Respiratory Medicine and Infectious Diseases, Copenhagen University Hospital–Bispebjerg and Frederiksberg, Copenhagen, Denmark.&lt;/p&gt;
&lt;h4&gt;Conflict of Interest Disclosures&lt;/h4&gt;
&lt;p&gt; Lisa Bero is a meta-research section editor for PLoS Biology, a Conflict of Interest Advisor for Health Canada, and a Senior Research Integrity Editor at Cochrane, for which the University of Colorado receives remuneration. David C. Dorman is an associate editor for Animals and Critical Reviews in Toxicology. Ibo van de Poel is the integrity officer of the Delft University of Technology; sits on the editorial boards of Science and Engineering Ethics, AI and Ethics, and International Journal of Technoethics; and contributed to the book series SpringerBriefs on Ethical and Legal Issues in Biomedicine and Technology. Asbjørn Hróbjartsson is an associate editor of the Journal of Evidence-Based Medicine and the Cochrane Methodology Review Group and sits on the editorial board of the Journal of Clinical Epidemiology. Andreas Lundh sits on the editorial board of BMC Medical Ethics. Quinn Grundy is a member of the Peer Review Congress Advisory Board but was not involved in the review or decision for this abstract.&lt;/p&gt;


The 10th Peer Review Congress

Conflicts of Interest in Research Across Scholarly Disciplines

academic-industry relationships

conflict of interest

editorial and peer review process

The Tenth Peer Review Congress featured 3 days for presentations of new research into peer review and all aspects of scientific publication, bias, quality of reporting, and information access and dissemination.

This year’s meeting was hybrid, and all plenary sessions were livestreamed with opportunities to view presentations and engage with participants in person and virtually during and after the meeting. All recordings are now available on Underline for viewing.

<div style="position:relative;padding-top:max(60%,324px);width:100%;height:0;"><iframe style="position:absolute;border:none;width:100%;height:100%;left:0;top:0;" src="https://online.fliphtml5.com/ebtyf/mget/"  seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe></div>


#### Why? 
Our aim is to encourage research into the quality and credibility of peer review and scientific publication, to establish the evidence base on which scientists can improve the conduct, reporting, and dissemination of scientific research.

#### Who? 
Participants include editors and publishers of scientific peer-reviewed journals, researchers, funders, bibliometric and informatics experts, information innovators, librarians, journalists, policymakers, ethicists, scientific information disseminators, and anyone interested in the progress of the scientific information enterprise and the quality of scientific evidence.

The Congress embraces a wide range of disciplines, including biomedicine, health and life sciences, applied sciences, basic sciences, physical and chemical sciences, mathematics, computer sciences, engineering, economics, and social sciences as well as new and emerging disciplines.

#### What? 
The Congress provides a forum for the presentation and discussion of new research into the quality and credibility of editorial and funding peer review, scientific and scholarly publication, research methods and reporting practices, identification and management of biases, transparency, reproducibility, access, publication and dissemination metrics, identification and management of threats to the integrity of science, and advances in information exchange.

**Follow us**

[![](https://assets.underline.io/markdown_image/1/image/662a22766b9788ed3766cb23cd156e32.png)](https://x.com/peerrevcongress)  [![](https://assets.underline.io/markdown_image/1/image/bb105afb1773a01fa169aa97ca1af49a.png)](https://www.youtube.com/channel/UCsG_0nKi3_Zfyv0yRPdxjWQ)  [![](https://assets.underline.io/markdown_image/1/image/034e1e70a194a9a4178fdf470ef796db.png)](https://bsky.app/profile/peerreviewcongress.bsky.social)



You need to log in with the email address you registered with. 



Please log in to explore this event.

Registration is required to attend this event, please [here](https://peerreviewcongress.org/registration-information/) to secure your ticket. Please check your spam/promotional inbox too.



Please register!

The Tenth Peer Review Congress features 3 days for presentations of new research into peer review and all aspects of scientific publication, bias, quality of reporting, and information access and dissemination.

<p>Helena Van Beersel Krejcikova,<sup>1,2</sup> Christoffer Bruun Korfitsen,<sup>1,2</sup> Lisa Bero,<sup>3</sup> Jason Dana,<sup>4</sup> David C. Dorman,<sup>5</sup> Quinn Grundy,<sup>6</sup> Ibo van de Poel,<sup>7</sup> Morten Rosenmeier,<sup>8</sup> Asbjørn Hróbjartsson,<sup>1,2</sup> Andreas Lundh<sup>1,2,9</sup></p>
<h4>Objective</h4>
<p> Conflicts of interest can undermine the trustworthiness of research if they are not adequately prevented or managed. Our objective was to (1) map and analyze conflict of interest policies of important international and national scholarly organizations within 5 selected scholarly disciplines and (2) describe cross-disciplinary differences and commonalities.</p>
<h4>Design</h4>
<p> This was a cross-sectional study and content analysis of conflict of interest policies for research in economics, engineering, environmental toxicology and chemistry, law, and medicine. We used purposive sampling to include international and national policies in English from: (1) 100 top scholarly journals (20 per discipline) and the 20 largest publishers (both based on rankings in Clarivate’s Journal Citation Reports 2022); (2) major journal and publisher associations and international multidisciplinary scholarly organizations (identified via targeted web search); (3) top universities (2 per continent based on ranking in Times Higher Education World University Rankings 2023); and (4) public funding agencies with the largest amount of annual funding (up to 2 per continent and discipline, identified via targeted web search). One researcher identified potentially eligible policies (April 2025), and 2 researchers independently included policies and extracted data. In this preliminary analysis, we report descriptive statistics stratified by type of scholarly discipline and organization.<i> </i>The protocol and study registration can be found online.<sup>1</sup></p>
<h4>Results</h4>
<p> We screened 1008 organizations and included policies from 170 scholarly organizations: 100 journals, 20 publishers, 6 journal and publisher associations, 14 international multidisciplinary scholarly associations, 12 universities, and 18 funding agencies. From these organizations, we included 400 policies targeting different stakeholders (<b>Table 25-0987</b>): 159 policies (40%) relevant for researchers (eg, manuscript authors or grant applicants), 126 (32%) for peer reviewers, and 115 (29%) for editors or grant committee members. A total of 369 policies (92%) addressed both financial and other interests, 13 (3%) addressed exclusively<i> </i>financial interests, and 18 (5%) addressed exclusively other interests. A total of 350 policies (88%) addressed disclosure of interests and 287 (72%) addressed the management of conflicts of interest. Content describing both disclosure requirements and management of disclosed conflicts of interest could be found in 71 of 159 policies (45%) for researchers, 87 of 126 (69%) for peer reviewers, and 79 of 115 (69%) for editors or grant committee members. Enforcement strategies (eg, consequences of violating policies) to ensure the compliance with both disclosure and management requirements were addressed in 16 of 159 policies (10%) for researchers, 19 of 126 (15%) for peer reviewers, and 7 of 115 (6%) for editors or grant committee members.</p>

![](https://assets.underline.io/markdown_image/1/image/15a985017b4dfb4960ba01d974d26462.png)

<h4>Conclusions</h4>
<p> Most of the top scholarly organizations have conflict of interest policies addressing both financial and other types of interests. While almost all policies addressed disclosure of conflicts of interest, only slightly more than one-half addressed both disclosure of conflicts of interest and how disclosed conflicts of interest should be managed. Few policies described how they should be enforced.</p>
<h4>Reference</h4>
<p>1. Krejcikova HVB, Korfitsen CB, Bero L, et al. Conflicts of interest in research across scholarly disciplines: cross-sectional study and qualitative content analysis of policies. October 16, 2023. Accessed July 15, 2023. <a href="https://osf.io/vwn6c"><span class="Hyperlink CharOverride-6">https://osf.io/vwn6c</span></a></p>
<sup>1</sup>Centre for Evidence-Based Medicine Odense (CEBMO) and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, Odense, Denmark, hkrejcikova@health.sdu.dk; <sup>2</sup>Open Patient Data Explorative Network (OPEN), Odense University Hospital, Odense, Denmark; <sup>3</sup>Center for Bioethics and Humanities, University of Colorado Anschutz Medical Campus, Aurora, CO, US; <sup>4</sup>Yale School of Management, New Haven, CT, US; <sup>5</sup>North Carolina State University College of Veterinary Medicine, Raleigh, NC, US; <sup>6</sup>Lawrence Bloomberg Faculty of Nursing, University of Toronto, Toronto, Ontario, Canada; <sup>7</sup>School of Technology, Policy and Management, Delft University of Technology, Delft, the Netherlands; <sup>8</sup>Centre for Information and Innovation Law (CIIR), Faculty of Law, University of Copenhagen, Copenhagen, Denmark; <sup>9</sup>Department of Respiratory Medicine and Infectious Diseases, Copenhagen University Hospital–Bispebjerg and Frederiksberg, Copenhagen, Denmark.</p>
<h4>Conflict of Interest Disclosures</h4>
<p> Lisa Bero is a meta-research section editor for PLoS Biology, a Conflict of Interest Advisor for Health Canada, and a Senior Research Integrity Editor at Cochrane, for which the University of Colorado receives remuneration. David C. Dorman is an associate editor for Animals and Critical Reviews in Toxicology. Ibo van de Poel is the integrity officer of the Delft University of Technology; sits on the editorial boards of Science and Engineering Ethics, AI and Ethics, and International Journal of Technoethics; and contributed to the book series SpringerBriefs on Ethical and Legal Issues in Biomedicine and Technology. Asbjørn Hróbjartsson is an associate editor of the Journal of Evidence-Based Medicine and the Cochrane Methodology Review Group and sits on the editorial board of the Journal of Clinical Epidemiology. Andreas Lundh sits on the editorial board of BMC Medical Ethics. Quinn Grundy is a member of the Peer Review Congress Advisory Board but was not involved in the review or decision for this abstract.</p>


poster

<p>Pritha Sarkar,<sup>1</sup> Ruth Whittam,<sup>1</sup> Leslie D. McIntosh<sup>1</sup></p>
<h4>Objective</h4>
<p> Properly declaring conflicts of interest (COIs) is essential for assessing potential bias in scholarly publications and maintaining research integrity. However, COI declarations are often inconsistent with significant variation in the requirements set by different journals. This leads to discrepancies in reporting and contributes to confusion regarding what constitutes a complete and transparent COI disclosure. This study uses a data-driven approach to create and measure a COI declaration taxonomy akin to CReDiT.<sup>1</sup> If journals standardize COI reporting requirements to this taxonomy, it will help address these inconsistencies.</p>
<h4>Design</h4>
<p> In 2023, Dimension’s full-text database<sup>2</sup> was used to perform a descriptive study on COI statements found in 2966 randomly selected open-source research papers published between 2012 and 2023. COI declarations were classified in 6 primary categories: (1) none declared, (2) membership or employment, (3) stakeholder or shareholder ownership, (4) funds received, (5) personal relationship, and (6) donation. Using natural language processing tools, ~10% (297) of the statements from the initial pool of 2966 statements were manually annotated, creating a standard for automatic annotation of COI statements. Later, our analysis also leveraged the Retraction Watch<sup>3</sup> database to assess COI-related retractions when it became public in September 2023.</p>
<h4>Results</h4>
<p> Our model, which identifies both undeclared COIs and its categories, found that only 896,893 of 16,044,369 gathered COI statements mentioned at least 1 COI category. The skewness among the recognized COI categories is depicted in <b>Figure 25-1072</b>. The data also revealed significant inconsistencies in COI disclosures (eg, variations in the structure and clarity of statements). Moreover, when the Retraction Watch database<sup>3</sup> was compared with the database for Dimensions,<sup>2</sup> it was observed that among 24,289 overlapping papers, 393 were retracted because of COIs. Of those 393 papers, 349 (~89%) had initially declared no COI.</p>

![](https://assets.underline.io/markdown_image/1/image/d0b3ffc5b8c707f3b87ebbb371bbdb30.png)

<h4>Conclusions</h4>
<p> Due to the varying requirements imposed by different journals, authors often face confusion in clearly and concisely declaring COIs. As a result, many resort to minimal statements such as ”none declared,” and, in some instances, ambiguous terms such as “nil” or “none.” This undermines the intent of transparency. The study highlights this critical gap in the standardization and understanding of COI declarations, emphasizing the need for a structured framework to enhance clarity and transparency. To bridge this gap, we propose Conflict of interestS Taxonomy (CoST), a guideline for COI reporting. This framework provides authors with a straightforward, questionnaire-style tool to ensure consistency and completeness in COI declarations. By fostering adherence to journal and institutional standards, this taxonomy may promote trust within the research community and strengthen the credibility of scientific publications. Our work highlights the importance of systemic change in COI reporting to safeguard the integrity of scholarly communication.</p>
<h4>References</h4>
<p>1. Contributor Role Taxonomy. Contributor Role Taxonomy (CRediT). 2022. <a href="https://credit.niso.org/"><span class="Hyperlink CharOverride-6">https://credit.niso.org/</span></a></p>
<p>2. Hook DW, Porter SJ and Herzog C. Dimensions: Building Context for Search and Evaluation. Front Res Metr Anal. 2018;3:23. doi:10.3389/frma.2018.00023</p>
<p>3. The Retraction Watch Database. Retraction Watch Version 1.0.8.0. <a href="http://retractiondatabase.org/"><span class="Hyperlink CharOverride-6">http://retractiondatabase.org/</span></a> </p>
<sup>1</sup>Digital Science, London, UK, p.sarkar@digital-science.com.</p>
<h4>Conflict of Interest Disclosures</h4>
<p> All authors are employees of Digital Science. None of the authors received any donation or funds for the study.</p>


A Taxonomy-Based Guideline Framework for Conflict of Interest Disclosures (CoST)

<p>Julia Gunn,<sup>1</sup> Coromoto Power Febres,<sup>1</sup> Laura Wilson<sup>1</sup></p>
<h4>Objective </h4>
<p>The disclosure of competing interests in published academic research is vital to transparency and the integrity of the scholarly record.<sup>1</sup> In recent years, Taylor &amp; Francis has seen an increase in complex ethics cases across all disciplines involving perceived competing interests. This study examined this increase, identified patterns across cases, and considered the future implications for academic publishing.</p>
<h4>Design </h4>
<p>This qualitative analysis examined all competing interest cases (N = 71) investigated by the Taylor &amp; Francis Publishing Ethics &amp; Integrity (PEI) team between 2021 and 2024. The study began with data from 2021 because that is when the PEI team began systematically classifying cases. These cases included both unpublished and published manuscripts in 62 journals across all subject areas and included cases involving authors, editors, and peer reviewers. The years in which cases were raised are not necessarily the same as the date published. The study examined case volume increases over time to highlight trends by discipline and subject area, case complexity, and competing interest type (financial or nonfinancial). It also analyzed year-on-year (YoY) growth to identify whether there had been sudden growth in any 1-year period. Further analysis was conducted of the available data for the year that displayed sudden growth (2024). The study sought to explain the increase and consider ways publishers can refine policies to adequately address growing concerns about perceived competing interests.</p>
<h4>Results </h4>
<p>This study revealed several trends. First, between 2021 and 2023, the number of cases increased annually (2021: 9; 2022: 12; 2023: 14; 2024: 35), with significant YoY growth between 2023 and 2024, marking a 150% increase from the previous year. Second, the study also revealed an increase in allegations of failure to disclose perceived nonfinancial competing interests, such as personal relationships, ties to political or ideological organizations, and other relationships perceived to be relevant to the published content. In 2024, the majority of cases involved nonfinancial competing interests (financial: 6; nonfinancial: 19; financial and nonfinancial: 4), with 6 excluded due to insufficient data. Of the 71 cases, 3 involved allegations against editors, 2 were against reviewers, and the remaining 66 concerned authors.</p>
<h4>Conclusions </h4>
<p>This study highlights the need for greater consensus regarding competing interest disclosure. Although publishers typically require disclosure of financial and nonfinancial competing interests,<sup>2</sup> this study suggested that authors, editors, and publishers may struggle to determine what requires disclosure. Limitations of this study include its small sample size and focus only on cases investigated by the ethics team. Additionally, the study suggested that researchers may benefit from education on perceived competing interests. Further research is needed to explore the broader landscape of competing interest disclosure across disciplines and publishers to enhance the transparency of the scholarly record.</p>
<h4>References</h4>
<p>1. Gibson DS, O’Hanlon R. The current conflict of interest landscape and the potential role of information professionals in supporting research integrity. J Hosp Libr. 2020;20(3):183-203. doi:10.1080/15323269.2020.1778970</p>
<p>2. Resnik D. Disclosing and managing non-financial conflicts of interest in scientific publications. Res Ethics. 2023;19(2):121-138. doi:10.1177/17470161221148387</p>
<sup>1</sup>Taylor &amp; Francis Group, Philadelphia, PA, US, julia.gunn@taylorandfrancis.com.</p>
<h4>Conflict of Interest Disclosures </h4>
<p>Julia Gunn is a full-time employee of Taylor &amp; Francis. Coromoto Power Febres is a full-time employee of Taylor &amp; Francis and a member of the International Association of Scientific, Technical &amp; Medical Publishers (STM) Research Integrity Committee and United2Act Education and Awareness Working Group. Laura Wilson is a full-time employee of Taylor &amp; Francis and a member of the STM Membership Committee, United2Act Trust Markers Working Group, and Association of Learned and Professional Society Publishers Policy Committee.</p>


Navigating the Challenges of Competing Interest Disclosures in Academic Publishing

<p>Sue Kim,<sup>1</sup> Soo Young Kim,<sup>2</sup> Hyun Jung Yi<sup>3</sup></p>
<h4>Objective</h4>
<p> Data sharing is strongly recommended for replicability, trustworthy findings, and generation of new hypotheses.<sup>1</sup> Although a data availability statement (DAS) reveals whether data are shared and how to access data, little is known on DAS patterns. This study aimed to evaluate the proportion of articles presenting a DAS according to journal policies in Korea.</p>
<h4>Design </h4>
<p>This cross-sectional study was conducted from July 2024 to January 2025. Articles in KoreaMed member journals published in 2023 were randomly selected (5%) by generating random numbers using the RANDBETWEEN function in Microsoft Excel 2021. The inclusion criterion was human studies in Korean or English. Narrative reviews, letters, editorials, or case studies were excluded. Selected articles (600 of 12,000) were evaluated by the following parameters: presence of a DAS, its appropriateness, and whether the journal has a DAS policy statement. The research design, adherence to the International Committee of Medical Journal Editors (ICMJE) clinical trials data sharing requirement,<sup>2</sup> mention of reporting guidelines in the journal’s guidelines, and health discipline were also assessed as related factors. Two researchers independently reviewed the full text and discussed for consensus, using the Design Algorithm for Medical Literature on Intervention tool<sup>3</sup> to determine study design.</p>
<h4>Results </h4>
<p>After excluding irrelevant articles, 243 articles (including surveys, cohort studies, randomized clinical trials [RCTs], systematic reviews, and integrative reviews) were identified from 126 journals; 74 journals (58.7%) had a DAS policy and 155 articles (63.8%) were published in such journals. Of these, however, 96 articles (61.9%) did not comply with the journal’s policy of specifying data sharing. Of the 243 articles, only 67 (27.6%) articles (from 35 journals) presented a DAS, of which 19 (28.4%) were inappropriate, 41 (61.2%) were generic cliché statements, and only 4 (6%) provided a hyperlink to the data. Of the 74 journals with a DAS policy, 7 (9.5%) presented mixed results ranging from inappropriate to satisfactory DAS, suggesting the need for editorial consistency. Of the 16 experimental studies (from 13 journals), only 6 (3 RCTs, 3 non-RCTs) complied with ICMJE’s policy requiring a DAS, of which only 1 linked to a data registry. For observational studies, 58 of 216 (26.8%) presented a DAS. Journal policy on reporting guidelines (52 articles) was not significant for DAS or health discipline, but variation in the proportion of articles with an acceptable DAS was observable: 66% of articles from medicine (31), 67% from dentistry (2), 100% from nursing (9), and 75% from public health or nutrition (6).</p>
<h4>Conclusions</h4>
<p> Although roughly 62% of journals had a DAS policy, less than half of articles presented a DAS, with only 6% providing actual data. Given this gap, greater awareness of DASs among researchers and editorial consistency is needed, especially considering that ICMJE policy requires a DAS in clinical trials involving humans.</p>
<h4>References </h4>
<p>1. Hulsen T. Sharing is caring-data sharing initiatives in healthcare. Int J Environ Res Public Health. 2020;17(9):3046. doi:10.3390/ijerph17093046</p>
<p>2. Taichman DB, Sahni P, Pinborg A, et al. Data sharing statements for clinical trials: a requirement of the International Committee of Medical Journal Editors. JAMA. 2017;317(24):2491-2492. doi:10.1001/jama.2017.6514</p>
<p>3. Seo HJ, Kim SY, Lee YJ, et al. A newly developed tool for classifying study designs in systematic reviews of interventions and exposures showed substantial reliability and validity. J Clin Epidemiol. 2016;70:200-205. doi:10.1016/j.jclinepi.2015.09.013</p>
<sup>1</sup>College of Nursing, Mo-Im Kim Nursing Research Institute, Yonsei University, Seoul, South Korea, suekim@yuhs.ac; <sup>2</sup>Department of Family Medicine, Kangdong Sacred Heart Hospital, Hallym University College of Medicine, Seoul, South Korea; <sup>3</sup>Medical Library, Hanyang University Guri Hospital, Guri, South Korea.</p>
<h4>Conflict of Interest Disclosures </h4>
<p>None reported.</p>
<h4>Funding/Support </h4>
<p>This study was supported by the Korean Council of Science Editors.</p>
<h4>Role of the Funder/Sponsor </h4>
<p>The funder supported the costs of the research and was not involved in the planning, analysis, or interpretation of the results of the study.</p>


Data availability Statements in Health Research in Articles and Journal Policies in Korea

<p>Erfan Taherifard,<sup>1</sup> Hollin R. Hakimian,<sup>1</sup> Maryam Mooghali,<sup>1</sup> Sahil R. Mane,<sup>1</sup> Mengyuan Fu,<sup>1</sup> Stephen Bamford,<sup>2</sup> Karla Childers,<sup>3</sup> Nihar R. Desai,<sup>4</sup> Cary P. Gross,<sup>1,5,6</sup> Debbie Hewens,<sup>2</sup> Harlan M. Krumholz,<sup>4,7,8</sup> Richard Lehman,<sup>9</sup> Jessica D. Ritchie,<sup>7</sup> Tamsin Sargood,<sup>2</sup> Joshua D. Wallach,<sup>10</sup> Molly K. Willeford,<sup>7</sup> Joseph S. Ross<sup>1,7,8</sup></p>
<h4>Objective</h4>
<p> Sharing clinical trial data can advance scientific knowledge, maximize research impact, and reduce duplication, costs, and risks.<sup>1</sup> However, the impact of such initiatives has not been systematically evaluated. The Yale Open Data Access (YODA) Project is an academic-based data-sharing initiative housed at Yale University.<sup>2</sup> This study evaluated the impact of studies published using data from clinical trials sponsored by Johnson &amp; Johnson that are shared on the YODA Project platform, distinguishing between studies led by the primary study investigators and external investigators.</p>
<h4>Design</h4>
<p> We conducted a cross-sectional study of clinical trials sponsored by Johnson &amp; Johnson that were shared on the YODA Project platform as of December 31, 2021; trials without a primary publication were excluded. Primary publications—defined as the first full-length peer-reviewed published article reporting the trial’s primary end point—were identified. Secondary publications—defined as peer-reviewed published studies using individual-level participant data—were retrieved by screening citations to each trial’s primary publication in the Web of Science. The primary searches in the Web of Science were conducted from September 15 to December 15, 2024, with all searches updated as of December 15, 2024. We collected metrics for primary and secondary publications, including Impact Factors of publishing journals and annual citation counts, Altmetric scores, and Mendeley reader counts. Annual metrics were calculated by dividing each metric by the number of days since publication, then multiplying by 365. Secondary publications were categorized as internal (authored by primary study investigators) or external. Comparisons were performed using Mann-Whitney <i>U</i> tests.</p>
<h4>Results</h4>
<p> There were 294 trials with a primary publication sharing data on the YODA Project platform, 218 (74.1%) of which had at least 1 secondary publication, totaling 1699 secondary publications. Most were pooled analyses (1302 [76.6%]), as opposed to secondary analyses (397 [22.4%]). Trials of heart and blood disease interventions had the highest number of secondary publications per trial (median [IQR], 10.5 [2-19] publications). Compared with primary publications, secondary publications were published in journals with lower median (IQR) journal Impact Factors (8.4 [4.5-22.5] vs 4.9 [3.0-8.5]) and had lower annual citation counts (15.9 [7.8-45.4] vs 5.1 [2.5-11.4]), Altmetric scores (0.8 [0.3-3.1] vs 0.6 [0.2-3.1]), and Mendeley reader counts (10.1 [5.1-17.9] vs 8.4 [3.3-15.5]) (<b>Table 25-1008</b>). Secondary publications were predominantly internal (1169 [68.8%]), which, when compared with external secondary publications, were published in journals with higher median (IQR) Impact Factors (5.1 [3.2-10.3] vs 4.5 [2.9-7.0]) and had higher annual citation counts (5.8 [2.7-12.6] vs 3.2 [1.9-7.5]), Altmetric scores (0.7 [0.2-2.8] vs 0.5 [0.1-3.8]), and Mendeley reader counts (8.9 [4.3-16.3] vs 6.9 [0.9-13.1]).</p>

![](https://assets.underline.io/markdown_image/1/image/88c652a19e052b6b8cf00ea59f085232.png)

<h4>Conclusions</h4>
<p> Clinical trial data sharing through the YODA Project has fostered substantial scholarship, with nearly one-third of secondary studies published using these trials’ data by external investigators not affiliated with the primary study team. While secondary publications generally had lower impact metrics than primary publications, they still demonstrated meaningful scientific dissemination and usage, underscoring their contributions to the broader medical research enterprise.</p>
<h4>References</h4>
<p>1. Angraal S, Ross JS, Dhruva SS, Desai NR, Welsh JW, Krumholz HM. Merits of data sharing: the Digitalis Investigation Group trial. J Am Coll Cardiol. 2017;70(14):1825-1827. doi:10.1016/j.jacc.2017.07.786</p>
<p>2. Ross JS, Waldstreicher J, Bamford S, et al. Overview and experience of the YODA Project with clinical trial data sharing after 5 years. Sci Data. 2018;5:180268. doi:10.1038/sdata.2018.268</p>
<sup>1</sup>Section of General Internal Medicine, Yale School of Medicine, New Haven, CT, US, erfan.taherifard@yale.edu; <sup>2</sup>Johnson &amp; Johnson, London, England, UK; <sup>3</sup>Johnson &amp; Johnson, New Brunswick, NJ, US; <sup>4</sup>Section of Cardiovascular Medicine, Yale School of Medicine, New Haven, CT, US; <sup>5</sup>Cancer Outcomes, Public Policy, and Effectiveness Research Center, Yale School of Medicine, New Haven, CT, US; <sup>6</sup>Department of Chronic Disease Epidemiology, Yale School of Public Health, New Haven, CT, US; <sup>7</sup>Yale–New Haven Hospital Center for Outcomes Research and Evaluation, New Haven, CT, US; <sup>8</sup>Department of Health Policy and Management, Yale School of Public Health, New Haven, CT, US; <sup>9</sup>Institute of Applied Health Research, University of Birmingham, Birmingham, England, UK; <sup>10</sup>Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, US.</p>
<h4>Conflict of Interest Disclosures</h4>
<p> Erfan Taherifard is an academic editor of PLOS One. Stephen Bamford, Karla Childers, Debbie Hewens, and Tamsin Sargood are current employees and shareholders of Johnson &amp; Johnson. Nihar R. Desai, Cary P. Gross, Harlan M. Krumholz, Jessica D. Ritchie, Joshua D. Wallach, Molly K. Willeford, and Joseph S. Ross are members of the YODA Project leadership team and receive support from Johnson &amp; Johnson to support data sharing through the YODA Project. Nihar R. Desai reported working under contract with the Centers for Medicare and Medicaid Services to develop and maintain performance measures used for public reporting and pay-for-performance programs and receiving research grants from and consulting for Amgen, AstraZeneca, Bayer, Boehringer Ingelheim, Bristol Myers Squibb, CSL Behring, Cytokinetics, Merck, Novartis, scPharmaceuticals, and Vifor. Cary P. Gross has received research funding from the NCCN Foundation (AstraZeneca) and Genentech and is an associate editor of JAMA Internal Medicine. Harlan M. Krumholz reported receiving options for Element Science and Identifeye and payments from F-Prime for advisory roles, being a cofounder of and holding equity in Hugo Health, Refactor Health, and ENSIGHT-AI, being associated with research contracts through Yale University from Janssen, Kenvue, and Pfizer, and being editor in chief of JACC. Jessica D. Ritchie reported receiving support from the US Food and Drug Administration (FDA) and Arnold Ventures. Joshua D. Wallach reported receiving support from the FDA and Arnold Ventures, having previously served as a consultant to Hagens Berman Sobol Shapiro LLP and Dugan Law Firm APLC, and being an associate editor of JACC. Joseph S. Ross reported receiving support from the FDA, Arnold Ventures, Agency for Healthcare Research and Quality, and National Heart, Lung, and Blood Institute and being an expert witness at the request of the relator’s attorneys, the Greene Law Firm, in a qui tam suit alleging violations of the False Claims Act and Anti-Kickback Statute against Biogen Inc that was settled in September 2022, and being a deputy editor of JAMA.</p>
<h4>Funding/Support</h4>
<p> This work was supported in part by a research grant from Johnson &amp; Johnson through Yale University to establish a platform for clinical trial data sharing.</p>
<h4>Role of the Funder/Sponsor</h4>
<p> The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the abstract; or decision to submit the abstract for presentation.</p>


Assessing the Impact of Clinical Trial Data Sharing: A Cross-Sectional Study of Clinical Trials Sharing Data on the YODA Project Platform

<p>Eli Paul,<sup>1</sup> Griffin Hughes,<sup>1</sup> Alex Hagood,<sup>1</sup> Matt Vassar<sup>1,2</sup></p>
<h4>Objective</h4>
<p> Data sharing promotes secondary use, transparency, and reproducibility, yet prior studies have revealed gaps in policy standardization and implementation.<sup>1</sup> Although some evaluations have explored data sharing statement (DSS) practices within specific fields or policy contexts, no broad, comparative assessment across medical specialties exists.<sup>2,3</sup> This meta-analysis assesses DSS prevalence across 19 medical specialties and examines variability in adoption rates.</p>
<h4>Design</h4>
<p> We conducted a meta-analysis using harmonized article-level data from 19 separate studies, each prospectively designed and executed by our research team using the same methodology, with each study focused on a distinct medical specialty. Between December 2023 and July 2024, all studies systematically searched PubMed for original research articles published between 2018 and 2023. Study designs included in our study were clinical trials, cohort studies, cross-sectional studies, case series, case-control studies, cost-effectiveness analyses, qualitative research, survey-based studies, and other designs that involved human participants. Reviews, editorials, and commentaries were excluded. For each article, we assessed the presence of a DSS and whether data were publicly accessible. Two independent reviewers performed screening and data extraction per specialty, with discrepancies resolved by consensus. We conducted a random-effects meta-analysis using inverse-variance weights based on standard errors of DSS proportions. Influential study diagnostics were applied to identify and mitigate the impact of extreme specialty effects. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) reporting guideline was followed for the design and execution of our study.</p>
<h4>Results</h4>
<p> Among 20,095 eligible articles, 6092 (30.3%) reported a DSS (<b>Figure 25-1134</b>). Prevalence varied substantially by specialty, from 63.9% in Rheumatology to 1.5% in Plastic Surgery. The pooled DSS reporting rate was 29.8% (prediction interval, 0-65.9%), with high heterogeneity (<i>I</i><span lang="ar-SA">² = 99.60%). After removing influential specialties (rheumatology, neurology, and plastic surgery), the adjusted pooled rate was 27.5% (prediction interval, 0-54.9%), with high heterogeneity persisting (</span><i>I</i><span lang="ar-SA">² = 99.14%).</span></p>

![](https://assets.underline.io/markdown_image/1/image/7555504ed421a8bde9c394748385e4c8.png)

<h4>Conclusions</h4>
<p> Despite increasing emphasis on open science, DSS reporting remains low and inconsistent across medical specialties. The high heterogeneity suggests that DSS reporting is shaped more by specialty-specific norms and editorial practices than by standardized policy. By conducting 19 internally coordinated studies using identical methodology, our team generated a uniquely standardized dataset that enabled robust, cross-specialty comparisons. Stronger policy enforcement and cross-disciplinary coordination among journals, funders, and regulatory bodies are needed to improve transparency and foster responsible data sharing in medical research.</p>
<h4>References</h4>
<p>1. Johnson AL, Anderson JM, Bouvette M, et al. Clinical trial data-sharing policies among journals, funding agencies, foundations, and other professional organizations: a scoping review. <i>J Clin Epidemiol</i>. 2023;154:42-55. doi:10.1016/j.jclinepi.2022.11.009</p>
<p>2. Tedersoo L, Küngas R, Oras E, et al. Data sharing practices and data availability upon request differ across scientific disciplines. <i>Sci Data</i>. 2021;8:192. doi:10.1038/s41597-021-00981-0</p>
<p>3. Vassar M, Jellison S, Wendelbo H, Wayant C. Data sharing practices in randomized trials of addiction interventions. <i>Addict Behav</i>. 2020;102:106193. doi:10.1016/j.addbeh.2019.106193</p>
<sup>1</sup>Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, US, eli.paul@okstate.edu; <sup>2</sup>Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, US.</p>
<h4>Conflict of Interest Disclosures </h4>
<p>Matt Vassar reported receiving funding from the National Institute on Drug Abuse, the National Institute on Alcohol Abuse and Alcoholism, the US Office of Research Integrity, and the Oklahoma Center for Advancement of Science and Technology and internal grants from the Oklahoma State University Center for Health Sciences outside the submitted work. No other disclosures were reported.</p>


Data Sharing Statement Reporting Across Medical Specialties

<p>John P. A. Ioannidis,<sup>1,2,3,4</sup> Angelo Maria Pezzullo,<sup>4,5</sup> Antonio Cristiano,<sup>4,5</sup> Guillaume Roberge,<sup>6</sup> Stefania Boccia,<sup>5,7</sup> Jeroen Baas<sup>8</sup></p>
<h4>Objective</h4>
<p><i> </i>Although retractions are increasingly frequent, they remain a small fraction of publications. We have previously incorporated retraction data into Scopus-based databases of top-cited (top 2%) scientists to facilitate linkage of retractions with impact metrics at the individual scientist level.<sup>1</sup> Here, we explored whether gender disparities in the likelihood of having retractions exist, both among highly cited authors and among all authors with at least 5 publications.</p>
<h4>Design </h4>
<p>On August 15, 2024, we screened 55,237 Retraction Watch records, excluding nonretractions, those clearly unrelated to author error, those tied to republished papers, or those not linkable to Scopus, leaving 39,468 eligible retractions. We examined demographics of scientists with and without retractions among highly cited authors (career-long: n = 217,097) and among all authors with at least 5 publications (n = 10,361,367). We were able to assign gender using NamSor<sup>2</sup> to 186,466 and 8,267,888 authors, respectively. We stratified authors by publication age, field,<sup>3</sup> country income level (high, other), and publication volume, identifying for all these strata and for individual countries, men and women, and with and without retractions. We computed gender-specific retraction rates and calculated the relative propensity (R) of women vs men to have at least 1 retraction.</p>
<h4>Results </h4>
<p>Authors with retractions were more common among highly cited scientists (3.3%) than among non–highly cited scientists (0.7%). Overall, gender differences were modest: among highly cited authors, retraction rates were 2.9% for women and 3.1% for men; among all authors, retraction rates were 0.7% for both genders. Men consistently showed slightly higher retraction rates than women within both income groups. Field-specific analysis among all authors revealed women’s rates were at least one-third lower than men’s (R &lt; 0.67) in biology, biomedical research, and psychology and cognitive sciences, but higher (R &gt; 1.33) in economics and business, engineering, and information and communication technology. Among highly cited scientists, the highest women to men retraction ratios were in mathematics and statistics (R = 3.06) and engineering (R = 1.78), while biomedical research (R = 0.64) and built environment and design (R = 0.65) had lower rates for women. Across publication age cohorts, gender differences in retraction rates among all authors were minimal; however, among highly cited authors, younger cohorts showed increasingly higher rates among men (4.2% of men and 3.0% of women in those starting to publish in 2002-2011; 8.7% of men and 4.9% of women in those starting to publish post-2011). Country-level data revealed particularly large gender gaps in Pakistan (men, 28.7%; women, 14.3%), Iran (12.4% vs 9.3%), and India (9.2% vs 6.6%) among highly cited authors. Among all authors, country-level gender gaps were small.</p>
<h4>Conclusions </h4>
<p>Gender differences in retraction rates were small in most settings but varied by field, country, and publication cohort. Overall, field and country were more strongly associated with retraction rates than gender. These results highlight the need to account for structural and contextual factors when interpreting gender disparities.</p>
<h4>References</h4>
<p>1. Ioannidis JPA, Pezzullo AM, Cristiano A, Boccia S, Baas J. Linking citation and retraction data reveals the demographics of scientific retractions among highly cited authors. <i>PLoS Biol.</i> 2025;23(1):e3002999. doi:10.1371/journal.pbio.3002999</p>
<p>2. NamSor. Accessed July 14, 2025. <a href="https://NamSor.app"><span class="Hyperlink CharOverride-6">https://NamSor.app</span></a></p>
<p>3. Archambault É, Beauchesne OH, Caruso J. Towards a multilingual, comprehensive and open scientific journal ontology. In: <i>Proceedings of the 13th International Conference of the International Society for Scientometrics and Informetrics</i>. 2011;13:66-77.</p>
<sup>1</sup>Department of Medicine, Stanford University, Stanford, CA, US, jioannid@stanford.edu; <sup>2</sup>Department of Epidemiology &amp; Population Health, Stanford University, Stanford, CA, US; <sup>3</sup>Department of Biomedical Data Science, Stanford University, Stanford, CA, US; <sup>4</sup>Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, US; <sup>5</sup>Section of Hygiene, Department of Life Sciences and Public Health, Università Cattolica del Sacro Cuore, Rome, Italy; <sup>6</sup>Analytics and Data Services, Elsevier B.V., Montreal, Canada; <sup>7</sup>Department of Women, Children and Public Health Sciences, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy; <sup>8</sup>Research Intelligence, Elsevier B.V., Amsterdam, the Netherlands.</p>
<h4>Conflict of Interest Disclosures</h4>
<p> Guillaume Roberge and Jeroen Baas are employees of Elsevier. John P. A. Ioannidis is a member of the Peer Review Congress Advisory Board but was not involved in the review or decision for this abstract.</p>
<h4>Additional Information </h4>
<p>Elsevier runs Scopus, which is the source of these data, and also runs the repository where the database of highly cited scientists is now stored.</p>


Retraction Prevalence and Gender Imbalance Among Highly-Cited Authors and Among All Authors Across Scientific Disciplines

<p>Ulrike K. Müller,<sup>1</sup> M. Janneke Schwaner,<sup>2</sup> Ksenia Keplinger<sup>2</sup></p>
<h4>Objective</h4>
<p> Despite decades of diversity initiatives, inequality persists, including in academic publishing. Promising trends remain weak when intersectionality is considered.<sup>1,2</sup> Inspired by the concept of intersectionality, we hypothesize that relying solely on gender as an indicator underestimates inequality, as decades of tokenistic inclusion measures have masked the true extent of inequality. The central idea of this study requires us to go beyond direct equity indicators, such as gender, race, and geographic location, and to identify indirect indicators. We predict that indirect indicators of inequality that correlate with gender due to intersectionality (eg, type of institution, as the proportion of women faculty is lower at research-intensive institutions<sup>3</sup>) will show higher levels of inequality, with more extreme disparities at higher rungs of the academic power ladder.</p>
<h4>Design</h4>
<p> In this cross-sectional study, we quantified inequality predicted by gender vs type of institution by collecting data from 50 top-ranked journals (SCImago ranking) for 6 academic fields (<b>Table 25-1014</b>) on lead editors, on editorial boards for 5 of those journals, on corresponding authors for 1 journal, and the editorial board for 1 journal from 1979 to 2022. All data were accessed in 2022. We determined gender from pronouns used in self-authored or self-edited documents whenever possible, such as editorial biographical sketches, and otherwise used text written by authors with a high likelihood of knowing correct pronouns, such as acknowledgments. When collecting data on lead editors, we excluded publications led by large subject-specific editorial teams.</p>

![](https://assets.underline.io/markdown_image/1/image/7700941f95b0ea61cfbbc7bdf2d7e778.png)

<h4>Results</h4>
<p> This study included 407 lead editors, 340 editorial board members, and 607 corresponding authors. Overall, women accounted for 51% of corresponding authors, 34% of editorial board members, and 37% of lead editors. Between 1979 and 2023, the proportion of women editors increased steadily from a median of 10% in the 1980s to more than 50% in the 2020s. In contrast, the proportion of PUI editors remained largely flat, with a median near 10%, only increasing in the 2020s under the tenure of a PUI lead editor. Inequality was higher for type of institution. Although more US faculty worked at primarily undergraduate institutions (PUIs) than PhD-granting institutions, only 12% of corresponding authors, 5% of editorial board members, and less than 1% of editors in chief worked at PUIs.</p>
<h4>Conclusions</h4>
<p> The observed trends are consistent with our central idea—indirect indicators of inequality that reflect intersectionality, such as type of institution, reveal more severe inequality in academic publishing than direct inequality indicators, such as gender.</p>
<h4>References</h4>
<p>1. Memon AR, Ahmed I, Ghaffar N, Ahmed K, Sadiq I. Where are female editors from low-income and middle-income countries? a comprehensive assessment of gender, geographical distribution and country’s income group of editorial boards of top-ranked rehabilitation and sports science journals. <i>Br J Sports Med</i>. 2022;56(8):458-468. doi:0.1136/bjsports-2021-105042</p>
<p>2. Bates DC, Borland E. Fitting in and stalling out: collegiality, mentoring, and role strain among professors in the sciences at a primarily undergraduate institution. <i>Polymath</i>. 2014;4(2):50-68.</p>
<p>3. Curtis JW. Faculty gender equity indicators 2021: data report. Accessed July 16, 2025. <a href="https://mountainscholar.org/bitstreams/78250ae2-8a5c-4bc0-b43d-4417d53adba9/download"><span class="Hyperlink CharOverride-6">https://mountainscholar.org/bitstreams/78250ae2-8a5c-4bc0-b43d-4417d53adba9/download</span></a></p>
<sup>1</sup>Fresno State University, Fresno, CA, US, umuller@csufresno.edu; <sup>2</sup>Max Planck Institute for Intelligent Systems, Stuttgart, Germany.</p>
<h4>Conflicts of Interest Disclosures </h4>
<p>Ulrike K. Müller is the editor in chief of <i>Integrative and Comparative Biology</i>, a journal included in the dataset analyzed for this study. No other disclosures were reported.</p>


Academic Institutional Affiliations and Gender of Authors, Editorial Board Members, and Editors of Journals

<p>Navita Goyal,<sup>1</sup> Ivan Stelmakh,<sup>2</sup> Nihar B. Shah,<sup>3</sup> Hal Daumé III<sup>1</sup></p>
<h4>Objective</h4>
<p> Peer review often involves multiple reviewers to reduce bias and broaden perspectives.<sup>1,2</sup> We examined the role of diversity among reviewers assigned to evaluate a paper as a factor in diversifying perspectives and improving the utility of the peer review process.<sup>3</sup> We proposed 2 desiderata: reviews should cover most contents of the paper (high coverage) and reviews should add information not already present in other reviews (low redundancy). We hypothesized that reviews from diverse reviewers would exhibit higher coverage and lower redundancy.</p>
<h4>Design</h4>
<p> We conducted a cohort study using data from the International Conference on Machine Learning, a top-tier venue in computer science. Data were collected in February to April 2020 and analyzed January to April 2024. Reviewer diversity was defined along 5 binary dimensions: whether reviewers belonged to the same organization, same geographical region, similar seniority levels, similar research topics, or had common coauthors or papers. Organization and geographical data were obtained from reviewer profiles, seniority was based on h-index, coauthorship was determined from Google Scholar publications records, and topics were inferred using a topic model applied to the abstracts of reviewers’ prior publications. Seniority and topical diversity were binarized using median h-index and topical similarity scores, respectively. Coverage was measured by the breadth of review criteria addressed—specifically, the aspects of the paper discussed (eg, summary, motivation, originality, soundness) and the types of arguments used (eg, fact, request, reference, quote)—and lexical and semantic overlap between the reviews and the paper abstract. Redundancy was measured as the lexical and semantic overlap among different reviews. Both measures were computed using natural language processing tools. To isolate the relationship between diversity and review coverage and redundancy, we controlled for potential confounders, including reviewers’ expertise (measured as similarity between reviewer’s published papers and the submitted paper), reviewer characteristics (organization, location, topic, coauthors, and seniority), and paper content (by comparing diverse and nondiverse slates of reviewers for the same paper). We used a weighted linear regression model with review coverage or redundancy as the dependent variable and diversity and confounding factors as independent variables. Statistical significance was assessed using <i>t</i> tests.</p>
<h4>Results</h4>
<p> This study included 4991 submitted papers and 3637 reviewers. Diversity in publication networks and seniority were associated with broader coverage of review criteria (<span class="CharOverride-4">Table 25-1066</span>). Topical diversity was associated with a broader coverage of the paper. No significant association was found between coverage and organizational and geographical diversity. Except for geographical diversity, diversity in organizations, seniority, topics, or publications networks were associated with lower redundancy among reviews. Furthermore, publication network-based diversity alone was associated with varying perspectives (that is, low redundancy) within specific review criteria.</p>
<h4>Conclusions</h4>
<p> Our study revealed that, in addition to optimizing individual reviewer expertise, choosing diverse slates of reviewers can lead to better reviews with higher coverage and lower redundancy. The findings are limited to certain aspects of review utility, namely redundancy and coverage, operationalized through specific measures. We recognize that there may be other factors that are crucial, either generally or specific to a particular conference or journal, which we have not addressed.</p>
<h4>References</h4>
<p>1. Shah NB. Challenges, experiments, and computational solutions in peer review. Comm ACM. 2022;65(6):76-87. doi:10.1145/3528086</p>
<p>2. Lee CJ, Sugimoto CR, Zhang G, Cronin B. Bias in peer review. J Am Soc Inf Sci Technol. 2013;64(1):2-17. doi: 10.1002/asi.22784</p>
<p>3. Jackson SE, May KE, Whitney K, Guzzo RA, Salas E. Understanding the dynamics of diversity in decision making teams. Team Effectiveness Decision Making Organ. 1995;204:261.</p>
<sup>1</sup>University of Maryland, College Park, MD, US, navita@umd.edu; <sup>2</sup>New Economic School, Moscow, Russia; <sup>3</sup>Carnegie Mellon University, Pittsburgh, PA, US.</p>
<h4>Conflict of Interest Disclosures</h4>
<p> Nihar B. Shah is a member of the Peer Review Congress Advisory Board but was not involved in the review or decision for this abstract.</p>
<h4>Funding/Support</h4>
<p> This research was supported by National Science Foundation award 1942124 and Office of Naval Research award N000142212181.</p>
<h4>Role of the Funder/Sponsor</h4>
<p> The funders played no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the abstract; or decision to submit the abstract for presentation.</p>
<h4>Additional Information</h4>
<p> We thank the current and former members of the University of Maryland Computational Linguistics and Information Processing laboratory, especially Alexander Hoyle and Connor Baumler, for their useful suggestions and feedback on this work. This study was approved by the University of Maryland Institutional Review Board.</p>


Diversity Among Reviewers Assigned to Evaluate a Paper as a Factor in Diversifying Perspective and Improving the Peer Review Process in Computer Science

<p>James M. Zumel Dumlao,<sup>1</sup> Misha Teplitskiy<sup>1</sup></p>
<h4>Objective</h4>
<p> This study tested whether (1) peer reviewers from the same country as the corresponding author are more favorable compared with those from a different country and (2) corresponding authors have differential access to these same-country reviewers (SCRs). While reviewer geographic diversity was previously considered,<sup>1,2</sup> attempts to establish same-country preferences were confounded<sup>2</sup> or had small samples.<sup>3</sup></p>
<h4>Design</h4>
<p> This cross-sectional study (using the STROBE reporting guideline) took place from October 2022 to May 2025. Using metadata from 204,718 submissions to 60 STEM journals published by the Institute of Physics Publishing from 2018 to 2022, the study employed linear models with fixed effects and 
	t tests for significance at the 1% level. Standard errors were clustered at the level of the fixed effects. Only first-round reviews were included to avoid autocorrelation (2.10 first-round reviewers per submission on average; 14.67% were SCRs). Fixed effects limit analysis to within-group comparisons. For example, manuscript fixed effects control for time-invariant variation across manuscripts like quality and proportion of SCRs on the review panel. To test the first hypothesis, this study compared the likelihood of a positive review (outcome) between SCRs and non-SCRs (exposure) using manuscript and reviewer fixed effects. Review positivity is equal to 0 if a reviewer recommended to reject the submission and 1 otherwise. To test the second hypothesis, this study estimated the likelihood a reviewer is an SCR (outcome) by corresponding author country income category (exposure) using journal fixed effects and controls for logged team size and anonymization status. Of 156 corresponding author countries, 60 were high-income countries (HIC), 39 were upper-middle income (UMIC), and 57 were low- and lower-middle income (LLMIC), according to World Bank classification.</p>
<h4>Results</h4>
<p> SCRs were more likely to give positive reviews compared with non-SCRs on the same manuscript (4.78 percentage points higher [95% CI, 3.78-5.78]; n = 181,228). Estimates of relative SCR positivity were positive for all country income groups (<b>Figure 25-1099</b>). HIC authors received SCRs over twice as often as LLMIC authors (4.97% [95% CI, 3.50%-6.44%] vs 2.66% [95% CI, 1.41%-3.91%]; n = 237,823). Authors from countries most represented among reviewers—the US, China, and India—had the greatest likelihood of receiving SCRs (30.27% [95% CI, 30.26%-30.28%], 26.59% [95% CI, 24.41%-28.77%], and 13.69% [95% CI, 10.77%-16.61%], respectively; n = 237,823).</p>

![](https://assets.underline.io/markdown_image/1/image/5893761af38fd09800d0ef2976033283.png)

<h4>Conclusions</h4>
<p> Lack of geographical diversity among reviewers—possibly reflecting historical patterns of scientific production associated with country wealth—may introduce structural advantages if reviewers favor work from their own country, as this study demonstrated. However, diversification may be challenging if qualified reviewer capacity is low in underrepresented countries. Further research should examine generalizability across fields and test potential remedies.</p>
<h4>References</h4>
<p>1. Smith OM, Davis KL, Pizza RB, et al. Peer review perpetuates barriers for historically excluded groups. <i>Nat Ecol Evol</i>. 2023;7(4):512-523. doi:10.1038/s41559-023-01999-w</p>
<p>2. Murray D, Siler K, Larivière V, et al. Author-reviewer homophily in peer review. scientific communication and education <i>bioRxiv</i>. 2018. doi:10.1101/400515</p>
<p>3. Tomkins A, Zhang M, Heavlin WD. Reviewer bias in single- versus double-blind peer review. <i>Proc Natl Acad Sci USA</i>. 2017;114(48):12708-12713. doi:10.1073/pnas.1707323114</p>
<sup>1</sup>University of Michigan School of Information, Ann Arbor, MI, US, jamesmzd@umich.edu.</p>
<h4>Conflict of Interest Disclosures</h4>
<p> None reported.</p>
<h4>Funding/Support</h4>
<p> This study received funding from the Institute of Physics Publishing, Schmidt Futures, and Science for Progress Initiative.</p>
<h4>Role of the Funder/Sponsor</h4>
<p> The Institute of Physics Publishing was involved in the collection, management, analysis, and interpretation of the data and preparation, review, or approval of the abstract. Schmidt Futures and Science for Progress Initiative contributed personnel funding.</p>
<h4>Acknowledgment</h4>
<p> We thank the Institute of Physics Publishing, and particularly Kim Eggleton and Mikka Pers, for supporting this project. We thank Schmidt Futures and the Science for Progress Initiative for financial support.</p>


Geographical Representation of Author Country among Peer Reviewers and Publishing Success at 60 STEM Journals

<p>Mabel Chew,<sup>1</sup> Taissa Vila,<sup>2</sup> Jashelle Caga-Meller,<sup>3</sup> Zoë Mullan,<sup>4</sup> Diana Samuel<sup>5</sup></p>
<h4>Objective</h4>
<p> As part of The Lancet<i> </i>Group’s commitment to advancing equity, diversity, and inclusion, we implemented the Sex and Gender Equity in Research (SAGER) guidelines<sup>1</sup> in 2023, and <i>The Lancet</i> guidance on reporting race and ethnicity<sup>2</sup> in June 2024 across 24 Lancet Group journals. Although data exist on the reporting of race and ethnicity in published articles after similar guidelines were launched,<sup>3</sup> less is known about how authors view and engage with guidelines, which is crucial to implementing and refining editorial policy. Thus, we aimed to examine authors’ awareness of and responses to these guidelines and identify challenges to guideline implementation.</p>
<h4>Design</h4>
<p> Corresponding authors of research or review articles submitted to a <i>Lancet</i> journal, who had received a request for revision between July and December 2024, were invited to participate in an online survey in January 2025. The survey asked authors about their awareness of the guidelines, changes they made to their manuscripts in response to editorial advice, the ease with which they made those changes, any challenges encountered, and how these guidelines might influence their next project.</p>
<h4>Results</h4>
<p><i> </i>The survey response rate was 22% (484 of 2185 invitations). The largest proportion of respondents was from the US (68 [14%]), followed by China (65 [13%]), the UK (59 [12%]), Australia (30 [6%]), the Netherlands (27 [6%]), Germany (21 [4%]), Canada (19 [4%]), and Sweden (17 [4%]). Fifty-four percent identified as a man (n=262), 41% as a woman (n=197), 1% as non-binary or gender diverse (n=5), and 4% preferred not to say (n=20); (64%) were involved in research and/or development, and 191 (40%) were senior researchers or in middle management. Of the 484 respondents, 193 (40%) and 220 (46%) were aware of the sex and gender and race and ethnicity reporting guidelines before submitting, respectively. A total of 246 respondents (51%) and 266 (55%), respectively, were not required to collect these data, and 9 (2%) and 33 (7%) were not permitted to collect these data. Among 153 respondents (32%) who amended their manuscript as a result of the sex and gender guidance, 104 found this easy or very easy to do. Fewer respondents (90 [19%]) made changes in response to the race and ethnicity guidance, with 55 finding this easy or very easy. <b>Box 25-1122</b> includes open-text responses on challenges in addressing these guidelines. Approximately one-half of respondents said they were likely or very likely to do things differently in their next project as a result of these guidelines (255 [53%] and 221 [46%] for each guidance, respectively).</p>

<h4>Conclusions</h4>
<p> Less than one-half of the authors surveyed reported awareness of sex and gender or race and ethnicity reporting guidelines before submission, suggesting that increasing awareness could enhance engagement. Most authors who amended their manuscript in response to these guidelines found this to be easy. The challenges identified provide opportunities for journals to refine editorial processes.</p>

![](https://assets.underline.io/markdown_image/1/image/f556edaec2af5850b8b81ae3c23ff545.png)

<h4>References</h4>
<p>1. Heidari S, Babor TF, De Castro P, Tort S, Curno M. Sex and gender equity in research: rationale for the SAGER guidelines and recommended use. <i>Res Integr Peer Rev</i>. 2016;1:2. doi:10.1186/s41073-016-0007-6</p>
<p>2. Chew M, Samuel D, Mullan Z, Kleinert S; Lancet Group for Racial Equity (GRACE). The Lancet Group’s new guidance to authors on reporting race and ethnicity. <i>Lancet</i>. 2024;403(10442):2360-2361. doi:10.1016/S0140-6736(24)01081-X</p>
<p>3. Flanagin A, Cintron MY, Christiansen SL, et al. Comparison of reporting race and ethnicity in medical journals before and after implementation of reporting guidance, 2019-2022. <i>JAMA Netw Open</i>. 2023;6(3):e231706. doi:10.1001/jamanetworkopen.2023.1706</p>
<sup>1</sup><i>The Lancet, </i>Elsevier Australia, Chatswood, Sydney, Australia, mabel.chew@lancet.com; <sup>2</sup><i>The Lancet Regional Health—Americas, </i>Rio de Janeiro, Brazil; <sup>3</sup><i>The Lancet Regional Health—Western Pacific</i>, Sydney, Australia; <sup>4</sup><i>The Lancet Global Health</i> London, UK; <sup>5</sup><i>The Lancet Digital Health</i>, London, UK.</p>
<h4>Conflict of Interest Disclosures</h4>
<p> Mabel Chew is a member and former co-chair of The Lancet Group for Racial Equity and has received funding for conference travel expenses from the World Conference on Research Integrity, Committee on Publication Ethics, and Nuffield Department of Primary Care Health Sciences. Taissa Vila is co-chair of and a member of The Lancet Group for Racial Equity. Jashelle Caga-Meller is honorary clinical senior lecturer at the Faculty of Medicine and Health, University of Sydney, Australia, and a member of The Lancet Group for Racial Equity. Diana Samuel is a member and former co-chair of The Lancet Group for Racial Equity, and a member and former Chair of the European Association of Science Editors’ (EASE) EDI Committee.</p>
<h4>Acknowledgments </h4>
<p>We thank all authors who responded to the survey; Marco Conforti for database support; Louise Hall and Adrian Mulligan for their help in conducting the survey and in preliminary reporting and analysis; Pooja Jha, Rupa Sarkar, Lan-Lan Smith, Richard Horton, and members of the <i>Lancet’s</i> Group for Racial Equity (GRacE) for advice and support.</p>


Next from The 10th Peer Review Congress

A Taxonomy-Based Guideline Framework for Conflict of Interest Disclosures (CoST)

Similar lecture

Attitudes and Perceptions of Biomedical Journal Editors in Chief Towards the Use of Artificial Intelligence Chatbots in the Scholarly Publishing Process