march 2012

What to choose: internal reporting guidelines or external reporting guidelines?

A step closer to answering this dilemma

March 2012 Class 8

Introdução à Medicina II

Class 8 2

SUMMARY

• Introduction

• Justification

• Research question

• Aims

• Methods

• Some results

• Expected results

• References

What to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma

March 2012

Class 8 3

INTRODUCTION

March 2012

SCIENTIFIC KNOWLED

GE DIVULGATI

ON

Scientific journals

Books

Conferences

Governmental reports

Technical reports

Flyers

Online versions


Class 8 4

INTRODUCTION

March 2012

Scientific articles Scientific journals

First scientific journal First medical journal

Philosophical Transactions of the Royal Society1665

New England Journal of Medicine1812

published in


Class 8 5

INTRODUCTION

March 2012

Scientific articlesContain…

• Motivation of the author• Experimental design and execution• Meaning of the results• Conclusions and recommendations

Require…• Clarity• Concision• Organization• Objectivity

• Better comprehension• More effective way of using its results

To accomplish


Class 8 6

INTRODUCTION

March 2012

Impact of scientific journals

Impact Factor (IF) Average number of times an article published in a given journal was cited in the last two years

Comparison between different scientific areas can induce biased conclusions

Journal Citation Report ISI Web of Knowledge


Impact ≠ Quality

Class 8 7

INTRODUCTION

March 2012

Impact of scientific articles

Number of citations

Possible biases:• Size of the articles• IF of the journal in which they are published

ISI Web of Knowledge

Presented in the end of the academic work, bibliographies or specific indexes


Impact ≠ Quality

Class 8 8

INTRODUCTION

March 2012

GuidelinesInformation for the authors on how they must write their manuscript

Scientific Journals

Not presentation of guidelines

Presentation of guidelines

(recommendation or obligation)

Editing Guidelines

Reporting Guidelines

External

Uniform RequirementsSTREGA SQUIRE STROBE

CONSORT STARD PRISMAGNOSISTRENDORIONCOREQ

QUORUM REMARKMOOSE

Internal


Class 8 9

INTRODUCTION

March 2012

GuidelinesUniform Requirementsfor Manuscripts Submitted to Biomedical Journals

General Reporting Guidelines

Vancouver Group(Vancouver, British Columbia, 1978)

International Committee of Medical Journal Editors (ICMJE)

First statements: 1979Last update: 2010


INTRODUCTION

March 2012 10Class 8

GuidelinesRefering to a particular type of study and to other specific aspects of science publication


GNOSIS Guidelines for neuro-oncology: Standards for investigational studies

CONSORT Consolidated Standards of Reporting Trials

COREQ Consolidated criteria for reporting qualitative research

MOOSE Meta-analysis of Observational Studies in Epidemiology

ORION Outbreak Reports and Intervention Studies Of Nosocomial infection

PRISMA Preferred Reporting Items for Systematic Reviews and Meta-Analyses

QUORUM Quality of Reporting of Meta-analyses of Randomized Controlled Trials

REMARK REporting recommendations for tumour MARKer prognostic studies

SQUIRE Standards for Quality Improvement Reporting Excellence

STARD Standards for the Reporting of Diagnostic Accuracy Studies

STREGA Strengthening the Reporting of Genetic Association studies

STROBE Strengthening the Reporting of Observational studies in Epidemiology

TREND Transparent Reporting of Evaluations with Nonrandomized Designs

JUSTIFICATION

December 2011 11Class 8

Scientific articles - Relevance for doctors:


Medical care is improved by new discoveries and studies that promote a better life perspective for patients.

Breakthroughs are published in scientific articles.

In order to achieve a better treatment for patients and a good management of resources it is imperative to divulgate the knowledge

in the clearest way possible Scientific articles highly effective.

Class 8 12

Depends on…• Sientific content• Way that it is written

March 2012

JUSTIFICATION

The quality of a scientific articleInfluences…

• Interest of scientific community• Diffusion and applicability of the results

PROBLEM:It is not known which type of reporting guidelines leads to a

better diffusion of the scientific breakthroughs.


Highest impact of the articles published

Class 8 13

RESEARCH QUESTION

March 2012

Is there any association between the use of internal reporting guidelines and/or external reporting guidelines and the impact of scientific articles published in Journals of General and Internal

Medicine?


Class 8 14

AIMS

March 2012

Central aim:Evaluate the association between the use of internal or external reporting guidelines and the impact of scientific articles published in General and Internal Medicine Journals.

Specific aims:

• Determine the type of reporting guidelines recommended by each selected scientific journal of General and Internal Medicine.

• Measure the impact of different scientific papers published in 2008 in journals with reporting guidelines.

• Compare the impact of scientific papers published in journals that present internal reporting guidelines to the impact of the articles published in journals which recommend external reporting guidelines.

• Compare the advantages of the use of external reporting guidelines over the use of internal reporting guidelines.


Class 8 15

METHODS

March 2012


Class 8 16

METHODS

March 2012

Type of study:

• Observational study

• Transversal study

• Analytic study


Class 8 17

METHODS

March 2012


Tasks Class 8 Class 21

Colect list of journals of General and Internal Medicine X X

Apply exclusion/inclusion criteria X (distribution)

X (collection)

Colect Impact Factors from 2008, 2009 and 2010 X (distribution)

X (collection)

Analyse the reporting guidelines X (distribution)

X (collection)

Colect articles from 2008 and their number of citations X

Analyse journals by group X

Analyse 6 articles from 2008 for each group X

Calculate impact of articles from 2008 and make statistical analyses X

Class 8 18March 2012

Search in ISI Web of Knowledge for journals of General and Internal Medicine.1

http:// www.isiknowledge.com

METHODS



From all the journals found, distribute its primary analysis by the students of two classes to apply some criteria and collect their Impact Factor from 2008, 2009 and 2010.2

Inclusion Criteria • Journals which have an available web site.

Exclusion Criteria • Websites not written in Portuguese, English or Spanish.

METHODSWhat to choose: internal reporting guidelines or external reporting guidelines?A step closer to answering this dilemma


From all the journals found, distribute its primary analysis by the students of two classes to apply some criteria and collect their Impact Factor from 2008, 2009 and 2010.2

METHODS



Compare the analysis of the journals made by the two reviewers and select the journals for the study.3

METHODS


• Some statistic analysis is done to clarify the motives of exclusion of some journals and to verify how many journals are included in the study.


From the included journals, select those with reporting guidelines and verify its type.4

• Go to the website of the selected journals• Read the section of the instructions for authors• Verify if any guidelines are presented and analyse its type• Select journals that present some type of reporting guidelines

METHODS



From the included journals, select those with reporting guidelines and verify its type.4

Until this point, most methods are commom to both of the classes, so there is a division of the tasks.

• Class 8 is responsible for doing the distribution of the journals between the two classes and for preparing the database.

METHODS



Search for articles of the selected journals which were published in 2008.5

• This information is collected on ISI Web of Knowledge

METHODS



Export information about selected articles to SPSS.6

• Title of the article• Authors• Number of citations• Journal in which it was published

METHODS



Calculate the impact for each article.7

2)2010()2009( IFIF

CNImpact of each article

CN – Citation NumberIF – Impact Factor of the journal

METHODS



Verify if there is an association between the impact of the articles and the type of reporting guidelines used by the journals.8

METHODS


Separate articles into 3 groups:

Articles published in journals using internal reporting guidelines Articles published in journals using external reporting guidelines

(specifying what type) Articles published in journals using both types reporting guidelines

Calculate the mean impact of the articles for each group

Apply ANOVA to verify if there is evidence of diference between groups

Class 8 28

SOME RESULTS

March 2012


There are 153 journals of General and Internal

Medicine.

Class 8 29

SOME RESULTS

March 2012


Included

Excluded

Language

Not available website

134

19

4

15

Application of selection criteria to journals

SOME RESULTS



Divergences

Included

Excluded

23

16

7

Divergences between reviewers

SOME RESULTS



Average IF 2008 2009 2010 3 years

Included 1,021 1,142 1,303 1,120

Excluded 0,464 0,505 0,512 0,505

Language 0,506 0,491 0,474 0,487

Not available website 0,464 0,505 0,697 0,522

Median values of Impact Factor

Class 8 32

EXPECTED RESULTS

March 2012

There will be an association between the use of internal reporting guidelines and/or external reporting guidelines and the impact of scientific papers

HOWEVER…

Impact factor of the journal where the articles are published

Proper characteristics of the study presented in the article

…the differences between those impacts can also be due to:


Class 8 33

EXPECTED RESULTS

March 2012

A guide to the creation (or maintenance) of reporting guidelines for scientific journals of General and Internal Medicine.

A motivation for further studies on this subject, involving other scientific areas

It is expected that our study serve as…

Generalization of the results


Class 8 34

Jacinto T. Informação e conhecimento biomédico, pesquisa bibliográfica, bibliotecas digitais [Biomedical information and knowledge, bibliographic research, digital libraries] [slide]. Porto (Portugal): Faculdade de Medicina da Universidade do Porto (PT), Departamento de Ciências da Informação e da Decisão em Saúde; 2011. Portuguese, English.

Nahas FX, Ferreira LM. A arte de redigir um trabalho científico [periódico na Internet] 2005;20 Suppl. 2:17-8. Disponível em URL:

http://www.scielo.br/acb Nte AR, Awi DD. Writing a scientific paper: getting to the basics. Niger J. Med (2007) Jul-Sep;16(3):212-8. Jacinto T, Morais A, Fonseca JA. How to write a scientific paper - Searching and Managing Biomedical information. Rev Port

Pneumol. 2011;17:190-194. Samil LR. Writing and publication of a medical article. Vandenbroucke J P. STREGA, STROBE, STARD, SQUIRE, MOOSE, PRISMA, GNOSIS, TREND, ORION, COREQ, QUOROM, REMARK and

CONSORT: for whom does the guideline toll?. Clin Epidemiol. 2009;62:594-596. International Committee of Medical Journal Editors. ICMJE, International Committee of Medical Journal Editors [homepage on the

Internet]. [place unknown]: International Committee of Medical Journal Editors; 2009 [cited 2011 Nov 11]. Available from: http://www.icmje.org/

REFERENCES

March 2012


Class 8 35

Rodrigues P. Artigos científicos, aspectos e orientações base [Scientific papers, guidelines and basic aspects] [slide]. Porto (Portugal): Faculdade de Medicina da Universidade do Porto (PT), Departamento de Ciências da Informação e da Decisão em Saúde; 2011. Portuguese, English.

CONSORT Group. CONSORT, TRANSPARENT REPORTING OF TRIALS [homepage on the Internet]. [place unknown]: Minervation;

[reviewed 2011 May 16; cited 2011 Nov 11]. Available from: http://www.consort-statement.org/ STROBE Group. STROBE Statement, Strengthening the Reporting of Observational studies in Epidemiology [homepage on the

Internet]. [Bern (Switzerland)]: ISPM – University of Bern; 2009 [cited 2011 Nov 11]. Available from: http://www.strobe-statement.org/

SQUIRE Group. SQUIRE, Standards for Quality Improvement Reporting Excellence [homepage on the Internet]. [Lebanon (NH)]:

[Publisher unknown]; [cited 2011 Dec 1]. Available from: http://squire-statement.org/ STARD Group. STARD Statement, STAndards for the Reporting of Diagnostic accuracy studies [homepage on the Internet].

[Amsterdam (The Netherlands)]: [Publisher unknown]; [reviewed 2008 Apr 22; cited 2011 Nov 11]. Available from: http://www.stard-statement.org/

Stefánsson E, Kivelä T. The ingredients of a good paper. Acta Ophthalmol. 2010; 88:619-621

REFERENCES

March 2012


march 2012

Documents

reporting guidelines

step closer

answering this dilemma

introduction march

answering this dilemmamarch

conhecimento cientfico

artigo cientfico contm

powerpoint what