Download PDF
Pharmacopsychiatry 2020; 53(06): 247-255
DOI: 10.1055/a-1167-3567
Original Paper

Importance, Errors, and Patterns of Quotations to Psychiatric Original Articles

Christopher Baethge
1   Department of Psychiatry and Psychotherapy, University of Cologne Medical School, Cologne, Germany
2   Deutsches Ärzteblatt & Deutsches Ärzteblatt International, Cologne, Germany
› Author Affiliations Funding: This study has not been externally funded.
› Further Information
Also available at
    Permissions and Reprints

Abstract

Introduction A substantial rate of quotation errors has been reported in medical journal publications: about 25% of all quotations are wrong. It is, however, entirely unclear how important quotation errors are for the message of quoting articles.

Methods This is a case study in form of a retrospective quotation analysis of a cohort of 72 psychiatric original articles (index articles) from 5 German-language general psychiatric journals. Main outcomes were importance and accuracy of quotations from the 2 calendar years following the publication of index articles.

Results Fifty-one index articles were quoted 235 times in 109 quoting articles. Almost all quotations were of medium (76% [95% CI: 70%; 81%]) or high (20% [15%, 25%]) importance for the message of the quoting paper. Regarding quotation accuracy, 44 quotations (19% [14%; 24%]) were rated as minor, and 51 (22% [17%; 27%]) as major errors. In multivariable analyses, no statistically significant and practically relevant factors associated with quotation inaccuracy emerged, such as self-quotation, impact factor of the quoting journal, or importance. Among quoting articles, 7 (6% [3%; 13%]) showed a pattern of predominantly quoting index articles from the time span relevant to the calculation of the impact factor.

Discussion Quotations are important for the message of the quoting paper. Therefore, quotation errors may be detrimental to scientific reasoning and may undermine public trust in medical science. The present investigation is a case study, and its results are exploratory. While it is plausible that the findings translate into other environments, independent replication is needed.

Key words

quotation accuracy - bibiometric study - psychiatric journals

Supplementary Material



Publication History

Received: 17 January 2020
Received: 13 April 2020

Accepted: 23 April 2020

Article published online:
02 June 2020

© 2020. Thieme. All rights reserved.

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

 

  • References

  • 1 de Lacey G, Record C, Wade J. How accurate are quotations and references in medical journals?. Br Med J 1985; 291: 884-886
    CrossrefPubMedGoogle Scholar
  • 2 Jergas H, Baethge C. Quotation accuracy in medical journal articles—a systematic review and meta-analysis. Peer J 2015; 3: e1364
    CrossrefPubMedGoogle Scholar
  • 3 Lawson L, Fosker R. Accuracy of references in psychiatric literature: A survey of three journals. Psychiatr Bull 1999; 23: 221-224
    CrossrefPubMedGoogle Scholar
  • 4 Pieters G, Ceysens E, De Heyn E. Formele en inhoudelijke nauwkeurigheid van referenties in het Tijdschrift voor Psychiatrie [Accuracy and appropriateness of references in the “Tijdschrift voor Psychiatrie”]. Tijdschr Psychiatr 2001; 43: 349-354
    PubMedGoogle Scholar
  • 5 Heidenreich U, Baethge C. Deutschsprachige psychiatrische Zeitschriften in der Bundesrepublik—eine quantitative Bestandsaufnahme [German language psychiatry journals in Germany—a quantitative analysis]. Psychiatr Prax 2012; 39: 26-33
    Article in Thieme ConnectPubMedGoogle Scholar
  • 6 Baethge C. The production and recognition of psychiatric original articles published in languages other than English. BMC Psychiatry 2013; 13: 102
    CrossrefPubMedGoogle Scholar
  • 7 Sikorski C, Motzek T. Psychiatrie in der Lebensspanne? Der Altersbezug in der psychiatrischen Forschung [Psychiatry of the life span? Relevance of age in psychiatric research]. Psychiatr Prax 2010; 37: 401-404
    Article in Thieme ConnectPubMedGoogle Scholar
  • 8 Petermann F, Schüßler G. Zum Status der Psychotherapieforschung im deutschen Sprachraum—Eine bibliometrische Analyse dreier deutschsprachiger Zeitschriften. Z Psychosom Med Psychotherapie 2010; 56: 297-313
    PubMedGoogle Scholar
  • 9 Stengler K, Glaesmer H, Dietrich S. Gender- und geschlechtsspezifische Aspekte in der psychiatrischen und psychotherapeutischen Forschung: eine bibliometrische Analyse. Z Psychiatr. Psychol Psychother 2011; 59: 305-310
    PubMedGoogle Scholar
  • 10 Schüßler G, Petermann F. Status der psychosomatischen Forschung im deutschsprachigen Bereich. Psychotherapeut 2011; 56: 409-416
    CrossrefPubMedGoogle Scholar
  • 11 Petermann F, Lehmkuhl G. ADHS und Störung des Sozialverhaltens. Trends im deutschsprachigen Raum. Z Kinder Jugendpsychiatr Psychother 2011; 39: 421-426
    CrossrefPubMedGoogle Scholar
  • 12 de Vries U, Lehmkuhl G, Petermann F. Risiken und Chancen für Kinder in belasteten Familien [Risk and opportunities for children in problem families] Prax Kinderpsychol und Kinderpsychiatr 2011; 60: 576-588
    PubMed
  • 13 Wallesch CW. Alzheimer-Krankheit und senile Demenz. Fortschr Neurol Psychiatr 2011; 79: 137
    Article in Thieme ConnectPubMedGoogle Scholar
  • 14 Lukic IK, Lukic A, Gluncic V. et al. Citation and quotation accuracy in three anatomy journals. Clin Anat 2004; 17: 534-539
    CrossrefPubMedGoogle Scholar
  • 15 Goldberg R, Newton E, Cameron J. et al. Reference accuracy in the emergency medicine literature. Ann Emerg Med 1993; 22: 1450-1454
    CrossrefPubMedGoogle Scholar
  • 16 Davids J, Weigl D, Edmonds J. et al. Reference accuracy in peer-reviewed pediatric orthopaedic literature. J Bone Joint Surg Am 2010; 92: 1155-1161
    CrossrefPubMedGoogle Scholar
  • 17 Mertens S, Baethge C. The virtues of correct citation: Careful referencing is important but is often neglected—even in peer-reviewed articles. Dtsch Arztebl Int 2011; 108: 550-552
    PubMedGoogle Scholar
  • 18 Bouter LM, Tijdink J, Axelsen N. et al. Ranking major and minor research misbehaviors: Results from a survey among participants of four World Conferences on Research Integrity. Res Integr Peer Rev 2016; 1: 17
    CrossrefPubMedGoogle Scholar
  • 19 Clarivate Analytics. Suppressed titles 2017-2007 help.incites.clarivate.com/incitesLiveJCR/JCRGroup/8687-TRS. (accessed January 3, 2020).
    PubMedGoogle Scholar
  • 20 Busse R, Geissler A, Aaviksoo A. et al. Diagnoses related groups in Europe: Moving towards transparency, efficiency, and quality in hospitals. BMJ 2013; 346: f3197
    CrossrefPubMedGoogle Scholar
  • 21 Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-174
    Google Scholar
  • 22 Armstrong MF, Conduff JH, Fenton JE. et al. Reference errors in otoloaryngology—head and neck surgery literature. Otolaryngol Head Neck Surg 2018; 159: 249-253
    CrossrefPubMedGoogle Scholar
  • 23 Fenton JE, Brazier H, De Souza A. et al. The accuracy of citation and in otolaryngology/head and neck surgery journals. Clin Otolaryngol Allied Sci 2000; 25: 40-44
    CrossrefPubMedGoogle Scholar
  • 24 Baethge C. The languages of medicine. Dtsch Arztebl Int 2008; 105: 37-40
    PubMedGoogle Scholar
  • 25 Finkenzeller W, Zobel I, Rietz S. et al. Interpersonelle Psychotherapie und Pharmakotherapie bei Post-Stroke-Depression. Machbarkeit und Effektivität [Interpersonal psychotherapy and pharmacotherapy for post-stroke depression. Feasibility and effectiveness]. Nervenarzt 2009; 80: 805-812
    CrossrefPubMedGoogle Scholar
  • 26 Cuijpers P, Geraedts AS, van Oppen P. et al. Interpersonal psychotherapy for depression: A meta-analysis. Am J Psychiatr 2011; 168: 581-592
    CrossrefPubMedGoogle Scholar
  • 27 David I, Brunnauer A, Laux G. et al. Depression und response: Der Einfluss von Persönlichkeit und Kognition [Depression and response: impact of personality and cognition]. Psychiatr Prax 2009; 36: 132-136
    Article in Thieme ConnectPubMedGoogle Scholar
  • 28 Staedt J, Pless-Steinkamp C, Herfeld F. et al. Einfluss erhöhter Lichtintensität auf die Verweildauer von stationär behandelten depressiven Patienten [Influence of light intensity on the length of hospitalisation of depressive patients]. Nervenheilkunde 2009; 28: 223-226
    Article in Thieme ConnectPubMedGoogle Scholar
  • 29 Staedt J, Hauser M, Gudlowski Y. et al. Schlafstörungen bei schizophrenen Erkrankungen. Bedeutung und Optionen einer multimodalen Hilfestellung [Sleep disorders in schizophrenia. importance and options for a multi-dimensional support]. Fortschr Neurol Psychiatr 2010; 78: 70-80
    Article in Thieme ConnectPubMedGoogle Scholar
  • 30 Hoffmann F, Scharfetter W, Glaeske G. Verbrauch von Zolpidem und Zopiclon auf Privatrezepten zwischen 1993 und 2007. [Use of zolpidem and zopiclone on private prescription between 1993 and 2007]. Nervenarzt 2009; 80: 578-538
    CrossrefPubMedGoogle Scholar
  • 31 Joester J, Vogler CM, Chang K. et al. Hypnosedative use and predictors of successful withdrawal in new patients attending a falls clinic. Drugs Aging 2010; 27: 915-924
    CrossrefPubMedGoogle Scholar
  • 32 Tagay S, Düllmann S, Brähler E. et al. Wie hängen Religiosität, psychische Symptombelastung und Integration zusammen? Eine vergleichende Betrachtung der Religiosität bei türkischen/kurdischen Migranten gegenüber Deutschen [How are religiosity, psychological distress and integration interrelated? A comparative study of the religiosity in Turkish/Kurdish migrants in comparisons to Germans]. Psychiatr Prax 2009; 36: 286-292
    Article in Thieme ConnectPubMedGoogle Scholar
  • 33 Schouler-Ocak M, Bretz J, Hauth I. et al. Patienten mit Migrationshintergrund in Psychiatrischen Institutsambulanzen—ein Vergleich zwischen Patienten mit türkischer und osteuropäischer Herkunft sowie Patienten ohne Migrationshintergrund [Patients of immigrant origin in outpatient psychiatric facilities: a comparison between Turkish, Eastern European, and German patients]. Psychiatr Prax 2010; 37: 384-290
    Article in Thieme ConnectPubMedGoogle Scholar
  • 34 Jeske J, Bullinger M, Plaß A. et al. Risikofaktor Krankheitsverarbeitung – Zusammenhänge zwischen der Krankheitsverarbeitung einer elterlichen psychischen Erkrankung und der gesundheitsbezogenen Lebensqualität der Kinder [Risk factor coping with a disease—associations between coping and health related quality of life of children with a mentally ill parent] Z Psychiatr. Psychol Psychother 2009; 57: 207-213
    PubMedGoogle Scholar
  • 35 Stelling K, Kuhn K, Riedel-Heller SG. et al. Entwicklungsprobleme bei jungen Erwachsenen mit einer psychischen Erkrankung: Ergebnisse einer qualitativen Interviewstudie [Developmental problems in young adults suffering from mental illness: Results from an in-depth interview study]. Psychiatr Prax 2009; 36: 119-124
    Article in Thieme ConnectPubMedGoogle Scholar
  • 36 Voigt-Radloff S, Hüll M. Alltagsbewältigung bei Demenz: Medikamentöse und nicht medikamentöse Interventionen zeigen kleine Effekte auf heterogenen Skalen. Eine Synopse vier systematischer Reviews [Daily functioning in dementia: Pharmacological and non-pharmacological interventions demonstrate small effects on heterogeneous scales. A synopsis of four health technology assessments]. Psychiatr Prax 2011; 38: 221-231
    Article in Thieme ConnectPubMedGoogle Scholar
  • 37 Godemann F, Hauth I, Gutzmann H. et al. Gerontopsychiatrie versus Allgemeinpsychiatrie bei stationärer Behandlung von Depressionen im höheren Lebensalter [Gerontopsychiatry versus general psychiatry in the inpatient treatment in late-life depression]. Psychiatr Prax 2009; 36: 270-272
    Article in Thieme ConnectPubMedGoogle Scholar
  • 38 Glaesmer H, Kallert TW, Brähler E. et al. Die Prävalenz depressiver Beschwerden in der älteren Bevölkerung der Bundesrepublik Deutschland und die Bedeutung methodischer Aspekte für die identifizierten Prävalenzen [The prevalence of depressive symptomatology in the German elderly population and the impact of methodological aspects on the identified prevalence]. Psychiatr Prax 2010; 37: 71-77
    Article in Thieme ConnectPubMedGoogle Scholar
  • 39 Ridinger M, König S, Lange K. et al. Einfluss unsicherer Bindungsstile und ADHS auf Alkoholabhängigkeit [The impact of attachment styles and ADHD on alcohol dependence]. Nervenarzt 2009; 80: 827-832
    CrossrefPubMedGoogle Scholar
  • 40 Thorberg TA, Young RM, Sullivan KA. et al. Attachment security and alexithymia in a heavy drinking sample. Addict Res Theory 2011; 19: 556-570
    CrossrefPubMedGoogle Scholar