Subscribe to RSS
DOI: 10.1055/s-0040-1710159
Improving the Quality of Medical Research
- Abstract
- Introduction
- What Is Medical Research?
- What Is a Good-Quality Medical Research?
- Quality of Reporting
- Conclusion
- References
Abstract
A large number of medical research endeavors are made but only a few of them help in improving health. The primary reason for this dismal picture is the poor quality of most researches that increase the quantity but fail to make an impact. This communication suggests the steps that medical researchers can undertake to improve the quality of their research.
#
Keywords
health research - good quality - improving medical research - research methodology - research data analysisIntroduction
What is a medical research without a new finding? This may look like a valid statement but is not more than rhetoric. A large number of endeavors is made around the world that do not succeed in reaching to new results but many leave a lesson for us. Failure to get anticipated results does not render the research useless. If we know the result already, there is no need for research. But there are several other “researches” that do not contribute anything to our knowledge. This can happen because their research questions are hazy, the methodology is sloppy, the results are vague, or the reporting is unclear. Perhaps “such space-occupying lesions” have proliferated more in medical research quagmire than any other discipline. Quality has taken a back seat amidst rush for quantity.
Medline added as many as 813,598 citations in the year 2017 to its database.[1] Perhaps there are a million other publications that do not make the grade for indexing. Of this enormous number, how many were able to contribute to our knowledge is anybody’s guess but perhaps not more than 1% of these get the attention, while the others vanish into oblivion. If that is true, a lot of efforts and resources are going wasted. In the opinion of Ioannidis,[2] “most” papers out of nearly 1 million from clinical trials conducted across the world so far are not useful. Nearly 85% of billions of dollars spent each year on medical research go waste.[3] Thus, there is a desperate need to improve the quality of medical research. This communication discusses the common pitfalls and problems with medical research and suggests ways to improve quality.
This article starts with an explanation of the concept of medical research because the problem starts with inadequate understanding of what research is all about. The article subsequently discusses the ingredients of quality of research and provides advice on good reporting as an important constituent of quality.
#
What Is Medical Research?
Research is trying to discover new facts, enunciate new principles, or provide a new interpretation of the existing knowledge.[4] However, to qualify to be called valid research, the research question must have relevance to our well-being, it must contribute to the understanding of how and why of a phenomenon we come across in our life. Searching for answers to questions, such as what, when, and how much, is also a valid part of research endeavors.
Dealing with intricacies of life and well-being, the science of health and medicine has a special appetite for such inquiries. The objective of medical research should be a better understanding of how our body, mind, and soul function; why we get sick and what can be done to put the system back on the homeostatic state; how to minimize the adverse consequences; and how can we prevent such aberrations. In a nutshell, medical research is trying to find new ways to improve our health, not just physical but also mental, social, and possibly spiritual. On the ground, this is done through laboratory experiments or clinical trials for formulating or discovering new modalities, observational studies to identify and delineate new risk factors, or epidemiological surveys for assessing the current status and trends. With the gross functionalities of our body systems presently understood fairly well, the focus now needs to be on details at the micro level such as structure and function of DNA. At macro level, it can transgress into studying such minute details as the ratio of the length of two fingers for their possible association with coronary artery disease.[5]
As mentioned earlier, unsuccessful research that fails to come up with a positive finding is not waste so long as a useful hypothesis was examined with appropriate methodology. It generates lessons for us and gives the direction for future research. Miscues, such as finding that arthroscopic surgery for osteoarthritis of the knee is not better than placebo,[6] is also not a waste as they add to our knowledge. Wasteful research has one or more of the following ingredients:
-
Irrelevant questions that do not need an answer or whose answers are already known.
-
Unclear research question and tardy objectives that cannot be directly measured.
-
Inappropriate design, such as using an observational study to assess cause–effect relationship, and studying an unrepresentative sample.
-
Inaccurate data either due to use of unstandardized instruments (questionnaire, laboratory investigations, clinical assessment, scoring system, etc.) or due to ignoring fallacies and errors, sometimes even cooked up data.
-
Superficial or wrong analysis such as using arbitrary categories of quantitative measurements, doing logistic regression where Cox’s regression should be done, or ignoring confounders.
-
Subjective or wrong interpretation of the results due to incomplete understanding or to serve a preconceived notion. Mixing of opinion with evidence-based results in reaching to a conclusion also compromises the integrity of research.
-
Insufficient or unclear reporting of either the methods or results or conclusions.
The basic ingredient of quality medical research is that it should be well intentioned and should be performed with care and sincerity it deserves, done by using an appropriate methodology, and is honestly reported. The details are given next.
#
What Is a Good-Quality Medical Research?
Quality is a subjective term that takes varying meaning with different professionals and in different situations. Yet, the quality of a medical research can be assessed using the points listed in [Table 1]. These have been briefly presented by Indrayan[4] and Ioannidis[2] but in the present communication an effort has been made to provide a much more comprehensive list in a language conducive for medical researchers of all hues from postgraduate students to university professors.
Those who have conducted research and published their findings may like to introspect and reexamine their papers in the light of these criteria and assess the quality of their research. The most important aspect that defines quality is not the result but the methodology. When a relevant question is examined with appropriate methodology, the research is likely to have a good quality irrespective of the result. However, a research that reaches to an unexpected result has wide ramifications or the one that contradicts the current understanding has much more impact than a research with a routine result. But, for this too, the methodology must be appropriate because only then the result can be believed.
#
Quality of Reporting
There may be instances where a research is performed with utmost care as provided in the rule books[7] but it fails to be noticed because of sloppy presentation. This is not just language deficiency but some of us are not able to prepare a draft in a manner that can make an impression.
Much of how a manuscript should be prepared should be clear from the details provided in [Table 1]. Excellent texts such as by Indrayan[4] and Ray et al[7] are available that can help. In brief, the manuscript should contain the following:
-
Convince the reader that the research question is such that its answer will help improve health in one way or the other. A novel question attracts widespread attention. The statement of research question should be unambiguous and accompanied by a full justification of the choice of topic with citation of the literature pointing to the lacunae. The lacuna could be in terms of conflicting or inconsistent reports or near complete absence of the kind of thinking now is being explored.
-
Crucial for the credibility of the results is the methodology. This should be described in detail so that nothing is left to the imagination of the reader or reviewer. Convince yourself and the reader that you have used appropriate tools to obtain correct data. The method of analysis should be focused on the stated objectives. The methodology should be stated in a manner that anybody with sufficient resources can replicate.
-
State the result with complete clarity and all the results should be supported by the evidence collected during the study. Make sure that the results are reproducible. A recent BMJ Open Science blog[8] gives details of how reproducibility has become an overriding consideration. For this, demonstrate reliability and validity of the findings (reliability and validity are two different aspects of quality and should not be mixed). Demarcate the medical significance of the results from their statistical significance. State any coincidental findings as hypotheses and not as results of the study.
-
Discuss the findings honestly in the light of the findings of the others without leaving out inconsistent or conflicting reports. Resolve such conflicts by providing holistic arguments. Do not gloss over the errors and limitations but, instead, state them frankly that will increase the credibility of the paper.
-
Make a distinction between results and conclusions. Results are what your data say whereas the conclusion is based on the results plus other evidence available in the literature and a plausible biological explanation of the results. Results tend to give too much importance to the statistical p-values, sometimes even ignoring the multiple p-values that compromise statistical significance. There is a great discussion going on these days regarding the validity of the results based exclusively on p-values.[9]
#
Conclusion
Medical research is on cross-roads and is being intensively scrutinized for validity and reproducibility. Errors and fallacies are common that can jeopardize the health of a large number of people when such results are applied to millions.[10] Sloppy research is wastage of resources.
Researchers have the responsibility to produce research of high quality that can be believed and can be applied to improve health. This can be done by following the advice provided in this communication.
#
#
Conflict of Interest
None declared.
-
References
- 1 Medline. Detailed Indexing Statistics: 1965–2017. Available at: https://www.nlm.nih.gov/bsd/index_stats_comp.html. Accessed April 6, 2020
- 2 Ioannidis JP. Why most clinical research is not useful. PLoS Med 2016; 13 (06) e1002049
- 3 Macleod MR, Michie S, Roberts I. et al Biomedical research: increasing value, reducing waste. Lancet 2014; 383 (9912) 101-104
- 4 Indrayan A. Research Methods for Medical Graduates. Boca Raton, FL: CRC Press; 2019
- 5 Wu XL, Yang DY, Chai WH. et al. The ratio of second to fourth digit length (2D:4D) and coronary artery disease in a Han Chinese population. Int J Med Sci 2013; 10 (11) 1584-1588
- 6 Moseley JB, O’Malley K, Petersen NJ. et al. A controlled trial of arthroscopic surgery for osteoarthritis of the knee. N Engl J Med 2002; 347 (02) 81-88
- 7 Ray S, Fitzpatrick S, Golubic R, Fisher S. Eds. Oxford Handbook of Clinical and Healthcare Research. Oxford, United Kingdom: Oxford University Press; 2016
- 8 Amaral OB. Can we predict the reproducibility of biomedical studies? BMJ Open Science 2020 (Blog). Available at: https://blogs.bmj.com/openscience/2020/01/22/can-we-predict-the-reproducibility-of-biomedical-studies/. Accessed April 6, 2020
- 9 Wasserstein RL, Schirm AL, Lazar NA. Moving to a world beyond “p< 0.05”. Am Stat 2019; 73 (51) 1-19
- 10 Indrayan A. Statistical fallacies & errors can also jeopardize life & health of many. Indian J Med Res 2018; 148 (06) 677-679
Address for correspondence
Publication History
Article published online:
27 April 2020
© .
Thieme Medical and Scientific Publishers Private Ltd.
A-12, Second Floor, Sector -2, NOIDA -201301, India
-
References
- 1 Medline. Detailed Indexing Statistics: 1965–2017. Available at: https://www.nlm.nih.gov/bsd/index_stats_comp.html. Accessed April 6, 2020
- 2 Ioannidis JP. Why most clinical research is not useful. PLoS Med 2016; 13 (06) e1002049
- 3 Macleod MR, Michie S, Roberts I. et al Biomedical research: increasing value, reducing waste. Lancet 2014; 383 (9912) 101-104
- 4 Indrayan A. Research Methods for Medical Graduates. Boca Raton, FL: CRC Press; 2019
- 5 Wu XL, Yang DY, Chai WH. et al. The ratio of second to fourth digit length (2D:4D) and coronary artery disease in a Han Chinese population. Int J Med Sci 2013; 10 (11) 1584-1588
- 6 Moseley JB, O’Malley K, Petersen NJ. et al. A controlled trial of arthroscopic surgery for osteoarthritis of the knee. N Engl J Med 2002; 347 (02) 81-88
- 7 Ray S, Fitzpatrick S, Golubic R, Fisher S. Eds. Oxford Handbook of Clinical and Healthcare Research. Oxford, United Kingdom: Oxford University Press; 2016
- 8 Amaral OB. Can we predict the reproducibility of biomedical studies? BMJ Open Science 2020 (Blog). Available at: https://blogs.bmj.com/openscience/2020/01/22/can-we-predict-the-reproducibility-of-biomedical-studies/. Accessed April 6, 2020
- 9 Wasserstein RL, Schirm AL, Lazar NA. Moving to a world beyond “p< 0.05”. Am Stat 2019; 73 (51) 1-19
- 10 Indrayan A. Statistical fallacies & errors can also jeopardize life & health of many. Indian J Med Res 2018; 148 (06) 677-679