Data Collection Methods in Health Services Research

Summary

Background: Hospital length of stay and discharge destination are important outcome measures in evaluating effectiveness and efficiency of health services. Although hospital administrative data are readily used as a data collection source in health services research, no research has assessed this data collection method against other commonly used methods.

Objective: Determine if administrative data from electronic patient management programs are an effective data collection method for key hospital outcome measures when compared with alternative hospital data collection methods.

Method: Prospective observational study comparing the completeness of data capture and level of agreement between three data collection methods; manual data collection from ward-based sources, administrative data from an electronic patient management program (i.PM), and inpatient medical record review (gold standard) for hospital length of stay and discharge destination. Results: Manual data collection from ward-based sources captured only 376 (69%) of the 542 in-patient episodes captured from the hospital administrative electronic patient management program. Administrative data from the electronic patient management program had the highest levels of agreement with inpatient medical record review for both length of stay (93.4%) and discharge destination (91%) data.

Conclusion: This is the first paper to demonstrate differences between data collection methods for hospital length of stay and discharge destination. Administrative data from an electronic patient management program showed the highest level of completeness of capture and level of agreement with the gold standard of inpatient medical record review for both length of stay and discharge destination, and therefore may be an acceptable data collection method for these measures.

Citation: Sarkies MN, Bowles K-A, Skinner EH, Mitchell D, Haas R, Ho M, Salter K, May K, Markham D, O’Brien L, Plumb S, Haines T.P. Data collection methods in health services research – hospital length of stay and discharge destination. Appl Clin Inf 2015; 6: 96–109

http://dx.doi.org/10.4338/ACI-2014-10-RA-0097

Keywords

Data collection - health services research - length of stay - discharge destination - research methodology

• References

• 1 Morgan M, Beech R. Variations in lengths of stay and rates of day case surgery: implications for the efficiency of surgical management. Journal of Epidemiology and Community Health 1990; 44 (02) 90-105.
• 2 Shojania KG, Showstack J, Wachter RM. Assessing Hospital Quality: A Review for Clinicians. Effective Clinical Practice 2001; 4 (02) 82-90.
• 3 Brasel KJ, Lim HJ, Nirula R, Weigelt JA. Length of stay: an appropriate quality measure?. Archives of Surgery 2007; 142 (05) 461-466.
• 4 Faulkner MP, Walsh J, Filby D, Reid M, Stokes B, Torzillo P, Jackson C. National Health Performance Authority Hospital Performance: Length of stay in public hospitals in 2011–2012. 2013; Nov: 1-56.
• 5 Maresh M, Dawson AM, Beard RW. Assessment of an on line computerized perinatal data collection and information system. British Journal of Obstetrics and Gynecology 1986; 93 (12) 1239-1245.
• 6 Ricketts D, Newey M, Patterson M, Hitchin D, Fowler S. Markers of data quality in computer audit: the Manchester Orthopaedic Database. Annals of the Royal College of Surgeons of England 1993; 75 (06) 393-396.
• 7 Wilton R, Pennisi AJ. Evaluating the accuracy of transcribed computer-stored immunization data. Pediatrics 1994; 94 (06) 902-906.
• 8 Hogan WR, Wagner MM. Accuracy of data in computer-based patient records. Journal of the American Medical Informatics Association 1997; 4 (05) 342-355.
• 9 Tirschwell DL, Longstreth WT. Validating administrative data in stroke research. Stroke 2002; 33 (10) 2465-2470.
• 10 Michel P, Quenon JL, de Saraaqueta AM. Scemama.. Comparison of three methods for estimating rates of adverse events and rates of preventable adverse events in acute care hospitals. British Medical Journal 2004; 328 7433 199.
• 11 Bullano MF, Kamat S, Willey VJ, Barlas S, Watson DJ, Brenneman SK. Agreement between administrative claims and the medical record in identifying patients with a diagnosis of hypertension. Medical care 2006; 44 (05) 486-490.
• 12 Zhan C, Miller M. Administrative data based patient safety research: a critical review. Quality and Safety in Health Care 2003; 12 (Suppl. 02) ii58-ii63.
• 13 Wennberg J, Gittelsohn A. Small Area Variations in Health Care Delivery A population-based health information system can guide planning and regulatory decision-making. Science. American Association for the Advancement of Science 1973; 182 4117 1102-1108.
• 14 Roos Jr LL, Roos NP, Cageorge SM, Nicol JP. How Good Are the Data?: Reliability of One Health Care Data Bank. Medical Care 1982; 20 (03) 266-276.
• 15 May DS, Kelly JJ, Mendlein JM, Garbe PL. Surveillance of major causes of hospitalization among the elderly, 1988. MMWR. CDC surveillance summaries: Morbidity and mortality weekly report. CDC surveillance summaries/Centers for Disease Control 1991; 40 (01) 7-21.
• 16 Rosenthal GE, Harper DL, Quinn LM, Cooper GS. Severity-adjusted mortality and length of stay in teaching and nonteaching hospitals: results of a regional study. Journal of the American Medical Association 1997; 278 (06) 485-490.
• 17 Bernstein CN, Blanchard JF, Rawsthorne P, Wajda A. Epidemiology of Crohn’s disease and ulcerative colitis in a central Canadian province: a population-based study. American journal of epidemiology 1999; 149 (10) 916-924.
• 18 Asch SM, Sloss EM, Hogan C, Brook RH, Kravitz RL. Measuring underuse of necessary care among elderly Medicare beneficiaries using inpatient and outpatient claims. Journal of the American Medical Association 2000; 284 (18) 2325-2333.
• 19 Goff Jr DC, Pandey DK, Chan FA, Ortiz C, Nichaman MZ. Congestive heart failure in the United States: is there more than meets the I (CD code)? The Corpus Christi Heart Project. Archives of internal medicine 2000; 160 (02) 197-202.
• 20 Magid DJ, Calonge BN, Rumsfeld JS, Canto JG, Frederick PD, Every NR, Barron HV. National Registry of Myocardial Infarction 2 and 3 Investigators.. Relation between hospital primary angioplasty volume and mortality for patients with acute MI treated with primary angioplasty vs thrombolytic therapy. Journal of the American Medical Association 2000; 284 (24) 3131-3138.
• 21 Schrag D, Cramer LD, Bach PB, Cohen AM, Warren JL, Begg CB. Influence of hospital procedure volume on outcomes following surgery for colon cancer. Journal of the American Medical Association 2000; 284 (23) 3028-3035.
• 22 Virnig BA, McBean M. Administrative data for public health surveillance and planning. Annual review of public health 2001; 22 (01) 213-230.
• 23 Hamilton WT, Round AP, Sharp D, Peters TJ. The quality of record keeping in primary care: a comparison of computerised, paper and hybrid systems. British Journal of General Practice 2003; 53 (497) 929-933.
• 24 Haines T, Skinner E, Mitchell D, O’Brien L, Bowles K, Markham D, Plumb S, Chui T, May K, Haas R, Lescai D, Philip K, McDermott F. Application of a novel disinvestment research design to the use of weekend allied health services on acute medical and surgical wards-randomised trial and economic evaluation protocol. BMC Health Services Research 2014; 14 (Suppl. 02) 53.
• 25 isofthealth.com Australia: Computer Sciences Corporation Patient Management (i. PM and webPAS), Inc Copyright 2014 [cited 2014 Aug 15]. Available from: http://www.isofthealth.com/en-AU/Products/Hospital/Patient%20Management.aspx.
• 26 Feather H, Morgan N. Risk management: role of the medical record department. Topics in health record management 1991; 12 (02) 40-48.
• 27 Fortinsky R, Gutman JD. A two-phase study of the reliability of computerized morbidity data. The Journal of family practice 1981; 13 (02) 229-235.
• 28 Krippendorff K. Reliability in content analysis. Human Communication Research 2004; 30 (03) 411-433.
• 29 Andrews LB, Stocking C, Krizek T, Gottlieb L, Krizek C, Vargish T, Siegler M. An alternative strategy for studying adverse events in medical care. The Lancet 1997; 349 9048 309-313.
• 30 Hill AM, Hoffmann T, Hill K, Oliver D, Beer C, McPhail S, Brauner S, Haines TP. Measuring falls events in acute hospitals—a comparison of three reporting methods to identify missing data in the hospital reporting system. Journal of the American Geriatrics Society 2010; 58 (07) 1347-1352.
• 31 Gerber T, Olazabal V, Brown K, Pablos-Mendez A. An agenda for action on global e-health. Health Affairs 2010; 29 (02) 233-236.
• 32 Schweitzer J, Synowiec C. The economics of eHealth and mHealth. Journal of health communication 2012; 17 (Suppl. 01) 73-81.
• 33 safetyandquality.gov.au Sydney: Australian Commission on Safety and Quality in Health Care, (cited 2014 Aug 11). Available from: http://www.safetyandquality.gov.au/our-work/clinical-communications/clinical-handover