International Comparison of Six Basic eHealth Indicators Across 14 Countries: An eHealth Benchmarking Study

Elske Ammenwerth; Georg Duftschmid; Zaid Al-Hamdan; Hala Bawadi; Ngai T. Cheung; Kyung-Hee Cho; Guillermo Goldfarb; Kemal H. Gülkesen; Nissim Harel; Michio Kimura; Önder Kırca; Hiroshi Kondoh; Sabine Koch; Hadas Lewy; Dara Mize; Sari Palojoki; Hyeoun-Ae Park; Christopher Pearce; Fernan G. B. de Quirós; Kaija Saranto; Christoph Seidel; Vivian Vimarlund; Martin C. Were; Johanna Westbrook; Chung P. Wong; Reinhold Haux; Christoph U. Lehmann

doi:10.1055/s-0040-1715796

Methods of Information in Medicine, Inhaltsverzeichnis

CC BY-NC-ND 4.0 · Methods Inf Med 2020; 59(S 02): e46-e63
DOI: 10.1055/s-0040-1715796

Original Article

International Comparison of Six Basic eHealth Indicators Across 14 Countries: An eHealth Benchmarking Study

Elske Ammenwerth

¹Institute of Medical Informatics, University for Health Sciences, Medical Informatics and Technology (UMIT), Hall in Tirol, Austria

,

Georg Duftschmid

²Section for Medical Information Management, Medical University of Vienna, Vienna, Austria

,

Zaid Al-Hamdan

³Faculty of Nursing/WHO Collaborating Center, Jordan University of Science and Technology, Irbid, Jordan

,

Hala Bawadi

⁴Maternal and Child Health Nursing Department, The University of Jordan, Amman, Jordan

,

Ngai T. Cheung

⁵Hospital Authority, Hong Kong

,

Kyung-Hee Cho

⁶Seoul National University, Korea

,

Guillermo Goldfarb

⁷Medical Informatics, Hospital de Niños Ricardo Gutiérrez, Ciudad Autónoma de Buenos Aires, Buenos Aires, Argentina

,

Kemal H. Gülkesen

⁸Department of Biostatistics and Medical Informatics, Medical Faculty, Akdeniz University, Antalya, Turkey

,

Nissim Harel

⁹Department of Computer Science, Holon Institute of Technology, Holon, Israel

,

Michio Kimura

¹⁰Medical Informatics Department, School of Medicine, Hamamatsu University, Shizuoka, Japan

,

Önder Kırca

¹¹Department of Clinical Oncology, Memorial and Medstar Oncology Center, Antalya, Turkey

,

Hiroshi Kondoh

¹²Department of Medical Informatics, Tottori University Hospital, Yonago, Japan

,

Sabine Koch

¹³Department of Learning, Informatics, Management and Ethics, Health Informatics Centre, KarolinskaInstitutet, Stockholm, Sweden

,

Hadas Lewy

¹⁴Digital Health Ventures, Holon Institute of Technology, Holon, Israel

,

Dara Mize

¹⁵Department of Biomedical Informatics, Vanderbilt University, Nashville, Tennessee, United States

,

Sari Palojoki

¹⁶Department of Health and Social Management, University of Eastern Finland, Kuopio, Finland

,

Hyeoun-Ae Park

¹⁷College of Nursing, Seoul National University, Seoul, South Korea

,

Christopher Pearce

¹⁸Director of Research, Outcome Health, Blackburn, Australia

,

Fernan G. B. de Quirós

¹⁹Department of Health Informatics, Hospital Italiano de Buenos Aires, Buenos Aires, Argentina

,

Kaija Saranto

²⁰Department of Health and Social Management, University of Eastern Finland, Kuopio, Finland

,

Christoph Seidel

²¹Division of eHealth, Digitalisation and Social Health Economy, Lower Saxony Ministry for Social Affairs, Health and Equal Opportunities, Hannover, Germany

,

Vivian Vimarlund

²²Department of Computer and Information Science, Linköping University, Linköping, Sweden

,

Martin C. Were

²³Vanderbilt University Medical Center, Nashville, Tennessee, United States

,

Johanna Westbrook

²⁴Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Faculty of Medicine and Health Sciences, Macquarie University, Macquarie, Australia

,

Chung P. Wong

²⁵Hong Kong Society of Medical Informatics, Hong Kong

,

Reinhold Haux^*

²⁶Peter L. Reichertz Institute for Medical Informatics, TU Braunschweig and Hannover Medical School, Braunschweig, Germany

,

Christoph U. Lehmann^*

²⁷Clinical Informatics Center, Department of Pediatrics, Bioinformatics, and Population and Data Sciences, University of Texas Southwestern, Dallas, Texas, United States

› Institutsangaben

Abstract

Volltext

als PDF herunterladen

Keywords

health information exchange - health information systems - continuity of patient care - patient-centered care - eHealth - international health

Introduction

Modern health care strongly depends on the availability of health-related information. Information and communication systems, which form the technical foundation of eHealth, are thus increasingly introduced in health care institutions worldwide.

The aim of eHealth is to increase the quality and efficiency of care, reduce costs for clinical services, reduce administrative costs of the health care system, and enable new models of health care delivery.[1] Evidence shows that eHealth can support the quality and efficiency of patient care.[2] [3]

In many countries, we can see a shift from institution-centered to patient-centered information processing. This means that the fragmented pieces of a patient's health data distributed in isolated silos throughout the different institutions involved in his/her care are now consolidated within a common patient record, which integrates data across the boundaries of health care institutions.[4] eHealth, which is understood as “a commitment for networked, global thinking, to improve health care locally, regionally, and worldwide,”[5] facilitates this shift.

Countries show different progress using eHealth to support information exchange and patient-centered information processing. International organizations have designed and deployed eHealth indicators to explain differences between countries. For example, the Organization for Economic Cooperation and Development (OECD) has developed a guide for measuring eHealth indicators.[1] The Nordic eHealth Research Network published eHealth indicators to be used in the Nordic region.[6] [7] The European Commission publishes a report on the dissemination of eHealth functionality among general practitioners within the European Union (EU) member states in every 5 years.[8] The World Health Organization (WHO) provides statistics for several eHealth indicators in European member countries.[9] In the United States, the electronic health record (EHR) meaningful use incentive program requires participating care providers to demonstrate fulfillment of several functionality criteria as a prerequisite for receiving incentive payments.[10]

While these eHealth benchmarking approaches give important insights into eHealth adoption in different countries, they are not able to provide a clear picture of the cross-institutional availability of clinical information for clinicians and patients. Clinical information is at the core of eHealth and its availability to clinicians and patients across institutional boundaries is a precondition for patient-centered care.

In this paper, we apply six eHealth indicators and present the results of these indicators in 14 countries. We then compare our approaches to other available eHealth benchmarks.

Objectives

This study was aimed to present eHealth indicators on cross-institutional availability of major types of patient data for health care professionals and patients and their caregivers across 14 countries. “Availability of patient data” was defined as having the ability to access data and to add data to the patient record.

This study also focused to extend and to highlight changes for those seven countries that already participated in the eHealth indicator survey in 2017.[11]

Comparing our indicators and the resulting data for the examined countries with other related eHealth benchmarks was also studied.

Methods

Indicators and Survey Instrument

The survey instrument focuses on six basic eHealth indicators that cover two major aspects. First, the immediate access of health care professionals, patients, and (informal) caregivers (e.g., relatives) to patients' major relevant health data stored in EHRs. Second, the possibility of health care professionals, patients, and their caregivers to immediately add data to an EHR.

The indicators were defined and tested in a survey of six countries in 2017.[11] Details of the development of the items and the underlying motivation for selecting these items have been published.[11]

The survey contains 60 items that we aggregate to the six major eHealth indicators as presented in [Table 1].

Table 1
Six basic eHealth indicators used in the eHealth indicator survey 2017 and 2019
Abbreviations	eHealth indicator	Explanation
AH	Access of healthcare professionals to their patients' data:immediate access of physicians, nurses, and pharmacists to their patients' EHRs' major relevant data from other health care institutions where the patient received care	The 21 items assessed whether diagnoses, medication, and problems documented in one institution were available for health care professionals in other institutions.
AP	Access of patients to their data:immediate access of patients to their EHRs' major relevant data from selected health care institutions where the patient received care	The 15 items assessed whether diagnoses, medication, and problems documented by a healthcare institution were available for the patient.
AC	Access of caregivers to patients' data:immediate access of caregivers to the patients' EHRs' major relevant data from selected health care institutions where the patient received care	The 15 items assessed whether diagnoses, medication, and problems documented by a healthcare institution were available for authorized caregivers of the patient.
EH	Adding data by health care professionals:physicians, nurses, and pharmacists of selected health care institutions are able to add data immediately to the patients' EHR(s)	The seven items assessed whether health care professionals were able to electronically document patient-related data in a (local or shared) EHR system.
EP	Adding data by patients:patients are able to add data immediately to their EHR(s)	The item assessed whether the patient is able to add data in electronic form to a (local or shared) EHR system to make them available to health care professionals and themselves.
EC	Adding data by caregivers:caregivers are able to add data immediately to the patients' EHR(s) in a respective country	The item assessed whether the patient's caregivers are able to add data in electronic form to a (local or shared) EHR system to make it available to health care professionals and themselves.

Abbreviations: AC, access of caregivers to the patients' health record data; AH, access of healthcare professionals to their patients' data; AP, access of patients to their health record data; EC, enabling caregivers to add data to the patients' health record(s); EH, adding data by health care professional(s); EHR, electronic health record; EP, enabling patients to add data to their health record(s).

Note: The explicit scope of all questions was the experts' respective country.

Please note that throughout the survey, we chose the following naming conventions:

EHR: to accommodate for various interpretations of this term in the participating countries, we defined EHR as “any patient-centered electronic collection of clinical data or documents generated as a by-product of patient care.” According to ISO 20514 (ISO: International Organization for Standardization), an EHR may be managed by local (institutional) EHR systems, as well as by shared (i.e., transinstitutional, regional, or national) EHR systems.
Health care institution: a health care institution provides inpatient and/or outpatient care for a patient. We focused on selected health care institutions expected to exist in most participating countries. These institutions include hospitals, medical offices (e.g., physicians in private practice or with health maintenance organization [HMO]), contract(physicians in an ambulatory clinic), nursing homes (institutions for long-term nursing care of elderly or chronically ill patients), outpatient nursing organizations (providing ambulatory nursing care at the patient's home), and pharmacies.
Major relevant data: EHRs contain a large variety of data elements. We focused on major data elements considered central for patient care, namely, diagnoses, medication, and problems (e.g., allergies).
Immediate access and immediate adding of data: accessing and adding data are seen as “immediate” if they are available through electronic means and without the need for special requests; paper-based information processing cannot provide this.
Caregivers: persons informally taking care of patients such as family members or parents (for their children).

Organization of the Survey

Two experts from each of the following countries were invited to provide the indicator data for their country: Argentina, Australia, Austria, Finland, Germany, Hong Kong, Israel, Japan, Jordan, Kenya, South Korea, Sweden, Turkey, and the United States.

The rationale behind the selection of the 14 countries was as follows: Seven countries (Austria, Finland, Germany, Hong Kong, South Korea, Sweden, and the United States) already participated in the eHealth indicator survey 2017 and were thus chosen to allow an analysis of an eventual progress made. The remaining seven countries were chosen according to our goal to include representative countries from the remaining three continents (we did not consider Antarctica) and including a broad spectrum of different health care systems and various levels of eHealth adoption. The selection of the experts from each country was based on their known scientific activity in national eHealth projects.

As eHealth activities are advancing in many of these countries, all responses had to reflect the situation in the respective country on August 1, 2019 as date of reference.

The two experts in each participating country were asked to complete the survey, to solve any discrepancies through discussion, and to submit a consensus version. For each item, available answering options were as follows:

“−”: not given, meaning that the respective indicator item is not fulfilled or only fulfilled in a clear minority of institutions, health care professionals, or patients (<20%).
“+”: partly given, meaning that the respective indicator item is fulfilled in some (but not all) institutions, health care professionals, or patients.
“++”: given, meaning that the respective indicator item is fulfilled in the large majority of institutions, health care professionals, or patients.
N/A: not applicable.

The experts were also asked to provide short descriptions for all “partly given” answers and where they saw the need to provide additional context. E.A. and R.H. carefully reviewed and discussed all answers, contacted the experts in the event of clarification needed, and documented revised answers accordingly.

All authors explicitly released the final version of their respective survey results. Complying with rules for good scientific practice, all final questionnaires are available from the corresponding author.

Calculation of Indicators

[Table 2] summarizes the formulas for the 2019 survey. Based on the 60 items, we calculated the six eHealth indicators for each country using mainly the published formulas and motivations for the 2017 survey[11] with the following two clarifications:

Indicator AH (access of healthcare professionals to their patients' data): for pharmacies to achieve an overall “+,” it is now sufficient if they have at least access (i.e., “+”) to medication data. Rationale: in many countries, there is no plan for pharmacies to have access to diagnoses and problems at all. Thus, grading pharmacies as “−” that have access to medication data, but not to diagnoses and problems, does not seem fair. Therefore, we changed this calculation in the 2019 survey. The changed wording is highlighted in [Table 2].
Indicator EH (enabling health care professionals to add data to their patients' health record[s]; adding data by health care professionals): we now award an overall “+” if three or more outcome values were at least “+” and one or more outcome value was “N/A.” Rationale: In one country (Jordan), not all listed types of health care institutions exist independently, thus “N/A” is a valid answer and calculating it as “−” as in the 2017 survey did not seem adequate. The changed wording is highlighted in [Table 2].

Table 2
Indicator definition of the six eHealth indicator survey 2019. Outcome values can be given (++, green), partially given (+, yellow) or not given (−, red)
No.	Abbreviation	Indicator calculation
1	AH	Calculation of this eHealth indicator is based on 3 × 7 = 21 outcome values:access to (1) diagnoses, (2) medication, and (3) problemsfrom hospitals (by (1) physicians, (2) nurses, (3) pharmacists), from (4) medical offices (by physicians), from (5) nursing homes (by nurses), from (6) outpatient nursing organizations (by nurses), and from (7)pharmacies (by pharmacists). Outcome values on access to diagnoses, medication, and problems from each health care institution by the selected health care professionals were defined as follows: a) Access is ++ if all three outcome values for diagnoses, medication, and problems are ++ or if two are ++ and one is +. b) Access is + if one outcome value is ++ and two are + or if all three outcome values are +; exception: for pharmacies, a + was given if the outcome value for medication is at least +. c) Access is − in all other cases. Based on the then remaining sevenvalues this eHealth indicator was calculated in the sequence: 1) Indicator is ++ if ≥ 4 outcome values are ++. 2) Indicator is + if ≥ 2 outcome values are ++ or ≥ 3 values are ++ or +. 3) Indicator is − in all other cases.
2, 3	AP, AC	Calculation of these eHealth indicators is based on 3 × 5 = 15 outcome values: Access to (1) diagnoses, (2) medication, and (3) problemsfrom (1) hospitals, (2) medical offices, (3) nursing homes, (4) outpatient nursing organizations, and (5) pharmacies. For the values of diagnoses, medication, and problems for each selected health care institution we used the same definition of values as for indicator AH_r. Based on the remaining five values this eHealth indicator was calculated in the sequence: 1) Indicator is ++ if ≥ 3 outcome values are ++ and ≤ 2 outcome values are -. 2) Indicator is + if ≥ 2 outcome values are ++ or + 3) Indicator is − in all other cases.
4	EH	This eHealth indicator is based on seven outcome values, adding data in hospitals (by (1) physicians, (2) nurses, (3) pharmacists), in (4) medical offices (by physicians), in (5) nursing homes (by nurses), in (6) outpatient nursing organizations (by nurses), and in (7) pharmacies (by pharmacists). It was calculated in the sequence: 1) Indicator is ++ if ≥ 4 outcome values are ++. 2) Indicator is + if ≥ 2 outcome values are ++ or ≥ 4 outcome values are at least +or ≥ 3 outcome values are at least + and ≥ 1 outcome value is N/A. 3) Indicator is − in all other cases.
5, 6	EP, EC	The outcome value itself served as the eHealth indicator. No calculation was necessary.

Abbreviations: AC, access of caregivers to the patients' health record data; AH, access of healthcare professionals to their patients' data; AP, access of patients to their health record data; EC, enabling caregivers to add data to the patients' health record(s); EH, adding data by health care professional(s); EP, enabling patients to add data to their health record(s).

Notes: Indicator definitions are taken from the eHealth indicator survey 2017 (p. 708), with two clarifications (underlined; see main text for explanation).

Additional value not applicable is visualized as N/A and in black.

Results

We received responses from all invited countries. With the exception of Kenya, for all countries, at least two experts provided consensus data.

[Table 3] presents the outcome for the eHealth indicator AH, as well as changes compared to the 2017 survey. Survey responders added additional explanations that are summarized in [Appendix 1].

Table 3
Outcome for eHealth indicator AH as of August 1, 2019, for Argentina (RA), Australia (AUS), Austria (A), Finland (FIN), Germany (D), Hong Kong (HK), Israel (IL), Japan (J), Jordan (JOR), Kenya (EAK), South Korea (ROK), Sweden (S), Turkey (TR), and the United States (USA)
Can selected health care professionals from selected health care institutions immediately access relevant patient data from other institutions?		Countries
Selectedhealth care institutions	Selected groups ofhealth careprofessionals	A	AUS	D	EAK	FIN	HK	IL	J	JOR	RA	ROK	S	TR	USA
Hospitals	Physicians	→+	+	→−	−	→++	+	++	+	−	+	→++	++	→+
	Nurses	→+	+	→−	−	→++	+	++	+	−	+	→++	+	→+
	Pharmacists	+	+	→−	−	→++	+	++	+	−	+	→+	++	→+
Medical offices	Physicians	+	+	→−	−	→++	++	+	−	+	→++	+	→+
Nursing homes	Nurses	→−	−	→−	−	→++	+	++	N/A	−	→−	→+	+	→−
Outpatient nursing org.	Nurses	→−	+	→−	−	→++	++	N/A	−	→−	++	+	→−
Pharmacies	Pharmacists	+	+	→−	−	→+	→-	+	−	→−	→+	++	→+
Indicator 1 AH		→+	+	→−	−	→++	+	++	+	−	+	++	+	→+

Abbreviation: AH, access of healthcare professionals to their patients' data.

Note: For those countries, who participated also in the 2017 survey: → same indicator as 2017, indicator changed from − to + or from + to ++. N/A = not applicable. Survey responders added additional explanations that are summarized in [Appendix 1].

Overall, four countries (Finland, Hong Kong, Japan, and Sweden) received a “++” in this indicator. Compared to the 2017 survey, Austria, South Korea, and Sweden improved in some items and South Korea, as well as Sweden, also improved their overall indictor AH.

[Table 4] presents the outcome for eHealth indicator AP(access of patients to their health record data) and eHealth indicator AC (access of caregivers to the patients' health record data), as well as changes compared to the 2017 survey. Survey responders added additional explanations that are summarized in [Appendix 2].

Table 4
Outcome for eHealth indicators AP and AC as of August 1, 2019, for Argentina (RA), Australia (AUS), Austria (A), Finland (FIN), Germany (D), Hong Kong (HK), Israel (IL), Japan (J), Jordan (JOR), Kenya (EAK), South Korea (ROK), Sweden (S), Turkey (TR), and the United States (USA)
Can the patient and patient's caregivers access major patient data from selected health care institutions?	Country
Selected health care institutions	A	AUS	D	EAK	FIN	HK	IL	J	JOR	RA	ROK	S^a	TR	USA
Hospitals	++	+	→−	−	→++	→−	−	→++	++	++	→+
Medical offices	→−	+	→−	−	→++	→−	−	→++	++	+	→+
Nursing homes	→−	−	→−	−	→++	→−	−	→++	→−	−	→−
Outpatient nursing organizations	→−	−	→−	−	→++	→−	−	→++	→−	+	→−
Pharmacies	+	+	→−	−	→++	→−	−	→+	−	→−
Indicators 2 AP_r and 3 AC_r	+	+	→−	−	→++	→−	−	→++	→+	+	→+

Abbreviations: Abbreviations: AC, access of caregivers to the patients' health record data; AP, access of patients to their health record data.

Note: For those countries, who participated also in the 2017 survey: → same indicator as 2017, indicator changed from – to + or from + to ++. N/A = not applicable. Survey responders added additional explanations that are summarized in[Appendix 1].

^a In Sweden, access of patients and access of caregivers differ. The entry in the table is with respect to patients. For caregivers in Sweden, all entries are “−” indicator AC decreases to “−”.

Overall, two countries (Finland and South Korea) received a “++” in these indicators. Compared to the 2017 survey, only Austria and Sweden improved some items. In the case of Austria, this led to an improvement of the overall indicators AP and AC.

[Table 5] presents the outcome for the eHealth indicator EH, as well as changes compared to the 2017 survey. Survey responders added additional explanations that are summarized in [Appendix 3].

Table 5
Outcome for eHealth indicator EH as of August 1, 2019, for Argentina (RA), Australia (AUS), Austria (A), Finland (FIN), Germany (D), Hong Kong (HK), Israel (IL), Japan (J), Jordan (JOR), Kenya (EAK), South Korea (ROK), Sweden (S), Turkey (TR), and the United States of America (USA)
Can selected health care professionals from selected health care institutions add relevant patient data to a (local or shared) electronic health record?		Country
Selected health care institutions	Selected groups of health care professionals	A	AUS	D	EAK	FIN	HK	IL	J	JOR	RA	ROK	S	TR	USA
Hospitals	Physicians	→++	++	→++	+	→++	++	+	→++	→++	++	→++
	Nurses	→++	++	→++	+	→++	+	++	+	→++	→++	++	→++
	Pharmacists	→−	++	→+	+	→++	+	−	++	−	+	→−	→−	++	→++
Medical offices	Physicians	→++	++	→++	+	→++	++	+	→++	→++	+	→++
Nursing homes	Nurses	+	+	→-	+	→++	→−	++	N/A	−	→++	→++	−	→+
Outpatient nursing org.	Nurses	→−	+	→−	+	→++	+	−	++	N/A	−	→++	→++	+	→+
Pharmacies	Pharmacists	+	+	→+	−	→+	→−	−	→−	→−	−	→++
Indicator 4 EH_r		→+	++	→+	+	→++	→+	++	+	→++	→++	+	→++

Abbreviation: EH_r, adding data by health care professional(s).

Note: For those countries, who participated also in the 2017 survey: → same indicator as 2017, indicator changed from − to + or from + to ++. N/A = not applicable. Survey responders added additional explanations that are summarized in [Appendix 1].

Overall, seven countries (Australia, Finland, Israel, Japan, South Korea, Sweden, and the United States) received a “++” in this indicator. Compared to the 2017 survey, Austria and Hong Kong improved some items but without effect on the overall indicator.

[Table 6] presents the outcome for eHealth indicators EP (enabling patients to add data to their health record[s]) and EC(enabling caregivers to add data to the patients' health record[s]), as well as changes compared to the 2017 survey. Survey responders added additional explanations that are summarized in [Appendix 4].

Table 6
Outcome for eHealth indicators EP and EC as of August 1^st, 2019, for Argentina (RA), Australia (AUS), Austria (A), Finland (FIN), Germany (D), Hong Kong (HK), Israel (IL), Japan (J), Jordan (JOR), Kenya (EAK), South Korea (ROK), Sweden (S), Turkey (TR), and the United States (USA)
Indicator				c	o	u	n	t	y
No.	Abbreviation	Name	A	AUS	D	EAK	FIN	HK	IL	J	JOR	RA	ROK	S[a]	TR[b]	USA
5	EP	Enabling patients to add data to their health record(s).	→−	+	→−	−	→+	→−	−	+	→−	→+	++	→+
6	EC	Enabling caregivers to add data to the patients' health record(s).	→−	+	→−	−	→+	→−	−	+	→−	→+	++	→+

Abbreviations: EC, enabling caregivers to add data to the patients' health record(s); EP, enabling patients to add data to their health record(s).

Note: For those countries, who participated also in the 2017 survey: → same indicator as 2017, indicator changed from – to + or from + to ++. Survey responders added additional explanations that are summarized in [Appendix 1].

^a In Sweden, enabling of patients and of caregivers to add data differ. The entry in the table is with respect to patients. For caregivers in Sweden, the entry is “−.” Indicator EC thus decreases to “−.”

^b In Turkey, enabling of patients and of caregivers to add data differ. The entry in the table is with respect to patients. For caregivers in Turkey, the entry is “+.”

Overall, only Turkey received a “++” in this indicator. Compared to the 2017 survey, no country showed an improved indicator.

[Table 7] summarizes the six eHealth indicators for all countries. No country received a “++” for all indicators. Finland received a “++” for four indicators, South Korea for three indicators, Japan and Sweden for two indicators, and Australia, Hong Kong, Israel, Turkey, and the United States for one indicator.

Table 7
Summary table for the outcomes for the six eHealth indicators as of August 1, 2019, for Argentina (RA), Australia (AUS), Austria (A), Finland (FIN), Germany (D), Hong Kong (HK), Israel (IL), Japan (J), Jordan (JOR), Kenya (EAK), South Korea (ROK), Sweden (S), Turkey (TR), and the United States (USA)
	eHealth indicator	Country
No.	Abbreviation	Name	A	AUS	D	EAK	FIN	HK	IL	J	JOR	RA	ROK	S	TR	USA
1	AH	Access of health care professionals to their patients' health record data.	→+	+	→−	−	→++	+	++	+	−	+	++	+	→+
2	AP	Access of patients to their health record data.	+	+	→−	−	→++	→−	−	→++	→+	+	→+
3	AC	Access of caregivers tothe patients' health record data.	+	+	→−	−	→++	→−	−	→++	→+	+	→+
4	EH	Enabling health care professionals to add data to their patients' health record(s).	→+	++	→+	+	→++	→+	++	+	→++	+	→++
5	EP	Enabling patients to add data to their health record(s).	→−	+	→−	−	→+	→−	−	+	→−	→+	++	→+
6	EC	Enabling caregivers to add data to the patients' health record(s).	→−	+	→−	−	→+	→−	−	+	→−	+	→+

Abbreviations: AC, access of caregivers to the patients' health record data; AH, access of healthcare professionals to their patients' data; AP, access of patients to their health record data; EC, enabling caregivers to add data to the patients' health record(s); EH, adding data by health care professional(s); EP, enabling patients to add data to their health record(s).

Note: For those countries, who participated also in the 2017 survey: → same indicator as 2017, indicator changed from − to + or from + to ++, indicator changed from ++ to + or from + to −.

Discussion

Summary of Findings

The 14 participating countries demonstrated diverse cross-institutional availability of patient-related information.

Finland, Hong Kong, Japan, and Sweden provide health care professionals from various inpatient and outpatient organizations with best access to patients' cross-institutional health record data ([Table 3]). Overall, 11 countries offer hospital staff fully or partly access to cross-institutional data, and 10 countries offer this for medical offices. In only six countries, nursing homes and outpatient nursing organizations have access to cross-institutional data. Three countries do not allow any access to any professional group.

Finland and South Korea allow patients and their caregivers the best access to their health record data ([Table 4]), five countries offer at least partial access. In all these countries, patients receive the largest amount of health record data from hospitals and from medical offices, as access to these data is fully or partly offered in seven countries. Access to data from nursing homes is only available in two countries. Three countries allow access to data from outpatient nursing organizations. Six countries do not allow patients and theiry caregivers any access to their data.

In all countries, health care professionals are partly or fully able to add patient data to a patient health record ([Table 5]). This reflects the fact that nearly all health care institutions have some sort of organizational EHR system where patient data is documented. Full support for electronic documentation is especially available in hospitals (12 countries) and medical offices (11 countries), to less extent also in nursing homes (5 countries) and outpatient nursing organizations (4 countries). Pharmacies typically only add medication data to the health record.

Only six countries allow patients and their caregivers to add data to the patient EHR, with Turkey supporting this best ([Table 6]). Eight countries do not allow patients to add any data.

Finland showed the highest fulfillment of all six analysed eHealth indicators, followed by South Korea, Japan, and Sweden ([Table 7]). No countries showed full support for all eHealth indicators, indicating opportunities for further improvement in all countries.

The WHO considers eHealth as an integral part of delivering improvements in health and sees a “substantial increase in the number and range of solutions.”[13] Our survey shows that in most of the 14 observed countries, the vision of universal access to major patient data is not yet fully reached. Nevertheless, according to the WHO, there has been a steady growth in the adoption of national EHR systems in the last years.[13] We found three countries (Argentina, Germany, and Kenya; [Table 3]) that did not allow health care professionals interorganizational access to relevant patient data from any of the selected health care institutions. We found six countries (Argentina, Germany, Hong Kong, Japan, Jordan, and Kenya; [Table 4]) that did not allow patients and their caregivers to access relevant health record data from any of the selected health care institutions.

Advancement in eHealth depends on contextual factors such as health care organization and health politics. Often cited barriers to national EHR systems are lack of funding, technical infrastructures, human resources capacity, effectiveness, and legal frameworks.[13] These barriers may hamper fast improvements in eHealth. However, countries like Finland show that strategic planning and long-term investments may result in effective eHealth. eHealth must show a positive impact on costeffectiveness[13] and on the quality of care[14] to increase the likelihood of being supported and implemented. Building such an evidencebase on the impact of eHealth seems crucial to further foster advancement in eHealth.[15]

Limitations

To increase the objectivity of the data, survey responses were based on consensus from two experts for all (but one) country. We tried to select eHealth experts for each country, but other experts may have come to other conclusions. All responses were reviewed and any implausible responses were rechecked with the experts.

Using eHealth expert surveys provided subjective results of the different indicators. Future research should be directed toward more direct measures that can provide a more objective picture by measuring completeness of information in electronic records. Other areas of future work will be to include allied health care providers, as well as professions, who support the health sector such as social workers.

Different from other surveys,[16] we did not provide quantitative ranges for “−,” “+,” and “++.” Instead, we aimed to make responding easier and accommodate for different interpretations and goals. However, not providing ranges might have led to different interpretation especially of “−” and “+.” To avoid this, we asked the experts to choose “−” if less than 20% of institutions or stakeholders in their country would have a positive indicator.

While attempting to carefully define and explain the core elements such as “EHR,” we found that some experts had difficulties to understand the scope of some questions. Based on a different understanding of the term EHR, some misunderstanding arose. We tried to accommodate this during verification of the responses through personal contact.

As a general limitation of every survey, the selection of indicators implies a certain perspective (and potential bias), with emphasis on some aspects and lack of coverage of other potentially important aspects. For example, we did not address questions such as the usefulness of EHR data for research.

Changes for Countries that Participated in the Survey of 2017

The eHealth indicator AH saw the biggest improvement between surveys with two (South Korea and Sweden) out of seven countries able to raise their overall score compared to the 2017 survey ([Table 7]). Considering that AH already showed the second highest overall scores in 2017 (“++” for two countries, “+” for three countries, and two “−”), this additional improvement seems remarkable and reflects better interoperability of electronic records. Hospital-based health care professionals made the most progress in accessing their patients' data ([Table 3]).

For eHealth indicators AP and AC, only Austria improved its overall score (from “−” to “+”). Most progress could be made in accessing data of hospitals (now “++” in Austria and Sweden, see [Table 4]).

For the other three indicators, EH, EP, and EC, none of the seven countries was able to make any visible improvements. As EH was the top scoring indicator already in 2017 (“++” for four countries and “+” for three countries), this seems less problematic than the stagnation for EP and EC. The latter indicators had low outcomes in 2017 (four “−” and three “+”), suggesting that substantial room for improvement was not exploited.

Comparisons to other eHealth Benchmarks

The OECD has developed a guide for measuring eHealth indicators. It is currently only available in a draft version.[1] The guide includes surveys to be answered by caregivers, as well as chief information officers of health institutions. The surveys address the availability of different types of electronic health information (e.g., problem lists, medication lists, and allergies) for caregivers, as well as patients, and distinguish between data-generated inside or outside the own organization. A smaller subset of seven indicators (e.g., management of electronic patient information by primary care providers, exchange of radiology images, and patient access to test results online) was used in a survey performed within 38 countries.[16] Compared to this OECD eHealth indicator survey, our survey is broader in regard to the included health care institutions by not only covering primary care providers and hospitals but also nursing homes, as these represent important contributors to patient-centered care. Comparable to the OECD survey, we also focused on problem lists, diagnoses, and allergies that we find essential for patient-centered care. The OECD survey, however, adds additional information types, such as demographics and vital signs, which makes the survey somewhat longer.

Six countries were covered both by the OECD survey[16] and our survey, and thus allowed us to compare the results. For the indicator EH, “enabling to add data,” with a focus on primary-care physicians (line 4 in [Table 5]), five of these six countries (Austria, Germany, Finland, Israel, and Sweden) scored “++” in our survey and “75 to 100%” in the OECD survey. Turkey scored “+” in our survey (with the comment that some private offices do not use EHRs) and “ > 75%” in the OECD survey. The survey results thus are congruent.

Regarding the indicator AP/AC, “access to EHR major data by patients or caregivers,” with a focus on primary care physicians (line 2 in [Table 4]), both surveys reported similarly (“++,” respectively, “maturity” for Finland and Israel and “−,” respectively, “ < 50%” for Germany). For Turkey, our survey found “+” and the OECD survey “ < 50%” that can be seen as corresponding. For Sweden, we found “++” and OECD <50%.” The reason may be the different survey dates (2016 vs. 2019) as in our surveys Sweden scored “+” in 2017 and “++” in 2019.

In 2013, the Nordic eHealth Research Network published a specification of eHealth indicators to be used in the Nordic region.[6] It is based on the OECD work and refines it in several aspects. The specification focused on three indicators for its initial test phase. These indicators address the availability of a list of currently prescribed medications to every caregiver that the patient sees, the availability and use of electronic transmission of medication prescriptions, and the availability and use of secure messaging between caregivers and patients for appointment booking. The initial set of indicators was extended to 49 indicators in 2015,[7] which address the availability and access of various types of health information (e.g., clinical notes, lab results, and medication prescriptions) by caregivers and patients. Comparable to the Nordic eHealth Research Network, our survey focusses on the availability of certain clinical information (e.g., clinical notes, lab results, and medication prescriptions). The Nordic indicator results are, however, limited to Nordic countries, while we covered countries from all over the world.

Two countries provided data in the Nordic survey[7] and were also covered in our survey, Finland and Sweden. In our survey, Finland scored “ + +” for the indicator AH, “access of health care professionals to patient data,” with regard to access from hospitals and from medical offices (lines 1–4 in [Table 3]). In the Nordic survey, Finland scored high for access to clinical notes (95%), patient summaries (85%), and prescriptions (100%) from specialized care institutions and reasonably high (78, 63, and 100%) for access to the same type of information from primary care institutions. Both survey results thus were congruent. In our survey, Sweden scored “++” for the indicator AH with regard to access from hospitals and from medical offices. In the Nordic survey, Sweden scored 100% for access to clinical notes, patient summaries, and prescriptions both from primary and specialized care institutions. These results thus were also congruent.

The European Commission publishes a report on the dissemination of eHealth functionality among general practitioners (GPs) within the EU member states in a 5-year interval.[8] This report provides an overview of the usage frequency of different types of content within the GP's EHR systems, such as laboratory test results, radiology reports, and drug-related information. In contrast to our survey, it does not focus on cross-institutional access to this data, thus we must expect that answers primarily refer to access within the GPs' local EHR systems. The survey further shows the extent of the exchange of these data with other care providers. Overall, our survey is broader, as we also cover hospitals, pharmacies, and nursing homes.

Four countries (Austria, Germany, Finland, and Sweden) were covered both by the GP survey[8] and our survey allowing comparison of the results. Regarding indicator AH, with focus on medical offices (line 4 in [Table 3]), the surveys were congruent with Austria/Finland/Sweden scoring “+”/“++”/“++” in our survey and 1.6/2.9/2.9 (out of a maximum of 4 points) for indicator “health information exchange of clinical data” in the GP survey. Germany scored 1.6 points in the GP survey and “−” in our survey. The reasons for the divergent conclusions between Germany (1.6/−) and Austria (1.6/+) in both surveys could be in the recent changes in Austria. At the moment, Austria is introducing the national EHR system ELGA (Elektronische Gesundheitsakte) leading to improvement of the indicator AH to “+” in our survey. ELGA may not have been covered by the GP survey from 2018.

The WHO provides statistics for several eHealth indicators among the European members of the WHO within its European Health Information Gateway.[9] The data originated from the WHO's global eHealth survey from 2015.[13] A separate report is available for the European region.[17] The indicators primarily focus on issues such as funding, strategies, legislation, and the existence of certain eHealth programs. These WHO indicators thus do not cover the availability of certain types of health information for certain types of caregivers or the patient as our indicators do.

In the United States, the EHR meaningful use incentive program requires participating care providers to demonstrate the satisfaction of several criteria as a prerequisite for funding.[10] Criteria focus on health information exchange and on providing patients electronic access to their health information. These criteria are more focused on available functionality and less on available Information.

While Esdar et al used an existing diffusion model to calculate the diffusion dynamics of EHRs in German and U.S. hospital care between 2007 and 2017,[18] access to different types of health information by different types of care providers was not addressed by them.

Naumann et al compared eHealth adoption in Austrian, German, and Swiss hospitals in regard to diffusion of EHRs, health information exchange, and electronic communication with patients.[19] Similar to the present work, they analyzed the availability of medical discharge letters for external care providers.

Tsai and Koch developed a framework for eHealth evaluation and monitoring in Sweden.[20] It focuses on 19 specific eHealth outcomes and provides indicators for assessing the outcomes.

Our survey provides an international perspective on the availability of basic clinical data for important stakeholders involved in patient-centered care, including patients and their caregivers. We focus on available and reproducible information and not on functionalities or technical infrastructure. In accordance with the Clinical Adoption Metamodel,[21] we see availability and usage of information systems as the precondition of information availability which is an important precondition for information logistics (“right information at the right place to the right person”[22]). Information availability thus is also the precondition to modification of clinical behaviors and clinical decisions that may, in the end, affect patient outcomes.

Conclusion

Advancement in eHealth depends on contextual factors such as health care organization, national health politics, and health financing. Improvements in eHealth are thus often slow. Our survey shows, however, that some countries were able to improve at least some indicators between 2017 and 2019. Further improvements can be expected in the future. Countries such as Finland show that strategic planning and long-term investments allowed fostering eHealth successfully in the end.

We must remember that the indicators we chose do not directly reflect the quality of health care. Quality of care may be quite high, even when eHealth indicators may (still) be low. Nevertheless, we expect that easy access to relevant patient data is an important part of high-quality patient care.

Appendices

Appendix 1
Explanations provided for the eHealth indicator AH Access of health care professionals to their patients' health record data for each country
Argentina	In 2018 the Ministry of Health in Argentina presented the National eHealth Strategy 2018-2024, defining interoperability standards based on HL7 FHIR and SNOMED CT. During 2018 and 2019 the ministry worked with all the provinces to facilitate the adoption of the eHealth strategy, and by the end of 2019 17 of the 24 provinces were connected to the National Digital Health Network, sharing identification details for more than 2 million patients. For 2020 it is expected that the private sector will start connecting to the Digital Health Network and that the first transactions of Digital Health Documents will occur, allowing to access patients' cross-institutional health record data at the national level. The adoption in the public sector is spurred by economic incentives to the provincial ministries of health, in programs cofunded by the national government and the World Bank. Each province has defined an adoption plan, that usually starts with a few selected healthcare facilities in the provincial capital, and then gradually expands to the rest of the province, managing costs for scaling in infrastructure, change management teams, etc. The current state of advance in 2020 varies greatly, with a few provinces with more than 90% coverage of EHR, and some that are just starting the process. Legacy software used for national immunization registries, communicable diseases, and other public health reports is slowly being integrated into the National Digital Health Network using new FHRI APIs. More details on the eHealth Strategy, standards, and national federated identity system are available at: https://www.argentina.gob.ar/salud/digital
Australia	Australia introduced the My Health Record system: www.myhealthrecord.gov.au, which provides elements of an individual's health care (e.g., diagnoses, medications, brief medical history, pathology results) across all types of health care organisations. The system was opt-in (i.e., Australians could choose to join the system) until 2018 when an opt-out system was introduced. The Australian population is 24.6M and approximately 10% of Australians decided to opt-out. Thus, around 90% of Australians have access to the My Health Record System to support the continuity of their care across providers. All registered health care providers are able to access a patient's My Health Record for the purposes of providing care to that individual, i.e., they can login to the My Health Record system and look up the patient's record (e.g., last discharge summary). Following a health care event (e.g., an admission to hospital, a visit to the local doctor) a summary of that event can be uploaded to the patient's My Health Record and therefore will be available for all future caregivers (unless a patient has put in place access controls to prevent or restrict access). As My Health Record is automatically updated with all medications dispensed through community pharmacies (and now radiology and pathology reports), this information will be available for providers in all organisations. All registered health providers/organisations can gain access to this system but as the system is relatively new, uptake is progressive. For example, many nursing homes have yet to start using My Health Record. Thus, our answers reflect that the My Health Record system is technically available to be accessed by registered practitioners, for patients who have elected to have a record created, however, the coverage of access by health professionals and the content of the records is gradually expanding. The amount and detail of information included in the My Health Record system is continuing to increase as more health care providers upload information. Health care professionals and health care organisations must be registered in order to gain to access the system. The My Health Record system does not replace the existing individual EHR systems in place at all the above health care organisations. The My Health Record system is a patient controlled health care record, designed to support continuity of care by increasing the sharing of information across health care organisations and providers, but it is not a comprehensive health record. A useful summary of information about the My Health Record system, as well as international comparison information is available at: https://www.digitalhealth.gov.au/home/get-started-with-digital-health/digital-health-evidence-review. Immediate access to information outside the My Health Record system requires a provider to directly contact a care provider/organisation and ask them to relay or send relevant information. Some hospital groups are able to access clinical records from other hospitals within their group. A useful summary of information about the My Health Record system, as well as international comparison information is available at: https://www.digitalhealth.gov.au/home/get-started-with-digital-health/digital-health-evidence-review. Immediate access outside the My Health Record system requires a provider to directly contact a care provider/organisation and ask them to relay or send relevant information. Some hospital groups are able to access clinical records from other hospitals within their group.
Austria	In August 2019, all hospitals, approximately 5,000 of 10,000 medical offices and approximately 1,000 of 1,400 pharmacies were connected to the nationwide Austrian EHR (ELGA;https://www.ots.at/presseaussendung/OTS_20190802_OTS0085/elga-e-medikation-im-zeitplan). Rollout of ELGA component “eMedication” started in February 2018. Medication data can be recorded by medical offices (prescriptions) and by pharmacies (dispensing). Diagnoses and problems are only accessible if documented during an inpatient hospital visits in the ELGA discharge letter. Pharmacists may only access medication data in ELGA.
Finland	Regarding pharmacies, the assessment relates to ePrescription which is compiled in the EHR.
Germany	Since October 2016, there is a law in Germany (abbreviated as eHealth-law;available at: https://www.bundesgesundheitsministerium.de/service/begriffe-von-a-z/e/e-health-gesetz.html) stating that some patients can receive a medication plan (Medikationsplan). This medication plan is still paperbased (although machine-readable through bar code). As only a selected group of patients can receive such a medication plan and as until now, as it is paper-based, the requested immediate access is hardly given, we decided to continue to enter a “−” at medication.
Hong Kong	All those ++ are only referred to those who opt-in to use the system, including doctors, nurses, pharmacists for the records of those patients who have opt-in to share their records.
Israel	In Israel, all the population has health insurance provided by four Health Maintenance Organizations (HMOs): Clalit (52.2% of the population), Maccabi (25.4% of the population), Me'uhedet (13.9% of the population), and Le'umit (8.5% of the population). For example, the HMO Clalit runs over 1,300 primary care clinics as well as a network of pharmacies and dental clinics. Hospitals: this information is available to citizens insured by Clalit and Maccabi (77.6% of the population). Infrastructure already exists to provide this information to all hospitals and is awaiting full implementation. Nursing homes: If the nursing home belongs to an HMO, then yes (++). Otherwise, no. Private elderly homes sometimes have an in-house physician. If this is the case, then the Maccabi HMO (25.4% of the population) shares relevant information with the physician. With the rest of the HMOs, the communication is done via the telephone and is dependent on the goodwill of the primary care physician. Pharmacies do not see the diagnoses. There are two types of pharmacies: private and ones that belong to the various HMOs. The ones that belong to the HMO see problems. In Clalit HMO's pharmacies, there is a system that checks whether there is a conflict in the medication prescribed and the pharmacist is alerted. In Maccabi (25.4% of the population), all pharmacies (private and owned) are alerted.
Japan	For all “problem” data, they are stored in each professional's record, but they are not compiled in one.
Jordan	Public hospitals do have access through the national health information system Hakeem. Private hospitals do not have access. Neither nursing homes nor outpatient nursing organizations exist in Jordan, with some exceptions in the private sector. Nursing care is typically provided in hospitals.
Kenya	There is wide variability in the implementation of systems across facilities. Some facilities have well-functioning point-of-care electronic record systems, while others do not have systems in place, e.g., they still use paper-based systems. It is also observed that some facilities, like nursing homes, tend to be behind in adoption electronic record systems.
South Korea	Korean government initiated the health information exchange project between primary, secondary, and tertiary care facilities in Korea. Those hospitals and medical officers participating in this program can exchange patient information. In 2017, there were 1,332 care facilities participating with six data depositories and 11 base hospitals. As of June 2018, 2,316 care facilities participating with 10 data depositories and 15 base hospitals.
Sweden	Hospital physicians, primary care physicians, and nurses can access health record data through the Swedish Summary Care Record (“NationellPatientöversikt,” NPÖ). Regions can either act as producers or consumers of NPÖ. All regions are connected to NPÖ today. However, the data sets published through NPÖ vary from region to region. To date, all regions publish diagnoses and daily notes. However not all publish medications and risk factors. Nursing homes in Sweden belong to municipalities. To date, 250 out of 290 municipalities are connected to NPÖ and nurses can thus, with the patient's consent, access health record data if their municipality is connected. Thus for nursing homes and outpatient nursing organizations, data access depends on whether these municipalities or privatelybased or regional organizations are connected to the national health information exchange platform through which the data for the summary care record (NPÖ) can be accessed. A current list of connected regions and municipalities and the accessible data sets are available at: https://www.inera.se/tjanster/nationell-patientoversikt-npo/Nationell-patientoversikt/#0e1cfb38-259d-42e6-a35d-7fc187152895. For access to medication data, there exists a second alternative. The Swedish eHealth Agency provides a national medication list, which contains all prescribed drugs for a patient (available at: https://www.ehalsomyndigheten.se/tjanster/prof/register/lakemedelsforteckningen/). The list is aggregated from data of all pharmacies for the last 15 months. Access for physicians and pharmacists to these data is dependent on patient consent. Nurses can access data in emergency situations with patient consent.
Turkey	In order to have a nationalEHR, a citizen must sign into e-Pulse (e-Nabız) web page or its mobile app with their citizen number (https://enabiz.gov.tr/). They can decide about the privacy of their data using the settings in e-Pulse system. The privacy options are; “No physician can see my information,” “Family physicians can see my information,” “The physician who performed my examination can see my information,” “Every physician in the health facility where I had my examination can see my health information,” and “All the physicians of the Ministry of Health can see my information.” By August 2019, 12,684,955 of 81 million Turkish citizens (∼16%) had an e-Pulse account. Allergy and emergency care notes can be entered only by the patient. The national system does not import such data from health institutions. All hospitals and public medical offices have integration to e-Pulse system. Private offices are not integrated into the system. The patient can share their data with any other citizen. Physicians in private offices, all nurses and other health professionals can access data only with the special consent of the patient, as can other citizens. Pharmacists can see all the diagnoses and prescriptions of the patient.
United States	Engagement in four interoperability domains, sending, receiving, finding, and integrating, has continued to rise among U.S. hospitals although engagement lags among small, rural and critical access hospitals.[1] Despite this growth, data access by healthcare providers was scored as partial in the United States for hospitals and medical offices because interoperability for immediate access to major relevant data remains siloed, primarily within healthcare systems, EHR vendors, or pockets of health information exchanges. For example, the federal government is supporting interoperability between The Department of Veterans Affairs (VA) and the Department of the Defense (DoD) through the Joint Legacy Viewer,[2] a web-based application displaying read-only data from the VA and DoD EHRs.[3] Large EHR vendors are attempting to increase data and information exchange with competing vendors and government-based EHRs through networks and alliances[4] [5] but access to health information remains limited to the participants of those ventures. Vendor agnostic means of exchanging patient information such as direct messaging remain underutilized.[6] While many skilled nursing facilities (SNF) use an EHR, few exchange key health information or participate in local health information exchanges.[7] Health IT adoption among nursing homes remains low, particularly as it relates to supporting clinical care of their patients and information exchange with other healthcare facilities.[8] Similarly, EHR implementation in outpatient nursing organizations is less common unless they are associated with a larger healthcare care organization sharing health IT resources. Regulation[9] around the standardization of data and reporting are likely to increase engagement by long-term care hospitals (LTCH), SNFs, home health agencies (HHA), and inpatient rehabilitation facilities (IRF). 1. Pylypchuk Y, Johnson C, Henry J, Ciricean D. Variation in Interoperability among U.S. Non-federal Acute Care Hospitals in 2017. Available at: https://www.healthit.gov/sites/default/files/page/2018-11/Interop variation_0.pdf. Accessed January 15, 2020 2. Office of the National Coordinator for Health Information Technology T. EXAMINING THE HITECH ERA AND THE FUTURE OF HEALTH IT THIS ANNUAL REPORT IS SUBMITTED PURSUANT TO SECTION 3001(C)(6) OF THE PUBLIC HEALTH SERVICE ACT AND SECTION 13113(A) OF THE HITECH ACT. Available at: http://healthit.gov/. Accessed January 15, 2020 3. Joint Legacy Viewer (JLV) 2.6 User Guide Department of Veterans Affairs Office of Information and Technology (OI&T) User Guide for Joint Legacy Viewer 2.6 ii Revision History. Available at: https://www.va.gov/vdl/documents/Clinical/Joint_Legacy_Viewer_(JLV)/JLV2_6_UserGuide.pdf. Accessed January 15, 2020 4. Why Commonwell Health Alliance [Internet]. Available at: https://www.commonwellalliance.org/about/. Accessed January 15, 2020 5. Epic Interoperability Creates One Virtual System Worldwide.Available at: https://www.epic.com/epic/post/epic-interoperability-one-virtual-system-worldwide. Accessed January 15, 2020 6. Lehmann CU, Kressly S, Hart WWC, Johnson KB, Frisse ME. Barriers to Pediatric Health Information Exchange. Pediatrics. 2017 May;139(5). pii: e20162653. doi:10.1542/peds.2016-2653. PubMed PMID: 28557727. 7. Alvarado CS, Zook K, Henry J. ONC Data Brief No. 39 \| EHR Adoption and Interoperability among U.S. Skilled Nursing Facilities in 2016 EHR Adoption and Interoperability among U.S. Skilled Nursing Facilities. Available at: https://www.healthit.gov/sites/default/files/electronic-health-record-adoption-and-interoperability-among-u.s.-skilled-nursing-facilities-in-2016.pdf. Accessed January 15, 2020 8. Alexander GL, Madsen RW, Miller EL, et al. A national report of nursing home information technology: year 1 results. J Am Med Informatics Assoc2017;24(1):67–73. 9. IMPACT Act of 2014 Data Standardization & Cross Setting Measures. 2018. Available at: https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/Post-Acute-Care-Quality-Initiatives/IMPACT-Act-of-2014/IMPACT-Act-of-2014-Data-Standardization-and-Cross-Setting-Measures.html. Accessed January 15, 2020
Abbreviations: APIs, application programming interfaces; ELGA, Elektronische Gesundheitsakte; EHR, electronic health record; FHIR, Fast Healthcare Interoperability Resources; HL7, Health Level Seven; HMO, health maintanance organization; SNOMED CT, Systematized Nomenclature of Medicine - Clinical Terms.

Appendix 2
Explanations provided for the eHealth indicators AP (access of patients to their health record data) and AC (access of caregivers tothe patients' health record data) for each country
Argentina	There are some hospitals with EHR where patients access their EHRs to manage appointments and medications, or where caregivers can do this for the patient.
Australia	Patients, who elected to have a My Health Record can directly access their health information. However, the amount and detail of information available are entirely dependent upon whether health care providers and organisations have uploaded information (e.g., hospital discharge summary, general practitioner provided information). Some information is automatically uploaded for all patients, who have a My Health Record, for example, medications dispensed by community pharmacists, some radiology and pathology results are automatically uploaded. Further information about the system is available on the website. Important features to note are that patients can elect for some documents not to be able to be viewed by a specific provider or health care organisation, e.g., patients can restrict access to some information in their record; patients may also delete documents from their My Health Record. All original health care documents remain in the individual health care organisations'EHR. Outside the My Health Record system patients can seek to access information from health care organisations such as hospitals, however, this requires a formal request process which can take some time. If an individual patient has nominated a carer or family member to have access to their My Health Record then they will be able to access the information in the record as well. Because medication data generated by pharmacies dispensing mediations is automatically uploaded into My Health Record. However, caregivers would need to have permission to access their “relatives” record to view this information.
Austria	Diagnoses and problems are only accessible if documented during an inpatient hospital visits in the national EHR “ELGA” discharge letter. Medication data can only be recorded by medical offices (prescriptions) and by pharmacies (dispensing). Discharge medication and medication given during the hospital stay can be documented in the ELGA discharge letter.
Finland	Access by patients is possible through KANTA (Finnish National Data Respository) services. Access by caregivers is given through KANTA (Finnish national data repository), if (and only if) patients gave permission for this access.
Germany	No comment
Hong Kong	No comment
Israel	In Israel, there is an ongoing implementation of various applications, mainly by hospitals. These applications make medical information more accessible to the patient, but these applications are usually built around specific procedures that are performed in hospitals (e.g., CT, MRI, and ultrasound), but they do not provide access to the medical records. All relevant information is available through community care. Patients can access this information anywhere they are, but the organization that provides and maintains this information is the HMO. Patients can, for example, access health information that records interactions, diagnosis, and measurements that were recorded by the personnel in their healthcare organization. Patients cannot access information from the hospital through their healthcare organization portal. They can receive if they ask for it, a report from the hospital, but they do not have access to the medical records collected by the hospital. Caregivers can receive authorization to access the medical information of the patient. This can be done legally through the institution of a guardian (e.g., parents to their children). In this case, caregivers get a view of the information the patient can access. However, medical information that is redeemed confidential and private is not accessible to the caregiver, e.g., parents will not see pregnancy information of their children, caregivers cannot view AIDS diagnosis and information related to the psychiatric history and condition of the patient, etc.
Japan	Only a few regional health system institutes (2-5% of the whole country) offer this access.
Jordan	No comment
Kenya	No comment
South Korea	Access is given through the National Health Insurance Agency of South Korea, if (and only if) patients gave permission to caregivers for this access. It is then the same access as for patients, as the patients' user identity has to be used.
Sweden	Patients can access their health record data through a patient accessible EHR (“Journalen”). As with NPÖ data is published through the national health information exchange platform and accessibility of the data for the patient.is steered by the regions' willingness to publish the data. To date, all regions are connected to the national health information exchange platform and all regions but one publish diagnoses. All regions publish daily notes but less than half of the regions publish data about allergies. A current overview of the published data is available at: https://www.inera.se/tjanster/journalen/Journalen/#7f7bcaef-c5f1-4488-8992-d594b945a166. All patients have access to their medication data by accessing the national medication list (available at: https://www.ehalsomyndigheten.se/tjanster/prof/register/lakemedelsforteckningen/) even if the regions do not publish individual prescription data through “Journalen”. Note: Caregivers' (i.e., relatives', next-of-kin's) access to the patient's EHR is prohibited by law. An application can be issued by a caregiver to become a legal proxy. If approved the caregiver has access to the same data as the patient him/herself. The only exception is that parents/custodians of children under the age of 13 are granted access to their children's records.
Turkey	Public medical offices have integration to e-Pulse system. Private offices are not integrated into the system. The national health system imports data that are related to physician diagnoses and prescriptions. If an outpatient nursing organization is not employing physician(s), their data are not visible. The patient can share their data with any other citizen.
United States	For the United States, hospitals and medical offices are designated as partially given for patient access. While most hospitals and medical offices use EHRs which include a patient portal allowing patients to view major relevant data,[1] patients commonly see clinicians across different health care systems requiring them to maintain access across multiple disparate patient portals with no interoperability between them. Apple is attempting to bridge this gap with the health records functionality announced in early 2018.[2] Currently, in beta testing with participating U.S. institutions, health records aggregates health data from across EHR platforms and presents it to patients in the Apple Health application on an iPhone. While there may be pockets of nursing homes, skilled nursing facilities and outpatient nursing organizations with patient portals,[3] [4] particularly when those organizations are associated with a larger healthcare system, the majority of patient portals are implemented through hospitals and medical offices. In the United States, caregiver access is achieved through designation as a delegate in the patient portal. Therefore, caregivers generally have the same access to health data as patients once they are granted delegate privileges. When receiving care outside of a single healthcare system, patients and their caregivers need to maintain to access multiple different patient portals without an aggregated view of health data in any single portal. For this reason, caregiver access to patient data is set as partially given. 1. Osborn CY, Rosenbloom ST, Stenner SP, et al. MyHealthAtVanderbilt: policies and procedures governing patient portal functionality. J Am Med Informatics Assoc2011;18(Supplement 1):i18–23. Available at: https://academic.oup.com/jamia/article-lookup/doi/10.1136/amiajnl-2011-000184. 2. Healthcare - Health Records - Apple. Available at: https://www.apple.com/healthcare/health-records/. Accessed January 15, 2020 3. Alvarado CS, Zook K, Henry J. ONC Data Brief No. 39 \| EHR Adoption and Interoperability among U.S. Skilled Nursing Facilities in 2016 EHR Adoption and Interoperability among U.S. Skilled Nursing Facilities. 2016. Available from: https://www.healthit.gov/sites/default/files/electronic-health-record-adoption-and-interoperability-among-u.s.-skilled-nursing-facilities-in-2016.pdf. Accessed January 15, 2020 4. Alexander GL, Madsen RW, Miller EL, et al. A national report of nursing home information technology: year 1 results. J Am Med Informatics Assoc 2017;24(1):67–73.
Abbreviations: CT, computed tomography, EHR, electronic health record; HMO, health maintanance organization; MRI, magnetic resonance imaging; NPÖ, NationellPatientöversikt.

Appendix 3
Explanations provided for the eHealth indicator EH (enabling health care professionals to add data to their patients' health record[s]) for each country
Argentina	There are some healthcare organizations with EHRs where physicians, nurses, and pharmacists add data to their patients' EHRs.
Australia	All registered health care providers can add information to a patient's My Health Record. This would occur at the end of a health event. Most hospitals etc. have an EHR system of some form in their organisation. Community pharmacists have their own electronic information systems where they record medications dispensed. However, we would not call this an EHR system and such systems are not connected to hospital EHRs. Thus, they add medication data to a record system and such data is also associated with obtaining subsidies for some medications. Specialist doctors, who work in their own practices (as well as in hospitals), have their own medical record systems and most of these are not computerised. Probably around 30-50% of nursing homes have some form of computerised data collection system but these range from those with very basic clinical information to those with clinical notes and medication components. However, our family/general practitioners in the community are highly computerised with all having electronic record systems in their practices. Hence, it is quite difficult to give overall scores for this question and the record systems of these various groups are separate from each other. The national health record allows practitioners to choose to upload some summary information in defined templates. Comments on some outcomes: Medical offices: ++ for family physicians in the community, + for specialist physicians, overall: ++ Nursing homes: + varies a lot. Maybe around 40–50% have some sort of EHR system. Outpatient nursing organizations: + Once again varies considerably between organisations. Pharmacies: + Yes they have systems for managing the dispensing of medications but I would not normally classify this as an EHR.
Austria	Hospital pharmacists do not record medication data in Austria. Most medical offices use computer-based documentation systems. Most nursing homes use a mix of paper-based and computer-based documentation systems. In August 2019, about 1,000 of 1,400 pharmacies were connected to ELGA; this indicates that they have an institutional EHR.
Finland	Pharmacists: only ePrescription
Germany	Hospital pharmacists can add data indirectly through medication recommendations to physicians, plus own (but separate) documentation. Nursing homes and outpatient nursing organizations only have some rare documentation in EHRs. At the current very limited state it has, however, clearly to be rated as not given. Not in all pharmacies can add data, and sometimes only for selected patients.
Hong Kong	Nurses in hospitals can add summaries, but not drugs or allergies or diagnoses. Pharmacists in hospitals can add or amend drugs but not other information. Outpatient nursing organizations can add summaries only
Israel	All healthcare professionals work on the health record and can view or add information into it according to their authorization.
Japan	No comment
Jordan	No comment
Kenya	Some facilities have well-functioning point of care systems, while others rely on paper systems or on retrospective data entry into electronic record systems. While some of these health care institutions might have EHRs with the ability for providers to enter data into the system, there still is an overwhelming preference by providers to use paper records in those settings. Only a small number of <10% of pharmacies have electronic documentation systems to keep patient information, these are usually programs that are using the EMR endorsed by the country for HIV care and treatment programs. In addition, private pharmacies also have electronic record systems, but these are mostly for inventory.
South Korea	The hospital pharmacist is a hospital affiliate, and the outpatient pharmacist is an independent agency that only shares drug information.
Sweden	All professionals always add data to their local medical record but as data is published through the National Health Information Exchange platform and viewed through the summary care record (for professionals) or the patient-accessible EHR (for patients) the data can be made accessible nationally. However, there is not a single integrated national EHR system in Sweden.
Turkey	Some private offices do not use EHRs. Public outpatient nursing organizations usually work as units of the hospitals. Nurses can add some data to the patient health records.
United States	Adoption of health IT in nursing homes and outpatient nursing organizations has lagged behind their hospital and medical office counterparts.[1] [2] When implemented in nursing homes, health IT is more likely to be used for administrative and billing activities than to support clinical activities.[2] Additionally, while some nursing homes have the capability to support clinical activities within their EHR, the extent of use of that functionality in daily resident care is much lower.[2] 1. Alvarado CS, Zook K, Henry J. ONC Data Brief No. 39 \| EHR Adoption and Interoperability among U.S. Skilled Nursing Facilities in 2016 EHR Adoption and Interoperability among U.S. Skilled Nursing Facilities. Available at: https://www.healthit.gov/sites/default/files/electronic-health-record-adoption-and-interoperability-among-u.s.-skilled-nursing-facilities-in-2016.pdf. Accessed January 15, 2020 2. Alexander GL, Madsen RW, Miller EL, et al. A national report of nursing home information technology: year 1 results. J Am Med Informatics Assoc15];24(1):67–73.
Abbreviations: EHR, electronic health record; EMR, electronic medicalrecord; IT, information technology.

Appendix 4
Explanations provided for the eHealth indicator eHealth indicators EP (enabling patients to add data to their health record[s]) and EC (enabling caregivers to add data to the patients' health record[s]) as for each country
Argentina	There are some hospitals with EHRs where patients access their EHRs and add some vital signs and some medical reports. There are also some hospitals with EHRs where caregivers access patient EHRs and add some vital signs and some medical reports.
Australia	Through the My Health Record system, patients can add information but this functionality is quite limited at the moment. For example, they can upload an “advanced care directive.” Patients cannot immediately add information to other EHRs, e.g., in hospital. Caregivers, who have been allocated permission by the patient, can act on behalf of the patient, e.g., a parent on behalf of a child. In this designated role, the caregiver can access the My Health Record system using the same functionality as described above. However, as stated there is quite limited functionality in the national my health record system for patients or their caregivers to add information. There is no facility for caregivers to provide input to EHR systems for individual provider organisations such as hospitals, nursing homes, etc.
Austria	No comment
Finland	Through KANTA services
Germany	No comment
Hong Kong	No comment
Israel	Maccabi HMO (25.4% of the population) has a personal health record (PHR) to which patients can add data, but it is not integrated with the EHR. Patients can discuss the information they added with the physician during face-to-face meetings, however, the physician is not responsible to actively view this information or to act upon it on a regular basis. See also the preceding comment about caregivers' access to the patient's EHR.
Japan	No comment
Jordan	No comment
Kenya	No comment
South Korea	No comment
Sweden	Patients can add notes to their EHR but only in one out of 21 county councils and regions. For caregivers, access is in general only granted for custodians of children under the age of 13 years. Otherwise not allowed for caregivers unless an official application has been filed by the caregiver and been granted by the county council. In that case, it is the same as for patients.
Turkey	Patients can add only their weight, height, allergies, blood pressure, blood sugar, heart rate, and emergency notes. Caregivers can add data if the patient is below 18 years old.
The United States	For the United States, this indicator is set at partial because most patient portals contain functionality that allows patients to enter data[1] but typically only for a subset of predefined structured data elements and occasionally only by invitation from their healthcare provider. Data that are commonly patient-entered include medications and other discrete data elements such as blood pressure or blood glucose readings. However, as the adoption of wearable technology increases, the manual process of entering multiple data values disincentivizes some patients, who now have numerous vital sign readings or glucose monitoring results to share with their physician. Some EHRs also supports the ability to upload additional clinical data such as a photograph to share with their physician securely through the EHR or to fill out previsit forms for easier integration at the time of the in-person interaction but these are not universally available features and are not always implemented at institutions even when the technical capability exists. Caregivers typically have the same data-entry rights as patients once they are granted delegate privileges in the patient portal. Therefore, they too subject to the limitations of predefined data subsets when entering data through the patient portal. 1. Most Wired Hospitals Use Technology for a Better Patient Experience \| AHA.; Available at: https://www.aha.org/press-releases/2016-07-06-most-wired-hospitals-use-technology-better-patient-experience. Accessed January 15, 2020.
Abbreviations: EHR, electronic health record; HMO, health maintanance organization; KANTA, Finnish National Data Respository.

Referenzen

References
1 Organisation for Economic Co-operation and Development (OECD). Draft OECD Guide to Measuring ICTs in the Health Sector. Available at: https://www.oecd.org/health/health-systems/Draft-oecd-guide-to-measuring-icts-in-the-health-sector.pdf . Accessed July 15, 2020
2 Kruse CS, Beane A. Health information technology continues to show positive effect on medical outcomes: systematic review. J Med Internet Res 2018; 20 (02) e41
3 Hersh WR, Totten AM, Eden KB. et al. Outcomes from health information exchange: systematic review and future research needs. JMIR Med Inform 2015; 3 (04) e39
4 Kuhn KA, Giuse DA. From hospital information systems to health information systems. Problems, challenges, perspectives. Methods Inf Med 2001; 40 (04) 275-287IS
5 Eysenbach G. What is e-health?. J Med Internet Res 2001; 3 (02) E20
6 Hyppönen H, Faxvaag A, Gilstad H. et al. Nordic eHealth indicators: organisation of research, first results and plan for the future. Stud Health Technol Inform 2013; 192: 273-277
7 Nordic Council of Ministers. Nordic EHealth Benchmarking. Available at: https://norden.diva-portal.org/smash/get/diva2:1093162/FULLTEXT01.pdf . Accessed July 25, 2020
8 European Commission. Benchmarking Deployment of EHealth among General Practitioners. Available at: http://ec.europa.eu/information_society/newsroom/cf/dae/document.cfm?doc_id=4897 . Accessed July 15, 2020
9 World Health Organization. E-health: Indicators & visualizations. Available at: https://gateway.euro.who.int/en/themes/e-health/indicators-visualizations/ . Accessed July 15, 2020
10 Centers for Disease Control and Prevention. Public Health and Promoting Interoperability Programs. Available at: https://www.cdc.gov/ehrmeaningfuluse/introduction.html . Accessed July 15, 2020
11 Haux R, Ammenwerth E, Koch S, et al. A Brief Survey on Six Basic and Reduced eHealth Indicators in Seven Countries in 2017. Appl Clin Inform. 2018;9(3):704–713. doi:10.1055/s-0038-1669458
12 ISO. ISO/TR 20514:2005. Health informatics—Electronic health record—Definition, scope and context. Available at: https://www.iso.org/standard/39525.html . Accessed July 15, 2020
13 World Health Organization. Global Diffusion of EHealth: Making Universal Health Coverage Achievable. Available at: https://apps.who.int/iris/bitstream/handle/10665/252529/9789241511780-eng.pdf;jsessionid=B7E7B4CF6BA92C6F4CC674C962BC395B?sequence=1 . Accessed July 15, 2020
14 Granja C, Janssen W, Johansen MA. Factors determining the success and failure of ehealth interventions: systematic review of the literature. J Med Internet Res 2018; 20 (05) e10235
15 Rigby M, Ammenwerth E, Talmon J. Forward outlook: the need for evidence and for action in health informatics. Stud Health Technol Inform 2016; 222: 355-363
16 Zelmer J, Ronchi E, Hyppönen H. et al. International health IT benchmarking: learning from cross-country comparisons. J Am Med Inform Assoc 2017; 24 (02) 371-379
17 World Health Organization. From Innovation to Implementation. EHealth in the WHO European Region(2016). Available at: https://www.euro.who.int/__data/assets/pdf_file/0012/302331/From-Innovation-to-Implementation-eHealth-Report-EU.pdf . Accessed July 15, 2020
18 Esdar M, Hüsers J, Weiß JP, Rauch J, Hübner U. Diffusion dynamics of electronic health records: a longitudinal observational study comparing data from hospitals in Germany and the United States. Int J Med Inform 2019; 131: 103952
19 Naumann L, Esdar M, Ammenwerth E, Baumberger D, Hübner U. Same goals, yet different outcomes: analysing the current state of ehealth adoption and policies in Austria, Germany, and Switzerland using a mixed methods approach. Stud Health Technol Inform 2019; 264: 1012-1016
20 Tsai CH, Koch S. Towards a framework for national ehealth evaluation and monitoring: a combined top-down and bottom-up approach using sweden as example. Stud Health Technol Inform 2019; 264: 954-958
21 Price M, Lau F. The clinical adoption meta-model: a temporal meta-model describing the clinical adoption of health information systems. BMC Med Inform Decis Mak 2014; 14 (01) 43
22 Winter A, Haux R, Ammenwerth E, Brigl B, Hellrung N, Jahn F. Health Information Systems: Architectures and Strategies. 2nd ed. New York, NY: Springer-Verlag; 2011

Abbildungen

International Comparison of Six Basic eHealth Indicators Across 14 Countries: An eHealth Benchmarking Study

Explanations provided for the eHealth indicator AH Access of health care professionals to their patients' health record data for each country

Explanations provided for the eHealth indicators AP (access of patients to their health record data) and AC (access of caregivers tothe patients' health record data) for each country

Explanations provided for the eHealth indicator EH (enabling health care professionals to add data to their patients' health record[s]) for each country

Explanations provided for the eHealth indicator eHealth indicators EP (enabling patients to add data to their health record[s]) and EC (enabling caregivers to add data to the patients' health record[s]) as for each country