Download PDF
Appl Clin Inform 2024; 15(04): 743-750
DOI: 10.1055/s-0044-1788331
Research Article

Developing PRISM: A Pragmatic Institutional Survey and Bench Marking Tool to Measure Digital Research Maturity of Cancer Centers

Carlos Berenguer Albiñana
1   IQVIA, London, United Kingdom
,
Matteo Pallocca
2   IRCCS Istituto Nazionale Tumori Regina Elena, Rome, Italy
,
Hayley Fenton
1   IQVIA, London, United Kingdom
3   Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom
,
Will Sopwith
1   IQVIA, London, United Kingdom
3   Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom
,
Charlie Van Eden
1   IQVIA, London, United Kingdom
,
Olof Akre
4   Karolinska Comprehensive Cancer Center, Stockholm, Sweden
,
Annika Auranen
5   Tays Cancer Centre, Pirkanmaa, Finland
,
François Bocquet
6   Data Factory & Analytics Department, Institut de Cancérologie de l'Ouest, Nantes-Angers, France
,
Marina Borges
1   IQVIA, London, United Kingdom
7   Instituto Português de Oncologia do Porto Francisco Gentil, Porto, Portugal
,
Emiliano Calvo
8   START Madrid-CIOCC, Centro Integral Oncológico Clara Campal, Madrid, Spain
,
John Corkett
3   Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom
,
Serena Di Cosimo
9   Fondazione IRCCS Istituto Nazionale dei Tumori, Milan, Italy
,
Nicola Gentili
10   IRCCS Istituto Romagnolo per lo Studio dei Tumori (IRST) “Dino Amadori,” Meldola, Italy
,
Julien Guérin
11   Data Office, Institut Curie, Paris, France
,
Sissel Jor
12   Oslo University Hospital Cancer Center, Oslo, Norway
,
Tomas Kazda
13   Masaryk Memorial Cancer Institute, Brno, Jihomoravský, Czechia
,
Alenka Kolar
14   Institute of Oncology Ljubljana, Ljubljana, Slovenia
,
Tim Kuschel
15   Charité, Universitätsmedizin Berlin, Berlin, Germany
,
Maria Julia Lostes
16   Vall d'Hebron University Hospital, Barcelona, Spain
,
Chiara Paratore
17   University Hospital San Luigi Gonzaga of Orbassano, Orbassano TO, Italy
,
Paolo Pedrazzoli
18   Fondazione I.R.C.C.S. Policlinico San Matteo, Pavia PV, Italy
,
Marko Petrovic
19   Sestre Milosrdnice University Hospital, Zagreb, Croatia
,
Jarno Raid
20   Tartu University Hospital, Tartu, Tartumaa, Estonia
,
Miriam Roche
21   Trinity St James's Cancer Institute, Dublin, Ireland
,
Christoph Schatz
22   Biobank Innsbruck, Innsbruck, Austria
,
Joelle Thonnard
23   Cliniques Universitaires Saint-Luc, Brussels, Belgium
,
Giovanni Tonon
24   IRCCS San Raffaele Scientific Institute, Milan, Italy
,
Alberto Traverso
24   IRCCS San Raffaele Scientific Institute, Milan, Italy
25   Maastricht Comprehensive Cancer Center, Maastricht, The Netherlands
26   DIGICORE, Bruxelles, Belgium
,
Andrea Wolf
27   University Cancer Center Frankfurt (UCT), University Hospital, Goethe University, Frankfurt, Germany
,
Ahmed H. Zedan
28   Vejle Hospital, University of Southern Denmark, Vejle, Denmark
,
Piers Mahon
1   IQVIA, London, United Kingdom
26   DIGICORE, Bruxelles, Belgium
› Author Affiliations
› Further Information
Also available at
    Permissions and Reprints

Abstract

Background Multicenter precision oncology real-world evidence requires a substantial long-term investment by hospitals to prepare their data and align on common Clinical Research processes and medical definitions. Our team has developed a self-assessment framework to support hospitals and hospital networks to measure their digital maturity and better plan and coordinate those investments. From that framework, we developed PRISM for Cancer Outcomes: PRagmatic Institutional Survey and benchMarking.

Objectives The primary objective was to develop PRISM as a tool for self-assessment of digital maturity in oncology hospitals and research networks; a secondary objective was to create an initial benchmarking cohort of >25 hospitals using the tool as input for future development.

Methods PRISM is a 25-question semiquantitative self-assessment survey developed iteratively from expert knowledge in oncology real-world study delivery. It covers four digital maturity dimensions: (1) Precision oncology, (2) Clinical digital data, (3) Routine outcomes, and (4) Information governance and delivery. These reflect the four main data types and critical enablers for precision oncology research from routine electronic health records.

Results During piloting with 26 hospitals from 19 European countries, PRISM was found to be easy to use and its semiquantitative questions to be understood in a wide diversity of hospitals. Results within the initial benchmarking cohort aligned well with internal perspectives. We found statistically significant differences in digital maturity, with Precision oncology being the most mature dimension, and Information governance and delivery the least mature.

Conclusion PRISM is a light footprint benchmarking tool to support the planning of large-scale real-world research networks. It can be used to (i) help an individual hospital identify areas most in need of investment and improvement, (ii) help a network of hospitals identify sources of best practice and expertise, and (iii) help research networks plan research. With further testing, policymakers could use PRISM to better plan digital investments around the Cancer Mission and European Digital Health Space.

Keywords

real-world data - hospital digital maturity - cancer outcomes research

Protection of Human and Animal Subjects

Our study is exempted from Institutional Review Board.


Supplementary Material



Publication History

Received: 05 November 2023

Accepted: 16 June 2024

Article published online:
11 September 2024

© 2024. Thieme. All rights reserved.

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

 

  • References

  • 1 Ekman S, Griesinger F, Baas P. et al. I-O Optimise: a novel multinational real-world research platform in thoracic malignancies. Future Oncol 2019; 15 (14) 1551-1563
    Google Scholar
  • 2 Salles G, Bachy E, Smolej L. et al. Single-agent ibrutinib in RESONATE-2™ and RESONATE™ versus treatments in the real-world PHEDRA databases for patients with chronic lymphocytic leukemia. Ann Hematol 2019; 98 (12) 2749-2760
    Google Scholar
  • 3 Palomba ML, Ghione P, Patel AR. et al. A comparison of clinical outcomes from updated Zuma-5 (Axicabtagene Ciloleucel) and the International Scholar-5 External Control Cohort in Relapsed/Refractory Follicular Lymphoma (R/R FL). Blood 2021; 138 (01) 3543
    Google Scholar
  • 4 HIMSS. HIMSS Maturity Models: Models for Digital Health Transformation. Accessed July 10, 2024 at: https://www.himss.org/what-we-do-solutions/maturity-models. (05/07/2024)
  • 5 European Commission. Europe's Beating Cancer plan. Accessed June 20, 2024 at: eu_cancer-plan_en_0.pdf (europa.eu)
    Google Scholar
  • 6 European Commission. EU Mission: Cancer (europa.eu) Accessed July 10, 2024 at: https://research-and-innovation.ec.europa.eu/funding/funding-opportunities/funding-programmes-and-open-calls/horizon-europe/eu-missions-horizon-europe/eu-mission-cancer_en (05/07/2024)
  • 7 Mahon P, Chatzitheofilou I, Dekker A. et al. A federated learning system for precision oncology in Europe: DigiONE. Nat Med 2024; 30 (02) 334-337
    Google Scholar
  • 8 Boomsma F, Van Harten W, Oberst S. et al. OECI. Accreditation and Designation User Manual V. 2.0. User manual of A&D Programme. Accessed June 202, 2024 at: oeci.eu
    Google Scholar