Mixed reality to support emergency outreaches

Overview

Initiative type

Service Improvement

Status

Deliver

Published

June 2025

Summary

Demand for the acute outreach Older Persons Emergency Network has increased exponentially. An advanced mode of telehealth using mixed reality was trialled to increase service capacity.

Key dates

1 March 2024 - 1 June 2024

Implementation sites

Royal Brisbane and Women's Hospital

Aim

The aim of this quality improvement (QI) project was to assess the usability and acceptability of mixed reality (MR) within the acute outreach Older Persons Emergency Network (AO OPEN).

Outcomes

  • Thirty-two clinicians interacted with MR and completed the System Usability Survey (SUS).
  • Good usability and acceptability of MR was demonstrated
  • Most patients were treated in residential aged care facilities (RACFs) (66%, 21/32).
  • Patients were treated for minor injuries (25%, 9/32), lacerations (25%, 8/32) or wounds (19%, 6/32).
  • Nurses found MR easy to use and obtained clear advice from senior clinicians
  • Senior clinicians found the image quality to be the biggest strength of MR.
  • Half of the staff experienced technical issues mainly due to internet connectivity in RACFs causing call disconnections and distorted images.

Background

A rapidly ageing population, alongside people living longer due to advances in healthcare has seen increased healthcare utilisation by older adults worldwide [1]. In Australia, older adults accounted for 22% of 8.2 million emergency department (ED) presentations between 2019 – 2020 which continues to rise [2]. Older adults, particularly from residential aged care facilities (RACFs) are a complex and vulnerable population with chronic conditions, comorbidities, high levels of frailty, functional and cognitive impairment. Furthermore, EDs have been identified as potentially harmful environments for older adults, with hospitalisations associated with increased risk of hospital acquired complications.

In response to growing demands on the healthcare system, new models of care such as ED substitutive models have been introduced in the community to treat older adults in their home to avoid unnecessary presentations to EDs [3-5]. Established in 2020 during COVID-19, the AO OPEN (formerly RADAR RR - RACFs only) was implemented in Metro North Hospital and Health Service (MNHHS), to provide ED substitution and Queensland Ambulance Service co-response to older adults with acute injuries or illnesses in their own home. The AO OPEN consists of a multidisciplinary team (medical, nursing, pharmacy, and social work) which provide acute care to older adults in their homes via telehealth and outreach services. Since expanding to community dwellers in 2022, demand for the AO OPEN has increased exponentially with over 1700 patients per annum treated in their homes in 2023 with the service reaching capacity regularly.

Increased demand for the service has led to the need for innovative, cost-effective solutions to increase capacity and capability. In collaboration with the Queensland Virtual Hospital, the Microsoft HoloLens 2, a MR holographic computer was introduced, in conjunction with a Telstra 5G modem, as an advanced mode of telehealth to support patient care. Unlike traditional telehealth methods using videoconference equipment, the HoloLens 2 involves wearing light, portable goggles, worn as a headset, enabling the user to interact (via Microsoft Teams) hands-free with a clinician remotely while assessing the patient and their physical environment. The HoloLens has undergone a rigorous validation process and is used in several healthcare contexts such as medical education and training, virtual training, gait analysis and rehabilitation, tele-mentoring, tele-consulting for procedural or surgical guidance and navigation [6] showing great potential for the AO OPEN model.

This advanced technology enables a greater point of view image and the ability to annotate, share clinical reference material, manipulate, and point while in a videoconference, to better assist the remote clinician through a range of different procedures. Utilising this form of technology provided an opportunity for registered nurses (RNs) and Advanced Practice Nurses (APNs) within the service to carry out solo outreaches using MR to liaise with a Senior Medical Officer (SMO), or Nurse Practitioner (NP) remotely for medical governance and support via Microsoft Teams.

Methods

Operating seven days a week, 0800 - 2230hrs, the AO OPEN model provides telehealth and outreach services to older adults (65 or 50 years if Aboriginal or Torres Strait Islander persons) throughout MNHHS. The service consists of 32 clinicians, three outreach cars including a senior and a junior clinician in each car.

The Queensland Virtual Hospital provided the AO OPEN model with a MR device (Microsoft HoloLens 2) and licenses to trial the technology for 90 days, March - June 2024. This technology enabled an additional car to be employed consisting of an APN or RN to carry out solo outreaches. APNs and RNs providing outreach to older persons in the community were informed about the project and provided with individual 30-minute training sessions using the MR goggles.

Training involved:

  • Use of Microsoft® Teams videoconferencing for telehealth assessments of patients.
  • Remote annotation and pointing capabilities to provide more accurate guidance and instructions.
  • Use of Microsoft Teams chat and file sharing to provide reference material that appears in the wearer's vision for assistance during the consultation.

Following training, and for the purposes of this project the AO OPEN clinicians were categorised according to their role when using the HoloLens MR device:

  • Requestors (RNs and APNs) - nurses that wear the HoloLens device and provide onsite care to the patient.
  • Consultants (SMOs and NPs) - senior clinicians contacted by requestors via Microsoft Teams to review the patient remotely and provide clinical governance and advice.

Requestors attending solo outreaches were instructed to use the MR device to contact a consultant remotely from the AO OPEN via Microsoft Teams to obtain medical oversight or governance while reviewing and treating patients.
Using a convenience sampling approach, all clinicians interacting with the MR device (requestors and consultants) were invited to complete a survey following a patient review. Demographic data included the role of the user (i.e., requestor or consultant), clinical position of the participant (RN, APN, NP or SMO), dwelling type where the patient was assessed (i.e., home or RACF), and the condition the nurse was assessing during the telehealth call. Next, participants were asked to complete the System Usability Scale (SUS) [7-9], to determine the usability and acceptability of the technology. The SUS consists of a 10-item measure with each question answered using a 5-point scale from ' Strongly Agree to Strongly Disagree'. The SUS has good reliability and validity measures and has dependable benchmarks to aid in the interpretation of scores [10, 11]. The SUS is widely used with references in over 1300 articles and publications [7, 8]. Additional short answer questions were included to identify the enablers and barriers to MR within the AO OPEN model.

Descriptive statistics were used to summarise the data from the SUS survey. Data is presented as mean, standard deviation, frequencies, and percentages. Inductive content analysis was employed to code, categorise and abstract the short answer data to draw meaningful conclusions [12].

Discussion

Mixed reality shows great potential for solo clinicians to work autonomously in the community, however, the success of its use was hindered by poor internet connectivity in RACFs despite using a 5G modem. Since the Royal Commission into Aged Care and Quality report highlighted a lack of progress in the application of communication technology in RACFs there has been greater investment in telehealth enabling residents to be assessed online to avoid potential transfers to hospital [13]. Despite advancements, challenges related to inadequate information technology infrastructure to support telehealth have been reported [14]. Further work is needed to explore reliable and higher quality videoconference connections such as utilisation of Wi-Fi through local RACFs to facilitate telehealth consultations.

Advanced telehealth using MR is a cost-efficient way to expand the capacity of the AO OPEN model while also empowering nurses to broaden their skillset and work to their full scope of practice with support and guidance from a senior clinician. Nurses and midwives represent over 50% of all registered health professionals in Australia [15], yet over a third of all primary health nurses report they are under-utilised often or most of the time [16]. Empowering nurses to work to the full extent of their scope of practice not only improves health outcomes as service delivery is optimised it also increases nurses job satisfaction and retention in the workforce [17]. It is important however that healthcare organisations provide the necessary education, training and support to equip nurses with the skills and knowledge to competently and confidently provide quality care in the community [18].

There are several limitations that need to be considered. This was a QI project with a small sample size and caution should be exercised when generalising these findings to other healthcare settings. It is also important to consider the potential effect of selection bias associated with using a convenience sampling design. Further rigorous testing with larger numbers is required to test the technology in similar healthcare settings to inform wider adoption.

The world has an ageing population and innovative, cost-effective strategies are urgently needed to ensure older persons receive the right care in the right place at the right time. The use of MR in emergency outreach teams shows great potential to increase capacity and capability in healthcare services. While there is a long history of MR use in simulated real-world environments further research is needed to understand the clinical and cost effectiveness of its use in real-life settings to inform wider adoption of the technology. Furthermore, with the rapid pace of technological innovation it is important to ascertain the longevity of manufacturer support before investing in long term integration of the technology. Collaborative research between industry partners and healthcare services could assist with the development of fit for purpose technology to optimise service delivery and outcomes for patients.

References

1. Barnett, K., et al., Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet, 2012. 380(9836): p. 37-43.
2. Australian Institute of Health and Welfare, Older Australians. 2021, AIHW.
3. Patton, A., et al., The Alternative Pre-hospital Pathway team: reducing conveyances to the emergency department through patient centered Community Emergency Medicine. BMC Emerg Med, 2021. 21(1): p. 138.
4. Burkett, E. and I. Scott, CARE-PACT: a new paradigm of care for acutely unwell residents 
in aged care facilities. Aust Fam Physician, 2015. 44(4): p. 204-9.
5. Mellerick, A., et al., Nurse-led emergency department avoidance model of care for patients receiving cancer therapy in the ambulatory setting: a health service improvement initiative. BMC Health Serv Res, 2023. 23(1): p. 710.
6. Palumbo, A., Microsoft HoloLens2 in medical and healthcare context: State of the art and future prospects. Human health and performance monitoring sensors, 2022. 22(20).
7. Brooke, J., SUS: a quick and dirty usability scale. Vol. 189. 1996, London: Taylor and Franics.
8. Brooke, J., SUS: A retrospective. Journal of user experience, 2021. 8(2): p. 29-40.
9. Sauro, J., A practical guide to the system usability scale: Background, benchmarks and best practices. 2011: CreateSpace Idependent Publishing Platform.
10. Bangor, A., P. Kortum, and J. Miller, Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of user experience: p. 114-123.
11. Lewis, J.R. and J. Sauro, Human Centred Design,. The factor structure of the System Usability Scale. 2009, Berlin: Springer.
12. Hsieh, H.F. and S.E. Shannon, Three approaches to qualitative content analysis. Qual Health Res, 2005. 15(9): p. 1277-88.
13. The Royal Commission in Aged Care Quality and Safety, A summary of the final report. 2021, The Royal Commission in Aged Care Quality and Safety.
14. Seifert, A., J.A. Batsis, and A.C. Smith, Telemedicine in Long-Term Care Facilities During and Beyond COVID-19: Challenges Caused by the Digital Divide. Front Public Health, 2020. 8: p. 601595.
15. Australian Institute of Health and Welfare, Health workforce. 2022, AIHW.
16. Australian Primary Health Care Nurses Association, Nurses skills, experience being wasted despite nursing shortage. 2023, APNA.
17. Halcomb, E. and S. Bird, Job Satisfaction and Career Intention of Australian General Practice Nurses: A Cross-Sectional Survey. J Nurs Scholars, 2020. 52(3): p. 270-280.
18. Australian College of Nursing, Position statement: Scope of practice - registered nurses in the community setting. 2024, ACN: Canberra.

Key contact

Julie Oliver and Dr Amy Spooner

A/Nursing Director /  Clinical Nurse Consultant

Metro North Hospital and Health Service

Email: amy.spooner@health.qld.gov.au; julie.oliver@health.qld.gov.au