Reveal of unique delirium diagnostic tool 

Overview

Initiative type

Service Improvement

Status

Deliver

Published

June 2025

Summary

The creation, validation, refinement, digital transposition, demonstration of usability and finally implementation of a world first diagnostic support tool to help junior doctors identify the causes of delirium.

Dates: June 2020 -

Implementation sites - The Prince Charles Hospital

Partnerships: University of Queensland and Metro North Digital

Aim

The life cycle of iteration to implementation. Develop, validate, transpose, refine, measure usability and finally implement a diagnostic support tool (DST) for identification of causes of delirium.

Outcomes

Creation: A series of eight steps were formulated by an expert group to identify causes of delirium.  

Validation:  40 inpatients admitted to a general medical unit with a consultant physician/geriatrician diagnosis of delirium were reviewed against the AiD-DST.  Median number of causes of delirium detected on AiD-DST was 3 (IQR 3-4) versus 5 (IQR 3-6) using the reference standard diagnosis. Sensitivity of 88.8% (95% confidence interval, 81.6-93.9%) and specificity of 71.8% (63-79.5%).  

Transposition: The final electronic version was built on Microsoft Blazor technology.  

Refinement: software issues were identified, and modifications made.  

Three cycles of feedback were obtained from 29 doctors. Content was grouped into themes of; 'style and grammar', 'formatting', 'missed diagnosis' and 'other concerns.'  

Usability: 20 participants completed a standard usability (MAUQ) questionnaire. Average score was 6.36/7 (SD=0.8). This translates to agreement up to strong agreement concerning usability of AiD-DST.

Implementation: Reach: fifty-three out of 87 (61%) eligible doctors consented to participation in the study.

Effectiveness: A mean of 4.3 diagnoses were generated per patient with no difference in frequency when compared with historical control (z = 1.36; p = .17). Average usability score was 5.86 (SD = 1.15), with 93% of respondents being satisfied with the AiD-DST. Free text feedback comprised themes of accessibility, ergonomics, diagnostic accuracy and applicability of AiD-DST to related conditions.

Implementation: Instrument completion rate was 98% (n = 49/50), with a median completion time of 90 s. Maintenance: Sixty-seven % of uses of AiD-DST occurred in the second half of the study (p = .3). Following the initiation period there was an increase in use (r = .79; p = 02).

Background

Delirium represents an episode of new confusion caused by usually acute medical problems. Delirium affects one in four of hospitalized older patients or over 130,00 cases per year in Australia.

Delirium is  associated with a tripling of mortality in relation to aged matched controls and costs over $8 billion per year in Australia alone. The causes of delirium are multifactorial and heterogeneous with correct identification representing a clinical challenge with evidence that causes are missed in every other patient associated with a quadrupling of mortality.

The Australian national safety and quality standard for delirium identifies that the cause of delirium is an area of quality focus but one for which there are up to now no currently available diagnostic support tools.

The challenge of creating a diagnostic support tool in which the combination of causes in any given patient is almost infinite renders the problem beyond the scope of traditional lists or heuristics.

Using Bayesian theory applied to clinical method we crafted a diagnostic support tool from first principles and have since successfully undertaken a complete cycle of validation and translation.

Methods

Creation: Development of the aetiology in delirium-diagnostic support tool (AiD-DST) against standard criteria;

Validation: Performance of AiD-DST against reference standard diagnosis, based on clinical assessment from two independent consultant geriatricians.

Transposition: A development and evaluation life cycle of improvement was used. In phase 1, alpha testing among the development group evaluated technical performance of AiD-DST. In phase 2, we performed a cycle of beta testing among junior doctors to assess impressions of AiD-DST using Think Aloud methodology. We grouped responses into themes and made changes to AiD-DST by the development group accordingly. In phase 3, usability and acceptance of AiD-DST was assessed using the mHealth App Usability Questionnaire (MAUQ).

Implementation: A real-world implementation study of the AiD-DST within a general medical ward of a metropolitan hospital was conducted over a 10-week period. A mixed method evaluation was performed based upon the standard RE-AIM Framework of implementation that incorporates reach, effectiveness, adoption, implementation and maintenance of an intervention.

Discussion

The aetiology in delirium DST (A-iD-DST) is a valid diagnostic support tool in the identification of cause(s) in delirium. After a process of optimisation, AiD-DST was successfully transposed into a digital format and shown to be usable and useful. Local implementation was successful and AiD-DST is now used as part of usual care at TPCH. The instrument is expected to deliver compliance with safety and quality standards, revolutionise care delivery and outcomes in the management of delirium.

References

https://doi.org/10.56392/001c.37365.

https://pubmed.ncbi.nlm.nih.gov/39985249/

https://pubmed.ncbi.nlm.nih.gov/33301574/

Key contact

Dr Eamonn Eeles

Senior Medical Officer, Geriatric Medicine

Metro North Hospital and Health Service

Email: Eamonn.eeles@health.qld.gov.au