Beyond metrics?

Utilizing 'soft intelligence' for healthcare quality and safety

Graham P Martin, Lorna McKee, Mary Dixon-Woods

Research output: Contribution to journalArticle

54 Citations (Scopus)
3 Downloads (Pure)

Abstract

Formal metrics for monitoring the quality and safety of healthcare have a valuable role, but may not, by themselves, yield full insight into the range of fallibilities in organizations. 'Soft intelligence' is usefully understood as the processes and behaviours associated with seeking and interpreting soft data-of the kind that evade easy capture, straightforward classification and simple quantification-to produce forms of knowledge that can provide the basis for intervention. With the aim of examining current and potential practice in relation to soft intelligence, we conducted and analysed 107 in-depth qualitative interviews with senior leaders, including managers and clinicians, involved in healthcare quality and safety in the English National Health Service. We found that participants were in little doubt about the value of softer forms of data, especially for their role in revealing troubling issues that might be obscured by conventional metrics. Their struggles lay in how to access softer data and turn them into a useful form of knowing. Some of the dominant approaches they used risked replicating the limitations of hard, quantitative data. They relied on processes of aggregation and triangulation that prioritised reliability, or on instrumental use of soft data to animate the metrics. The unpredictable, untameable, spontaneous quality of soft data could be lost in efforts to systematize their collection and interpretation to render them more tractable. A more challenging but potentially rewarding approach involved processes and behaviours aimed at disrupting taken-for-granted assumptions about quality, safety, and organizational performance. This approach, which explicitly values the seeking out and the hearing of multiple voices, is consistent with conceptual frameworks of organizational sensemaking and dialogical understandings of knowledge. Using soft intelligence this way can be challenging and discomfiting, but may offer a critical defence against the complacency that can precede crisis.

Original languageEnglish
Pages (from-to)19-26
Number of pages8
JournalSocial Science & Medicine
Volume142
Early online date31 Jul 2015
DOIs
Publication statusPublished - Oct 2015

Fingerprint

Quality of Health Care
Intelligence
intelligence
Safety
National Health Programs
Hearing
data access
Organizations
Interviews
triangulation
qualitative interview
quantification
aggregation
Values
health service
Healthcare
manager
leader
monitoring
interpretation

Keywords

  • patient safety
  • healthcare quality metrics
  • knowledge management
  • England

Cite this

Beyond metrics? Utilizing 'soft intelligence' for healthcare quality and safety. / Martin, Graham P; McKee, Lorna; Dixon-Woods, Mary.

In: Social Science & Medicine, Vol. 142, 10.2015, p. 19-26.

Research output: Contribution to journalArticle

Martin, Graham P ; McKee, Lorna ; Dixon-Woods, Mary. / Beyond metrics? Utilizing 'soft intelligence' for healthcare quality and safety. In: Social Science & Medicine. 2015 ; Vol. 142. pp. 19-26.
@article{1c5b34cee385455ebbae42188981285e,
title = "Beyond metrics?: Utilizing 'soft intelligence' for healthcare quality and safety",
abstract = "Formal metrics for monitoring the quality and safety of healthcare have a valuable role, but may not, by themselves, yield full insight into the range of fallibilities in organizations. 'Soft intelligence' is usefully understood as the processes and behaviours associated with seeking and interpreting soft data-of the kind that evade easy capture, straightforward classification and simple quantification-to produce forms of knowledge that can provide the basis for intervention. With the aim of examining current and potential practice in relation to soft intelligence, we conducted and analysed 107 in-depth qualitative interviews with senior leaders, including managers and clinicians, involved in healthcare quality and safety in the English National Health Service. We found that participants were in little doubt about the value of softer forms of data, especially for their role in revealing troubling issues that might be obscured by conventional metrics. Their struggles lay in how to access softer data and turn them into a useful form of knowing. Some of the dominant approaches they used risked replicating the limitations of hard, quantitative data. They relied on processes of aggregation and triangulation that prioritised reliability, or on instrumental use of soft data to animate the metrics. The unpredictable, untameable, spontaneous quality of soft data could be lost in efforts to systematize their collection and interpretation to render them more tractable. A more challenging but potentially rewarding approach involved processes and behaviours aimed at disrupting taken-for-granted assumptions about quality, safety, and organizational performance. This approach, which explicitly values the seeking out and the hearing of multiple voices, is consistent with conceptual frameworks of organizational sensemaking and dialogical understandings of knowledge. Using soft intelligence this way can be challenging and discomfiting, but may offer a critical defence against the complacency that can precede crisis.",
keywords = "patient safety, healthcare quality metrics, knowledge management, England",
author = "Martin, {Graham P} and Lorna McKee and Mary Dixon-Woods",
note = "Copyright {\circledC} 2015 The Authors. Published by Elsevier Ltd. All rights reserved. Acknowledgments We acknowledge with gratitude our colleagues on the wider study, especially Janet Willars, who undertook most of the interviews used in this article. We would also like to thank the study's participants, and three anonymous peer reviewers. We thank the United Kingdom Department of Health Policy Research Programme (grant number 0770017) for funding this research programme of which this study was a part. Mary Dixon-Woods’ contribution was supported by a Wellcome Trust Senior Investigator award (grant number WT097899MA). Graham Martin's contribution to writing up the paper was supported by the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care East Midlands. The views and opinions expressed herein are those of the authors, and do not necessarily reflect those of the Policy Research Programme, the NHS, the NIHR, or the Department of Health.",
year = "2015",
month = "10",
doi = "10.1016/j.socscimed.2015.07.027",
language = "English",
volume = "142",
pages = "19--26",
journal = "Social Science & Medicine",
issn = "0277-9536",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Beyond metrics?

T2 - Utilizing 'soft intelligence' for healthcare quality and safety

AU - Martin, Graham P

AU - McKee, Lorna

AU - Dixon-Woods, Mary

N1 - Copyright © 2015 The Authors. Published by Elsevier Ltd. All rights reserved. Acknowledgments We acknowledge with gratitude our colleagues on the wider study, especially Janet Willars, who undertook most of the interviews used in this article. We would also like to thank the study's participants, and three anonymous peer reviewers. We thank the United Kingdom Department of Health Policy Research Programme (grant number 0770017) for funding this research programme of which this study was a part. Mary Dixon-Woods’ contribution was supported by a Wellcome Trust Senior Investigator award (grant number WT097899MA). Graham Martin's contribution to writing up the paper was supported by the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care East Midlands. The views and opinions expressed herein are those of the authors, and do not necessarily reflect those of the Policy Research Programme, the NHS, the NIHR, or the Department of Health.

PY - 2015/10

Y1 - 2015/10

N2 - Formal metrics for monitoring the quality and safety of healthcare have a valuable role, but may not, by themselves, yield full insight into the range of fallibilities in organizations. 'Soft intelligence' is usefully understood as the processes and behaviours associated with seeking and interpreting soft data-of the kind that evade easy capture, straightforward classification and simple quantification-to produce forms of knowledge that can provide the basis for intervention. With the aim of examining current and potential practice in relation to soft intelligence, we conducted and analysed 107 in-depth qualitative interviews with senior leaders, including managers and clinicians, involved in healthcare quality and safety in the English National Health Service. We found that participants were in little doubt about the value of softer forms of data, especially for their role in revealing troubling issues that might be obscured by conventional metrics. Their struggles lay in how to access softer data and turn them into a useful form of knowing. Some of the dominant approaches they used risked replicating the limitations of hard, quantitative data. They relied on processes of aggregation and triangulation that prioritised reliability, or on instrumental use of soft data to animate the metrics. The unpredictable, untameable, spontaneous quality of soft data could be lost in efforts to systematize their collection and interpretation to render them more tractable. A more challenging but potentially rewarding approach involved processes and behaviours aimed at disrupting taken-for-granted assumptions about quality, safety, and organizational performance. This approach, which explicitly values the seeking out and the hearing of multiple voices, is consistent with conceptual frameworks of organizational sensemaking and dialogical understandings of knowledge. Using soft intelligence this way can be challenging and discomfiting, but may offer a critical defence against the complacency that can precede crisis.

AB - Formal metrics for monitoring the quality and safety of healthcare have a valuable role, but may not, by themselves, yield full insight into the range of fallibilities in organizations. 'Soft intelligence' is usefully understood as the processes and behaviours associated with seeking and interpreting soft data-of the kind that evade easy capture, straightforward classification and simple quantification-to produce forms of knowledge that can provide the basis for intervention. With the aim of examining current and potential practice in relation to soft intelligence, we conducted and analysed 107 in-depth qualitative interviews with senior leaders, including managers and clinicians, involved in healthcare quality and safety in the English National Health Service. We found that participants were in little doubt about the value of softer forms of data, especially for their role in revealing troubling issues that might be obscured by conventional metrics. Their struggles lay in how to access softer data and turn them into a useful form of knowing. Some of the dominant approaches they used risked replicating the limitations of hard, quantitative data. They relied on processes of aggregation and triangulation that prioritised reliability, or on instrumental use of soft data to animate the metrics. The unpredictable, untameable, spontaneous quality of soft data could be lost in efforts to systematize their collection and interpretation to render them more tractable. A more challenging but potentially rewarding approach involved processes and behaviours aimed at disrupting taken-for-granted assumptions about quality, safety, and organizational performance. This approach, which explicitly values the seeking out and the hearing of multiple voices, is consistent with conceptual frameworks of organizational sensemaking and dialogical understandings of knowledge. Using soft intelligence this way can be challenging and discomfiting, but may offer a critical defence against the complacency that can precede crisis.

KW - patient safety

KW - healthcare quality metrics

KW - knowledge management

KW - England

U2 - 10.1016/j.socscimed.2015.07.027

DO - 10.1016/j.socscimed.2015.07.027

M3 - Article

VL - 142

SP - 19

EP - 26

JO - Social Science & Medicine

JF - Social Science & Medicine

SN - 0277-9536

ER -