From acupuncture to vitamin D: engaging the experts when the evidence is equivocal
Merriam Webster Dictionary describes science as ‘the state of knowing’ and yet, despite amazing advances, there remain many unknowns in science. Knowing that we don’t know is as important as knowing that we do; it instils vigilance and instigates research. It also guards against overconfidence.
Former US Secretary of Defense Donald Rumsfeld famously described the different types of knowing (NATO, 2002). Likewise in healthcare there are the ‘known knowns’ (for example that pressure damage will likely occur when bony prominences rest against a hard surface for a period of time) and the ‘unknown unknowns’ (waiting to be discovered). Cochrane Reviews help to identify and expose the ‘known unknowns’: areas where the evidence is equivocal. Take as an example a recent Cochrane Review investigating ways to prevent or delay development of type 2 diabetes in those with prediabetes. In her blog about the review, Catriona Hilton notes that the review authors found that “it isn’t clear whether diet or increased physical activity alone are effective…It is uncertain whether diet and exercise affect the risk of heart disease, stroke or death in people with prediabetes” (Hilton, 2018).
I have delved deep into the Cochrane Library to discover the known unknowns in relation to subjects as diverse as catheter care, vitamin D, dementia drugs and, most controversially, whether acupuncture really works for everything from migraine to menopause.
The Known Unknowns (thanks to Cochrane)
In my first ever blog for Evidently Cochrane, focussing on catheter care, Cochrane Reviews helped me to see that we do not yet know whether silicone or silver coated catheters reduce infection (the studies were too small and the confidence intervals too wide); insufficient data exist to provide reliable evidence about the benefits or harms of catheter washout policies; one small, underpowered study with inconsistent data failed to show any advantage to antibiotic prophylaxis at time of catheter change (Cowan, 2017).
The evidence is also equivocal when it comes to use of vitamin D in multiple sclerosis.
The evidence is also equivocal when it comes to use of vitamin D in multiple sclerosis (MS) (Cowan, 2018). Some patients report reduced relapses and slowed symptoms but a Cochrane Review states that “the current level of evidence for the effectiveness of vitamin D supplementation in the management of people with MS is based on a single RCT with potential high risk of bias, which does not at present allow confident decision-making about the use of vitamin D in MS” (Jagannath et al, 2010). It remains a known unknown.
In my second blog for Evidently Cochrane, I researched rivastigmine, the dementia drug (Cowan, 2017a). Whilst rivastigmine seemed to really work (in terms of cognitive scores), when data with low risk of bias for randomisation and allocation (from seven unconfounded, double-blind, randomised, controlled trials comprising a total of 3450 patients) were analysed, the evidence remained equivocal as to whether this translated into felt improvement in the lived experience of the participants and carers. Meanwhile, whether rivastigmine is useful in people with more advanced Alzheimer’s remains unknown.
Most recently I used the Cochrane library to answer questions about acupuncture. It’s a subject that divides opinion and my resulting piece for Reader’s Digest online concluded: “studies seeking to answer whether acupuncture ameliorates a range of disorders (such as depression (Smith et al, 2018), fibromyalgia (Deare et al, 2013), osteoarthritis (Manheimer et al, 2010), shoulder pain (Green et al, 2005) and acute stroke (Xu et al, 2018)) have revealed promising, but incomplete, conclusions. For the studies, and the effects seen, have often been too small to be helpful. What’s more, several studies fail to answer the most common argument against acupuncture: do some patients feel better after acupuncture because of the placebo effect and not because of the needles themselves?”(Cowan, 2018a). Acupuncture remains a known unknown.
What to do when the evidence is equivocal
One approach is to cease the practice until science proves it to be effective (if ever). In her blog for Evidently Cochrane, Teresa Chinn reflected on a decision not to administer a catheter washout while the evidence gap remains (Chinn, 2018); writing in the Mirror (the same week that I wrote my piece for Readers Digest online), Dr Miriam Stoppard called for an end to acupuncture on the NHS since “not one of the 12 [Cochrane Reviews] on acupuncture has proved the treatment effective” (Stoppard, 2018).
But is there another approach when the evidence is equivocal? Can the evidence gap be bridged using other sources? A recent blog made clear that evidence-based medicine comprises three components: the evidence itself, the patient’s preferences and values, and clinical judgement (Byatt and Chapman, 2018). When the evidence is inconclusive, expert opinion should be sought and that means asking both the clinical team and the patient.
Patient as Expert
Aristotle is said to have maintained that women have fewer teeth than men. Although he was twice married, it never occurred to him to verify this statement by examining his wives’ mouths.
How often have we, as health care professionals, forgotten to go back to the patients themselves to seek answers? It is said that, “to know the road ahead, ask those coming back”, for those who have travelled the journey of disease and disability are likely to have a wealth of experience to share.
Those who have travelled the journey of disease and disability are likely to have a wealth of experience to share.
It’s important though to gather a variety of opinions before making a decision, since “one story is good till another is told” (16th century English proverb). Sharing stories in the staff room or on social media (whilst maintaining confidentiality) can help shape and refine understanding; healthtalk is a website where thousands of people have shared their experiences on film to describe what it's really like to have a health condition such as breast cancer or arthritis (Healthtalk, 2018); the Cochrane Colloquium is this year a ‘patients included’ event, recognising the role that patients play in informing practice (Cochrane, 2017); patient forums and magazines (such as the one produced by the Spinal Injuries Association) publish stories by people with lived experience of issues such as incontinence or mobility problems (Spinal Injuries Association, 2018).
When asking patients their opinion on a practice, the Mental Capacity Act 2005 should be used (Social Care Institute for Excellence, 2016) – but can be harder to handle when the evidence is equivocal. For known knowns (such as the knowledge that eating a sugary diet will interfere with diabetic sugar control), evidence exists to support a person in making a decision; unwise or eccentric decisions are easily apparent (but the patient is still free to make that decision if deemed to have capacity). When dealing with a known unknown (such as whether rivastigmine is of benefit), the evidence gap makes it harder to support the patient in decision making; it is also harder to make a best interest decision.
For those lacking mental capacity, the long-term carer may be considered as an expert member of the decision-making team: something that I have described in another publication, drawing on first-hand experience.
Clinical team as expert
I have been privileged to work alongside experts in the fields of catheterisation, vitamin D, acupuncture and dementia care. I have liaised with continence specialist nurses who have described how they have dealt with their most complex catheter cases. Despite the evidence gap, they have seen silicone catheters really benefit some patients; catheter washouts have helped others. I have worked under elderly care doctors and interviewed acupuncturists; both can quote case studies in which treatments have worked.
I attended an inspiring talk by Oliver Gillie, previous medical correspondent for the Sunday Times and ‘committed campaigner for vitamin D’. He challenges a ‘known known’ (that sun exposure should be limited because of adverse health effects), suggesting instead that “lack of sunshine is as great a risk to health as lack of exercise or smoking” (Gillie, 2010). Here is what he has to say,
“We have to say the dermatologists have been badly wrong in telling us to avoid sunshine. This is one of those terrible errors of medical advice like telling mothers to put their babies sleeping on their fronts [previously thought to be a ‘known known’] – a position which increases the risk of choking and death. Sunshine is our most important source of vitamin D and if we avoid sunshine we make very little vitamin D and so are at greater risk of many diseases including infections. Dermatologists’ advice to avoid sunshine must have caused significant mortality. So be sure to get as much sun exposure as you can without burning and/or take a vitamin D tablet.”
As members of the clinical team ourselves, we can use our own eyes to evaluate practices where the evidence remains equivocal. What risks and benefits do you perceive when you administer the catheter washout? Does the rivastigmine drug seem to be offering relief from dementia? When did you last measure a patient’s vitamin D level? At all times, our aim should be to ‘do no harm’; we are on the frontline for monitoring for and advocating against harms.
We are on the frontline for monitoring for and advocating against harms
We can also keep an eye on the Cochrane Library: has recent evidence proved a practice to be worthwhile?
When the evidence is equivocal...
Evidence-based medicine (EBM) is defined as a systematic approach to clinical problem solving by the integration of best research evidence with real-world clinical expertise and patient values (Schlegl et al, 2017). When the best research evidence is equivocal, the other two components of the EBM triad carry more weight and should both be considered. In their blog, Kit Byatt and Sarah Chapman rightly suggest that patient preference perhaps predominates in long term conditions and end of life care decisions, whilst more weight is sometimes given to clinical experience and research evidence in the acute setting.
When the evidence is equivocal, the risk remains for disagreements. By making unknowns known, the Cochrane Library can expose evidence gaps and make clear where research is urgently needed.When both doctors and patients (or their carers) are engaged in clinical decision-making, disagreement can result and the courts have to act – as seen so heartbreakingly in the recent case of Alfie Evans (BBC, 2018). Thankfully, such cases are not commonplace, with one doctor writing that “rarely do doctors’ and parents’ wishes misalign so catastrophically that the courts are required to resolve what form of medical management is in a child’s best interests. Usually – even amid all the anguish and heartbreak of paediatric terminal illness – both clinicians and family come to recognise, however reluctantly, the point at which valiant efforts at saving life have instead become the prolongation of dying.” (Clarke, 2018).
References
BBC. Who was Alfie Evans and what was the row over his treatment? 2018. http://www.bbc.co.uk/news/uk-england-merseyside-43754949 (accessed 2nd May, 2018).
Byatt K., Chapman S. Being patient with EBM. “Just because we can, doesn’t mean we should” – supporting informed decision-making. 2018. http://www.evidentlycochrane.net/being-patient-with-ebm-supporting-informed-decision-making/ (accessed 2nd May, 2018).
Chinn T. Cochrane evidence on catheter washouts: from Twitter to the bedside. 2018. http://www.evidentlycochrane.net/cochrane-evidence-catheter-washouts/ (accessed 2nd May, 2018).
Clarke R. As an NHS palliative care doctor, I say: let Alfie Evans die with dignity. 2018. https://www.theguardian.com/commentisfree/2018/apr/26/nhs-palliative-care-alfie-evans-die-with-dignity (accessed 2nd May, 2018).
Cochrane. Announcing Cochrane Colloquium Edinburgh 2018: a Patients Included health research conference. 2017. http://www.cochrane.org/news/announcing-cochrane-colloquium-edinburgh-2018-patients-included-health-research-conference (accessed 2nd May, 2018).
Cowan H. Vitamin D: the truth behind the headlines. 2018. https://www.readersdigest.co.uk/health/wellbeing/vitamin-d-the-truth-behind-the-headlines (accessed 1st May, 2018).
Cowan H. Does acupuncture really work? 2018a https://www.readersdigest.co.uk/health/wellbeing/does-acupuncture-really-work (accessed 1st May, 2018).
Cowan H. Urinary catheter care: what does the evidence say? 2017. http://www.evidentlycochrane.net/urinary-catheter-care-evidence/ (accessed 30th April, 2018).
Cowan H. Rivastigmine reviewed: doubts about dementia drug. 2017a. http://www.evidentlycochrane.net/dementia-drugs-doubt-reviewing-rivastigmine/ (accessed 1st May, 2018).
Deare JC, Zheng Z, Xue CCL, Liu JP, Shang J, Scott SW, Littlejohn G. Acupuncture for treating fibromyalgia. Cochrane Database of Systematic Reviews 2013, Issue 5. Art. No.: CD007070. DOI: 10.1002/14651858.CD007070.pub2.
Gillie, O. Time to abandon this outdated view on staying out of the sun. 2010. https://www.independent.co.uk/voices/commentators/oliver-gillie-time-to-abandon-this-outdated-view-on-staying-out-of-the-sun-2018389.html (accessed 2nd May, 2018)
Green S, Buchbinder R, Hetrick SE. Acupuncture for shoulder pain. Cochrane Database of Systematic Reviews 2005, Issue 2. Art. No.: CD005319. DOI: 10.1002/14651858.CD005319.
Healthtalk. healthtalk.org. 2018. http://www.healthtalk.org/ (accessed 2nd May, 2018).
Hilton C. Preventing type 2 diabetes in people with ‘prediabetes’: do diet and exercise work? 2018. http://www.evidentlycochrane.net/preventing-type-2-diabetes-people-with-prediabetes-do-diet-and-exercise-work/ (accessed 30th April, 2018).
Jagannath VA, Fedorowicz Z, Asokan GV, Robak EW, Whamond L. Vitamin D for the management of multiple sclerosis. Cochrane Database of Systematic Reviews 2010, Issue 12. Art. No.: CD008422. DOI: 10.1002/14651858.CD008422.pub2.
Manheimer E, Cheng K, Linde K, Lao L, Yoo J, Wieland S, van der Windt DAWM, Berman BM, Bouter LM. Acupuncture for peripheral joint osteoarthritis. Cochrane Database of Systematic Reviews 2010, Issue 1. Art. No.: CD001977. DOI: 10.1002/14651858.CD001977.pub2.
NATO. Press conference by US Secretary of Defence, Donald Rumsfeld. 2002. https://www.nato.int/docu/speech/2002/s020606g.htm (accessed 30th April, 2018).
Schlegl E, Ducournau P, Ruof J. Different weights of the evidence-based medicine triad in regulatory, health technology assessment, and clinical decision making. 2017. Pharmaceutical Medicine; 31(4): 213-216
Smith CA, Armour M, Lee MS, Wang LQ, Hay PJ. Acupuncture for depression. Cochrane Database of Systematic Reviews 2018, Issue 3. Art. No.: CD004046. DOI: 10.1002/14651858.CD004046.pub4.
Social Care Institute for Excellence. Mental Capacity Act 2005 at a glance. 2016. https://www.scie.org.uk/mca/introduction/mental-capacity-act-2005-at-a-glance (accessed 2nd May, 2018).
Spinal Injuries Association. Forward Magazine. 2018. https://www.spinal.co.uk/learn/our-magazine/ (accessed 2nd May, 2018).
Stoppard M. There’s no proof acupuncture helps relieve pain so taxpayer shouldn’t foot bill. 2018. https://www.mirror.co.uk/lifestyle/health/theres-no-proof-acupuncture-helps-12392074 (accessed 2nd May, 2018)
Xu M, Li D, Zhang S. Acupuncture for acute stroke. Cochrane Database of Systematic Reviews 2018, Issue 3. Art. No.: CD003317. DOI: 10.1002/14651858.CD003317.pub3.