Psychotherapy research is at a watershed. The supremacy of the randomised controlled trial (RCT) as the gold-standard measure of therapy鈥檚 efficacy is increasingly being challenged. The last couple of decades have seen a torrent of these trials sweep counselling and psychotherapy, kicking and screaming, towards manualised, technique-driven approaches that more closely resemble the medical treatments that RCTs were designed to test. Lately, the force of the torrent has perhaps lessened, checked by a growing number of studies and reviews that question RCT findings and their validity, especially those on the efficacy of CBT. There is also an emerging recognition that large sets of data collected from routine practice have much to tell us about what 鈥榳orks鈥� in therapy.
Even NICE, the UK鈥檚 supreme arbiter of clinical effectiveness, seems to be faltering: publication of the revised guideline on treating adult depression keeps being shifted further back, with no explanation. There are many who hope that, finally, NICE is listening to its critics who say its hierarchy of evidence is too narrow, that RCTs are only one way of assessing the effectiveness of psychotherapies and that they don鈥檛 give a full enough picture to be used as the primary, gold-standard measure.
Naomi Moller, joint Head of Research at 香港六合彩精准资料, is among those leading this critique. 鈥業n my view, it鈥檚 the funding context and the politics that drives a lot of the RCT research. RCTs offer a great method to compare treatments. My issue is that focusing so much on one factor means ignoring all the other factors that might make a difference 鈥� like therapist or services variables. It also often means ignoring process 鈥� the complex, detailed stuff that happens in the room. But in today鈥檚 NHS, if you can鈥檛 evidence that your therapy approach 鈥渨orks鈥�, it won鈥檛 get commissioned.鈥�
Robert Elliott, Professor of Counselling at the University of Strathclyde, calls it a horse race, 鈥榓nd as soon as you have a horse race, you get people cheating鈥�. He says this with tongue in cheek, but there鈥檚 a serious underlying message. 鈥楾he thing about the horse-race effect is that it is used to gain power over other people: research has become about politics not science.鈥�
Andy Rogers agrees. A university and college counselling service co-ordinator, he is a vocal critic of the direction in which he believes the counselling establishment is taking his profession. 鈥楨very therapeutic approach wants validation by NICE. The political reality is that we are all vying for dominance and legitimacy, and that鈥檚 to do with the power of the NHS. As the biggest employer of counsellors in the UK, it has a distorting effect on what is involved in our professional practice.鈥�
The 鈥榗heating鈥� is not necessarily deliberate. As a paper published last autumn in the leading US medical journal JAMA reveals,1 it鈥檚 simply that RCTs are not the unflawed, objective, super-scientific model they have been made out to be. Researchers at the University of Giessen in Germany found that just 17% of the RCTs used to demonstrate the efficacy of CBT for anxiety and depression were of 鈥榟igh quality鈥�; that more than 80% of trials of CBT for anxiety and 44% of those for depression compared it with a waiting list control group, which 鈥榠s not a strong proof of efficacy and may lead to overestimating the efficacy of CBT鈥�. They raise the problem of 鈥榬esearcher allegiance鈥� (or bias, more bluntly), which they say is highly likely to have occurred in several major CBT studies, skewing the results (in one, a study of therapy for trauma, the therapists in the non-CBT comparison group were not allowed to directly address the trauma). CBT, they conclude, 鈥榠s not a panacea鈥�, and by implication, RCTs are not either.
Others would say they are also a very blunt instrument that is ill-suited to the highly complex, multifaceted processes of counselling and psychotherapy, the outcomes of which are dependent on the interplay of a huge array of interpersonal factors between therapist and client and all the other, external influences on both of them. No single research method is going to paint a true picture of the process.
Social healing
鈥楶sychotherapy is social healing. It鈥檚 not surprising it鈥檚 so difficult to research,鈥� says Bruce Wampold, Emeritus Professor of Counseling Psychology at the University of Wisconsin鈥揗adison and a much-cited authority in the world of therapy effectiveness research. RCTs are the wrong method, measuring the wrong things, he argues: 鈥楾he NHS in England has wasted an immense amount of money training therapists to deliver CBT without any evidence of improvement in outcomes. CBT is effective, but it鈥檚 no better than any other treatment given by skilled practitioners.鈥�
Mick Cooper, Professor of Counselling Psychology at Roehampton University, says it is unrealistic to entirely dismiss RCTs and their contribution to our understanding of therapy outcomes. He is currently leading a major RCT, the ETHOS study, on the effectiveness and cost-effectiveness of humanistic, school-based counselling. 鈥楻CTs are not the source of all evil. What they do well is give us an indication of the average effect and average cost-effectiveness of a particular intervention. They have their limitations 鈥� they are not always representative of particular client sub-groups and what is done in real-life clinical practice 鈥� but they do allow a comparison of what happens when you do something and when you don鈥檛, and that鈥檚 often what commissioners want to know.
鈥榃hen a commissioner says, 鈥淲hy should I be paying you for providing this therapy?鈥�, you need to have studies showing that what you do is, overall, effective,鈥� he says. 鈥楶resenting them with a copy of Rogers鈥� The necessary and sufficient conditions of therapeutic personality change is unlikely to convince. Qualitative research is critical to our field, but we鈥檝e yet to work out how to use it to inform national clinical guidelines. That is an important area for further work.鈥�
Pim Cuijpers, Professor of Clinical Psychology at the Vrije Universiteit Amsterdam, is a leading authority on RCTs for depression. He led the 2016 meta-analysis that the JAMA paper cites as conclusively exploding the claims for CBT鈥檚 superiority over other kinds of talking therapy.2 Nevertheless, while he unhesitatingly points out the flaws in the current RCT evidence base for talking therapies for depression, he also argues that RCTs are an essential tool in healthcare research: 鈥楻CTs are the only method that enables you to establish that it is the therapy that makes the difference, not other factors outside the therapy room 鈥� which is often the case with a condition like depression. People can get better spontaneously and then think that, because they are in therapy, that is the reason, and it鈥檚 not necessarily true.
鈥楾here are a lot of alternative therapies that have very satisfied patients who swear that they were helped by them, and therapists who are sincerely convinced that their approach is highly effective, when it is not so,鈥� he says. 鈥楾he only way to distinguish this kind of practice from serious treatments is by doing RCTs. Any other kind of research does not result in scientifically strong evidence. Without RCTs, all you have is opinion from clinicians and patients about what works. It鈥檚 the same across all medicine, it鈥檚 not only psychotherapy.鈥�
So, if RCTs don鈥檛 give the full, or even accurate, picture, what does? Most counsellors and therapists will be familiar with the so-called dodo bird verdict: 鈥楨verybody has won and all must have prizes.鈥� Coined originally by US psychologist Saul Rosenzweig in 1936 and borrowed from Lewis Carroll鈥檚 book Alice in Wonderland, it answers the perennial question of whether particular therapy models or techniques are more effective than others 鈥� or, using Elliott鈥檚 analogy, which horse wins the race. Evidence from numerous studies shows that, across all populations and all types of presenting issues, all therapies achieve roughly the same outcomes.
Common factors
The dodo bird finding has led researchers to explore whether the magic ingredients in counselling and psychotherapy are in fact those that are common across all the modalities 鈥� the so-called common factors 鈥� not the different techniques they use. Another line of inquiry is 鈥榳hat works for whom?鈥� A therapy might be effective overall, but is it demonstrably effective, say, with depression, or with older adults, or with older adults with depression?
The common factors are legion 鈥� up to 89 have been proposed. Bruce Wampold鈥檚 2015 paper is generally regarded as the most authoritative summary of the evidence for their impact.3 Summarised, they include the alliance between therapist and client, therapist empathy, the client鈥檚 expectations of therapy, the skill of the individual therapist (鈥榯herapist effects鈥�), and the adaptation of evidence-based treatments to accommodate different cultural needs and norms (acceptability of the therapy to the client).
The importance of these variations in the client, the therapist and, indeed, the therapy service is demonstrated in a study part-sponsored by 香港六合彩精准资料 that compared outcomes from CBT and generic counselling in more than 100 IAPT services and 33,000 patients.4 The outcomes were broadly comparable, but what did make a difference across both modalities was service variables. Naomi Moller says more research efforts need to focus on drilling down into these differences if therapy is to develop its capacity to contribute meaningfully to tackling mental ill health. This means looking beyond the horse race, and in particular to the quantities of client data being harvested by IAPT. But it is also why Professor Michael Barkham鈥檚 PRaCTICED trial at the University of Sheffield is so important, because it is an RCT comparing CBT with counselling for depression in a real-life setting 鈥� an actual IAPT service.
鈥榃e have to hold on to the value of the range of research, quantitative and qualitative, process and outcome, while being pragmatic about the kind of research that is necessary to effectively influence policymakers and funders,鈥� Moller says. 鈥榃e criticised the 2018 Children and Young People鈥檚 Mental Health green paper because it totally ignores the evidence for the effectiveness of school-based counselling. We were also very critical that NICE still refuses to accept the relevance of findings based on large routine outcome datasets like the IAPT dataset, and that the latest depression guideline revision didn鈥檛 bother to update the service-user experience part. It is shameful not to look at the research on users鈥� preferences when there is so much research showing that it makes a difference to outcomes in therapy.鈥�
Where to now?
Miranda Wolpert, Professor of Evidence-based Practice and Research at University College London, thinks therapy research is too much focused on the competing modalities and what goes on inside the counselling room. Rather, research should look at external factors in clients鈥� lives and the resources that contribute to client behaviour change, so therapy can build on them in the counselling relationship. 鈥榃e need to move away from our obsession with modalities, and explore what people do to manage their own mental wellbeing in the 99% of their lives when they aren鈥檛 in therapy,鈥� she says. She also argues that therapy research needs to look more at 鈥榳hat works for whom鈥� 鈥� 鈥榳hat individuals and groups of individuals find helpful, in and outside of therapy, and how we tailor the therapeutic engagement and advice to the specific needs of different groups鈥�.
Robert Elliott backs change process research to drill down into the common therapeutic factors, within a pluralist approach. This combines quantitative outcome data, qualitative research into 鈥榟elpful factors鈥�, what he calls 鈥榟ermeneutic single-case efficacy studies鈥�, plus microanalyses of what happens moment by moment in the interactions between individual therapist and individual client. Change process research is by no means perfect, he says, but these very intensive case studies can be very fruitful, both for the individual therapist working with the individual client and in drawing more general conclusions from the convergence of data from several sources.
Naomi Moller says psychotherapy has much to learn from the evidence emerging from genetic and biological research. 鈥楥urrently the focus is on developing tightly specified treatments for particular presenting diagnoses and particular populations, and then trying to evidence that they indeed 鈥渨ork鈥� so that you can get your 鈥淣ICE-recommended鈥� gold star. An alternative is to focus on transdiagnostic treatment approaches that target common mechanisms that underlie a variety of mental health difficulties. In my view, this is an important area for both research and therapy development.鈥�
Bruce Wampold says research should be focusing more on developing highly skilled therapists, from the selection of students through to continuing professional development and supervision. 鈥楾he hallmark of expertise in any activity is to improve your skills over time. The therapy profession is not set up to do this. The attitude is, 鈥淟et鈥檚 see what is the most effective treatment and train everyone to do it鈥�, when what we should be doing is structuring the professional context to help therapists improve through professional development and supervision.鈥� He says looking at the influence of the organisations within which therapy is delivered is also important: the clinic environment and how clients are greeted and even spoken to on the phone by reception staff can greatly influence outcomes.
鈥榃e are not learning from each other and from our own data,鈥� says John McLeod, Visiting Professor of Psychology at Oslo University and Therapy Today Research Editor. He would like to see more research within agencies and organisations delivering therapy, using their outcomes and client feedback to continuously assess and improve what they offer, in an action research cycle. 鈥楾here is very little research that follows this cycle through. More typically, someone does a study and says the implications are such and such, and it stops there. No one does the follow-through to find out if, when they adopted the recommendations, it made a difference.鈥�
He also agrees with Wampold: 鈥業t鈥檚 pretty evident from research that some therapists get much better results than others. We should be using research to look at why that is so and whether feeding that back into CPD for therapists or particular types of supervision does result in better outcomes.鈥� This is what Tony Rousmaniere has dubbed 鈥榙eliberate practice鈥�.5
Relational inquiry
Art Bohart, emeritus professor, retired clinical psychologist and author of countless books and papers on person-centred counselling, says it is the client who is the most important common factor in counselling: 鈥業t is the client who makes the therapy work. Mobilising their creativity and resilience may be the most important factor in therapy.鈥� This necessarily also embraces factors in their life outside the therapy room that impact on their emotional and mental wellbeing. 鈥楾herapy is a complex, interactive process between the therapist and an intelligent being, who is not only being acted on by the therapist but has a life outside the therapy room, where they get ideas from all kinds of other people and influences, put it together with what they are learning in therapy and generate their own ideas. There will never be a simple relationship between what the therapist does and outcomes. The effect emerges from the interaction. We would be far better investigating what happens in that process.鈥�
Case studies are, he argues, much more sensitive than RCTs to the nuances of the therapeutic process: 鈥楥ase studies may not have the rigour of an RCT, but I believe, by piecing together what went on in sessions and changes in the client, you can begin to set out a plausible relationship between them. If you do that with a number of cases, you would get a relatively strong convergence of evidence that is much more faithful to the reality of the therapy process.鈥� That said, he emphasises that there is still a need for RCTs: 鈥業t will be the convergence of case studies with RCTs that will produce the most informative insights into how psychotherapy works and whether it works at all.鈥�
Andy Rogers disputes what he regards as the reification of research, which he thinks has become something of a 鈥榗ondition of worth鈥� 鈥� you can only be a 鈥榞ood therapist鈥� if you are reading and applying the research. So often, studies end with a recommendation for further research and a list of its limitations; how is that helpful to the practitioner, he asks? He cites Dave Mearns, who wrote that what goes on in person-centred therapy 鈥� listening to clients, moment by moment tracking what is going on, following the threads of what is being communicated 鈥� is an act of research itself. 鈥楥ounselling is a process of relational inquiry into human being; two people together exploring human distress and its meaning; empathic investigation. But these days we have to wear this new garb of the scientific, evidence-based practitioner to meet the demands of the NHS and win contracts and favour in the corridors of power. It removes us from the artfulness of therapy, the collaborative process where you are alongside someone who is fixing things themselves, and it鈥檚 OK not to know, to be a step behind the client.鈥�
Bringing us crashing back to earth, Pim Cuijpers points out there are no hard data to support the common factors hypothesis, and we are unlikely to get them: 鈥楳aybe they are the key but we simply don鈥檛 know, because it requires a lot of money to do this research, and in this field, we don鈥檛 have it. To look at specific factors, you need to conduct dismantling studies, and to do that, you need at least 500 people for each component. And even then, even if you examine all these mediators, moderators and mechanisms one by one, you won鈥檛 get a definitive answer. RCTs can only show that therapies work, not how. Showing how scientifically is much more complicated. It鈥檚 the same for any other area of biomedical science.鈥�
He says we already know the answer to the question about the most effective way to apply therapy to achieve the greatest impact: employ more, less highly trained therapists to deliver guided self-help to as many people as possible. It sounds a lot like IAPT.
鈥楾he overall effects of treatment with any therapy are very small. A lot of mental health problems can be solved by low-intensity therapies. That doesn鈥檛 mean some people don鈥檛 need longer treatment, but if we want to make a difference to the burden of mental ill health, we should focus on the larger numbers with common disorders, using the least costly, effective interventions, not the few with chronic illness,鈥� Pim Cuijpers says.
Mick Cooper wants counselling as a profession to engage much more with research. 鈥楢 research culture tends to be missing in our field. Often, students are being taught theory developed back in the 1950s and 60s, without reference to more recent developments and findings. In some respects, that is why CBT is ahead in the horse race. CBT practitioners are often trying out new methods and learning from the evidence of what鈥檚 working. I don鈥檛 hear many CBT people say, 鈥淏eck said this in 1970 and we can鈥檛 do it any other way.鈥濃�� He says it鈥檚 ironic that therapy is all about helping people who are stuck in certain ways of being that might have been helpful at the time but are now holding them back. 鈥楢s therapists, we can also get stuck in fixed theoretical positions that don鈥檛 evolve, and that鈥檚 stagnating. Research 鈥� both quantitative and qualitative 鈥� can be a means of helping us to get unstuck.鈥�
Ultimately, of course, what gets researched comes down to funding and politics. There is very little funding for mental health research across the board, and those who pay the piper get to call the tune. The danger is that, as John McLeod points out, amid the jockeying for pole position in the horse race and fighting for the survival of our own schools and modalities, 鈥楶eople seem to have forgotten the whole point of therapy 鈥� to help clients who come to us get better鈥�.
Pim Cuijpers and Robert Elliott are both keynote speakers at the 24th 香港六合彩精准资料 Research Conference on 11鈥�12 May in London.
Catherine Jackson is Editor of Therapy Today
References
1. Leichsenring F, Steinert C. Is cognitive behavioral therapy the gold standard for psychotherapy? JAMA 2017; 318(14): 1323-1324. doi:10.1001/jama.2017.13737
2. Cuijpers P, Cristea IA, Karyotaki E et al. How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence. World Psychiatry 2016; 15(3): 245鈥�258.
3. Wampold BE. How important are the common factors in psychotherapy? An update. World Psychiatry 2015; 14: 270鈥�277.
4. Pybis J, Saxon D, Hill A, Barkham M. The comparative effectiveness and efficiency of cognitive behavioural therapy and generic counselling in the treatment of depression: evidence from the 2nd UK National Audit of psychological therapies. BMC Psychiatry 2017; 17: 215.
5. Rousmaniere T. Deliberate practice for psychotherapists. London: Routledge; 2016.