Challenges and lessons arising from early adoption of a new approach towards determining what is good clinical practice
In March 2015, 41 medical specialties of the Royal Australasian College of Physicians (RACP) came together as part of the College’s EVOLVE initiative. The main aim of EVOLVE is to drive safer, higher-quality patient care through identifying and reducing low-value medical practices.1 In EVOLVE, “low-value” practices are defined as tests, procedures or interventions that are overused, inappropriate or of limited effectiveness (and, in extreme cases, potentially harmful). The name of the initiative reflects the dynamic and evolving nature of evidence-based medicine. EVOLVE is modelled on the Choosing Wisely initiative in the United States and similar initiatives underway in Canada, Italy and the United Kingdom.2
In EVOLVE’s first year, more than 20 specialties have completed or commenced work on lists of “top-five” low-value clinical practices in their respective fields. Here, we examine the approaches of three early adopter EVOLVE specialties — geriatric medicine, palliative medicine and rheumatology. We also share insights that have arisen so far that are relevant to the Medicare Benefits Schedule (MBS) Review Taskforce.
The EVOLVE approach
EVOLVE recognises the breadth of physicians’ practice, uniting specialties through their commitment to reducing low-value care. It is a partnership between specialty societies and the RACP. EVOLVE is clinician-led, with each specialty responsible for developing lists, engaging with its members and providing feedback to the RACP on systemic barriers to adoption of each list’s recommendations. The RACP is the umbrella body, developing common frameworks and a robust methodology, coordinating across and between specialties, connecting EVOLVE with associated initiatives such as Choosing Wisely Australia, and communicating about and advocating for high-value care.
To avoid the early mistakes of Choosing Wisely in the US, where some participating specialties identified “low-impact” practices on their lists and singled out clinical practices performed by other specialties,3 EVOLVE’s participating specialties agreed to robust principles and methods. These included:
-
Practices under consideration by each specialty should be “within or significantly impact their domain of practice”. This can be interpreted as including practices involving shared decision making with other health care specialties and those that are the subject of referral to and from other specialties. Specialties also have broad discretion to consider practices that they consider can “make a difference” in reducing low-value care (eg, rheumatologists and geriatric medicine specialists examined practices that affected people with conditions they commonly treated).
-
Practices under consideration should be either growing in use or currently commonly used. Some specialties interpreted “commonly used” as encompassing cost, not just volume (eg, rheumatologists excluded from consideration practices that were not very costly to the health care system).
-
Use of the Delphi method4 as the overarching methodology for identifying a top-five list.
The three specialties reviewed the US and Canadian Choosing Wisely lists as part of their development process, but this was not a substitute for formulating their own lists, as not every international practice is relevant to Australia. For example, performing whole-body bone scans (eg, scintigraphy) for diagnostic screening for peripheral and axial arthritis is included in the Canadian rheumatology list but is not material to Australia.
Three Delphi method case studies
EVOLVE recommends use of the Delphi method for identifying low-value care practices, in keeping with initiatives elsewhere.5 This survey-based approach derives consensus based on purposive sampling of experts in the field of interest, panellist anonymity and iterative questionnaire presentation.4
There were three subtle differences in the way the method was applied by the specialties:
-
Both geriatric medicine and palliative medicine working groups consulted their memberships early in the process to seek comment on provisionally identified practices and suggest new ones. Only after processing membership feedback and refinement of the provisional list was an evidence review conducted.
-
Both geriatric medicine and palliative medicine working groups shortlisted their identified practices by requiring respondents to assign scores to each practice based on multiple criteria. Geriatric medicine used seven criteria, while palliative medicine used three. “Strength of evidence”, “significance” and “opportunity to make a difference” were criteria common to both.
-
Rheumatology recruited additional members (including three trainees) into the working group so they could invest effort in building on the RACP’s initial evidence review. With this larger working group, they could break into smaller teams and assign to each team a practice for further research. The evidence was summarised in an online survey distributed to the broader membership, with links to a full discussion of the evidence embedded in the survey questions.
Remaining challenges
Notwithstanding EVOLVE’s established principles and methods, some challenges remain.
First, without a requirement for compulsory participation, there is an element of self-selection in participation in specialty working groups and surveys. It is unclear whether this will lead to bias in the list of practices compiled for investigation and final shortlisting.
Second, there may be a risk of limited buy-in by specialty members if survey participation rates are low or if consensus cannot be reached, potentially reducing the impact of EVOLVE lists on clinician behaviour. The rheumatology working group aims to overcome this by encouraging high survey participation and by requiring that each top-five list practice be selected by at least 70% of survey respondents, in the hope that this represents a sufficiently high threshold for buy-in.
Third, ensuring that practices being considered are commonly used or increasing in use is difficult. For some practices, regularly collected publicly available data are incomplete (eg, MBS data that do not cover all hospital-provided services or do not provide sufficiently detailed breakdowns by indication). In other cases, the judgement of survey respondents or working group members (most of whom are in active clinical practice) was relied upon to remove practices considered irrelevant because of low levels of use.
Fourth, due to the clinical expertise required to formulate EVOLVE lists, the process is specialist-dominated. Nevertheless, achieving buy-in from consumers and non-RACP clinicians is critical, as sustaining changes in clinical practice requires cooperation from these groups. This task will benefit from support from Choosing Wisely Australia, led by NPS MedicineWise, to which EVOLVE is a contributor.
Finally, implementation of the EVOLVE recommendations into practice will be the greatest challenge. A recent study of the Choosing Wisely campaign in the US found significant declines being achieved in only two of seven low-value services identified by the campaign.6 Translating the EVOLVE recommendations into clinical practice requires both consumer and clinician education and a systemic cultural shift towards high-value care. This might be achievable if there is a systematic and coordinated approach, but a substantial investment in time and support may be required to ensure that the aims of EVOLVE are achieved and are sustainable over time.
Insights relevant to the MBS Review Taskforce
The MBS Review Taskforce’s early work has focused on identifying “obsolete” MBS items.7 EVOLVE’s focus is on reducing low-value care. Use of the 23 obsolete items identified by the Taskforce will, by definition, be declining, so aiming to reduce their use will have minimal impact. By contrast, one of the EVOLVE criteria is that the practice examined is commonly used or growing in usage.
A critical EVOLVE insight is that few practices are unambiguously low value for all clinical indications, and low-value care is contextual. Hence, there will be few genuinely low-value clinical practices that could be reduced by deleting particular MBS items.
Clinical practice is more likely to be improved by ensuring tests and treatments are targeted at people with appropriate clinical indications. The following low-value practices identified by the three specialties illustrate the importance of this:
-
use of ultrasound imaging to guide glucocorticoid injections into the shoulder or lateral hip compared with non-image-guided injections (rheumatology)
-
use of antipsychotics as the first choice to treat behavioural and psychological symptoms of dementia (geriatric medicine)
-
use of oxygen therapy to treat non-hypoxic dyspnoea in the absence of anxiety and as routine treatment at the end of life (palliative medicine).
Although these three practices identify low-value applications of ultrasound imaging, antipsychotics and oxygen therapy for specific indications or groups, this does not justify withdrawing subsidies entirely from these tests and treatments, as they are valuable in other clinical contexts.
While some clinical change can be induced by restricting conditions under which particular MBS items are covered, our examples also illustrate the limits of this approach. First, there are tests and treatments that are at risk of being misused but are not funded by the MBS. Second, imposing additional restrictions on the use of MBS items does not guarantee adherence unless proof of correct indication is required.
Financial incentives have been found to have limited effectiveness in driving sustained changes in clinical practice.8 Thus, it is likely that a systems-based approach employing multiple complementary strategies is needed. Initiatives like EVOLVE, that create endorsed and recognised peer judgements on what is good clinical practice, combined with other strategies such as the current MBS Review and mechanisms to improve clinician and consumer understanding of what constitutes low-value care, are needed. Working together, such strategies may shift clinician behaviour and consumer preference towards opting for the most appropriate evidence-based tests and treatments.