×

Antibiotic prescribing practice in residential aged care facilities – health care providers’ perspectives

Widespread and inappropriate antibiotic use in residential aged care facilities (RACFs) has been widely reported.14 This is especially concerning given emerging evidence of antibiotic resistance in RACFs.5 Further, older people are particularly susceptible to the adverse consequences of antibiotic use, including Clostridium difficile infection.6 Thus, efforts to optimise antibiotic prescribing in this population are warranted.

Existing strategies to improve antibiotic use have largely focused on the acute care setting;7 however, different approaches are needed in the RACF setting due to differences in antibiotic prescribing behaviour and organisational resources. Several studies have proposed various factors leading to the widespread prescribing of antibiotics in RACFs, including difficulty in establishing clinical diagnosis of infection and lack of onsite diagnostic facilities.1,8,9 These, however, were based primarily on anecdotal presumption rather than the individual experience of relevant health care providers.

There may be unique challenges to improving antibiotic use in RACFs; however, limited data exist. Accordingly, this study reports on the organisational workflow and workplace culture influencing antibiotic prescribing behaviour and the perceived difficulties in optimising antibiotic use in RACFs.

Methods

This study involved high-level care RACFs affiliated with four major public health care services in metropolitan and regional Victoria, Australia. It forms part of a larger study exploring antibiotic prescribing practices in RACFs. Key health care providers, namely nurses, general practitioners and pharmacists servicing individual RACFs, were recruited using a combination of purposive and snowball sampling strategies.10 Institutional ethics approvals were obtained from all participating health care service networks and Monash University. Informed consent was sought from individual participants.

Senior executive nurses, nurse unit managers (NUMs) and registered nurses (RNs) were invited to participate in one-to-one interviews or focus groups. One-to-one interviews were conducted with GPs and pharmacists. Semistructured interview guides tailored to different health care providers’ perspectives were used. All data collection and interviews were conducted by one or two interviewers (C J L and M K) between 8 January 2013 and 2 July 2013. Recruitment continued until data saturation was reached. All interviews were audio recorded and transcribed verbatim. Onsite observation of the working environment and documentation related to antibiotic prescribing was also undertaken. Field notes from onsite observations were compared with interview transcripts for discrepancies.

Data were analysed and coded for emergent themes using the framework approach.11 Data management was facilitated with NVivo version 9.0 (QSR). All transcripts were independently verified against audio recordings by C J L and M K. Data analyses were performed independently by C J L and M K for cross-validation purposes. Themes and codes were finalised at regular meetings involving all researchers.

Results

Characteristics of study sites and participants

Twelve public RACFs (with 30–100 beds per facility) within the four health care networks participated. Primary care was delivered by GPs from different practices (range, 1–19 GPs per RACF). Individual RACFs were serviced by external community pharmacies (for medication supply) and consultant pharmacists (for medication review). Sixty-one participants consented to interviews: 40 nurses (four executive nurses, 15 NUMs and 21 RNs), 15 GPs and six pharmacists (Appendix). Fifteen RNs participated in three focus groups (4–6 participants per group). Other participants were interviewed individually.

Emergent themes

These can be categorised into workflow- and culture-related factors.

Workflow-related factors

Logistical challenges with provision of medical care. An important concern cited by all informants was the lack of onsite doctors to provide immediate clinical assessment. Consequently, antibiotics were commonly prescribed by phone order, especially for minor or recurrent infections. Telephone prescription would not necessarily be followed by onsite review (Box 1, quote 1). Due to logistical barriers, GPs tended towards initiating antibiotics early rather than waiting and observing (Box 1, quotes 2 and 3). There was delay in reviewing antibiotic prescriptions, particularly among GPs without regular onsite visits. All stakeholder groups believed that reliance on locum doctors was associated with greater use of antibiotics (Box 1, quotes 4 and 5).

Pharmacy support. Half the RACFs (6/12) did not have access to onsite antibiotics for after-hours use, which sometimes hindered timely administration (Box 1, quote 6). Medication review for individual RACF residents was only performed annually by consultant pharmacists through a scheduled residential medication management review; as such, short-term courses of antibiotics were rarely reviewed. Most GPs and nurses felt that there was a limited role for pharmacists in influencing antibiotic prescribing (Box 1, quote 7). Pharmacists also perceived major challenges in guiding antibiotic use, including their offsite location, limited communication with GPs and lack of access to clinical notes (Box 1, quote 8).

Nurse-driven infection management. All participants acknowledged the significant role of nurses in driving infection management in RACFs, with mixed opinions about having such a nurse-led system. Some GPs felt confident with nursing assessment, relying primarily on nursing staff information to guide their decisions to prescribe antibiotics (Box 2, quote 1). Other GPs had negative views, commenting on rapid staff turnover, lack of experienced nurses and variability of assessment quality, especially from agency or casual nursing staff (Box 2, quote 2). Several GPs also raised concerns about overreporting and pressure to treat from nurses, leading to unnecessary antibiotic prescribing (Box 2, quote 3). From nurses’ perspectives, some emphasised their influence on GPs in initiating or changing antibiotics (Box 2, quote 4). However, many considered their responsibility in infection management overwhelming, given existing staffing and workload issues. Some also indicated a lack of confidence and knowledge in advising about antibiotic use (Box 2, quotes 5 and 6).

Institutional policy and guidelines for antibiotic prescribing. None of the participating RACFs had an antimicrobial restriction policy. Prescribing was often based on residents’ histories and antimicrobial susceptibility results, if available. In most instances, however, the type and dose of antibiotics were chosen without following guidelines or evidence, with few GPs citing use of the Australian Therapeutic guidelines: antibiotic.12 Indeed, several GPs had concerns that the guidelines are generally not applicable to the older RACF population. Pharmacists likewise claimed that choice of antibiotics used in this population did not normally follow the guidelines (Box 3, quotes 1 and 2).

There was no standardised method for infection surveillance across participating RACFs. Some (eight RACFs) used infection control practitioners and followed the McGeer definitions for infection surveillance,13 while others (four RACFs) had a self-initiated infection registry. Only one facility monitored long-term trends in antibiotic use and the benefits of this were highlighted (Box 3, quote 3).

It was routine practice at several RACFs to perform regular (monthly or bi-monthly) dipstick urinalysis for all residents, regardless of presence of symptoms. However, this practice was criticised as leading to overtreatment of asymptomatic bacteriuria, with consistent views across stakeholders supporting its abolishment (Box 3, quotes 4 and 5).

External expertise and diagnostic facilities. Most GPs rarely sought advice from infectious diseases specialists (Box 3, quote 6). External supports used included microbiologists at pathology services (regarding multidrug-resistant organisms) and mobile services from hospitals (eg, Mobile Assessment and Treatment Service and In-Reach service) for assistance in administering intravenous antibiotics.

Few of the RACFs (2/12) had onsite radiology or pathology services. Most GPs rarely ordered radiological investigations for chest infections, partly because of the difficulty in transferring debilitated residents to an external site (Box 3, quote 7). Additionally, delay in pathology sample collection often complicated the clinical decision (Box 3, quote 8). Interestingly, GPs had mixed views about the usefulness of urine cultures in guiding antibiotic treatment for urinary tract infections (UTIs) (Box 3, quotes 9 and 10).

Culture-related factors

Patient. Most GPs and nurses felt that resident frailty was an important factor in early initiation of antibiotic treatment, with many GPs also prescribing broader spectrum antibiotics (eg, amoxicillin–clavulanate as opposed to amoxicillin) for this reason (Box 4, quotes 1 and 2). Difficulties in assessing residents with behavioural problems or cognitive deficits also complicated the prescribing decisions. Among this population, correctly obtaining a urine sample for microbiological investigation was often impossible. Fever and typical urinary symptoms were often not observed in presumed UTIs, and therefore, the decision for antibiotic therapy frequently depended on less specific symptoms including changes in behavioural or functional status (Box 4, quotes 3 and 4).

Family. Pressure from family members was identified to influence antibiotic prescribing (Box 4, quotes 5 and 7). Often there were unrealistic expectations of antibiotics being prescribed for minor symptoms or to avert hospitalisation. Antibiotics were sometimes prescribed for residents in end-stage illness to fulfil family expectation.

Institutional. Several GPs felt institutional pressure to use antibiotics in order to avoid legal consequences and sometimes to prolong a resident’s life inappropriately, with most nursing staff admitting to overreporting symptoms due to fear of litigation (Box 4, quotes 8 and 9). Both GPs and nurses emphasised the importance of advance care planning in guiding antibiotic prescribing decisions (Box 4, quote 10).

Discussion

To our knowledge, this is the first study that has explored the views of key health care providers about barriers and challenges to optimising antibiotic prescribing in RACFs. One of the major concerns raised was the logistical barrier associated with lack of onsite doctors. This places heavy responsibility on nurses for infection management, a role they are generally not trained to perform. Indeed, this study highlighted a perceived lack of knowledge and guidance regarding antibiotic use among nursing staff. Further guidance and support to the nursing staff is clearly needed. Additionally, the Therapeutic guidelines: antibiotic12 were deemed not relevant to the RACF population, highlighting an unmet need.

Extending the roles of pharmacists in antimicrobial stewardship (AMS) in the RACF setting has shown positive outcomes.14,15 There is potential for consultant pharmacists to provide additional support to nursing staff, particularly with regard to education about appropriate antibiotic use and facilitating surveillance of antibiotic use. Extensive antibiotic surveillance has been common practice in the United States and in European RACFs;16,17 however, such activities are relatively scarce in Australian RACFs. Monitoring of longitudinal trends of antibiotic use and benchmarking across RACFs will be a useful starting point to improve antibiotic use.

Another recurrent theme was the influence of routine dipstick urinalysis (regardless of symptoms) on overprescribing of antibiotics for asymptomatic bacteriuria. Despite studies showing that urine dipstick tests are unreliable for identifying older residents with laboratory evidence of UTI,18 half of the participating RACFs used routine full-ward tests. Anecdotally, positive dipstick urinalysis often led to initiation of antibiotics, especially among psychogeriatric residents. This is concerning, given that treatment for asymptomatic bacteriuria has been shown to contribute to the emergence of antibiotic resistance.19,20 Accordingly, nursing staff education highlighting evidence-based practice about diagnosis and treatment of UTI should be promoted.

Empiric antibiotic prescribing without pathological or radiological investigations was found to be common practice. Reassessing antibiotic therapy according to culture and susceptibility results is critical given the increasing occurrence of multidrug-resistant organisms in the RACF setting,21,22 and particularly helpful given the GPs’ reliance on nursing staff to follow-up on the duration and outcomes of antibiotic treatment. Indeed, the recently revised McGeer criteria for infection surveillance has recommended mandatory urine culture for the diagnosis of UTIs.13 On the other hand, however, mandatory culture of urine samples regardless of obvious signs and symptoms could paradoxically lead to an increase in unnecessary antibiotic prescribing for asymptomatic bacteriuria. Thus, strict evidence-based guidelines for the indication of urine cultures and treatment of UTIs are warranted.

The pressure to prescribe antibiotics from nursing staff and family was reportedly a significant influence on antibiotic prescribing behaviour; notably, these factors are potentially modifiable. Antibiotic prescribing decisions in older patients are often difficult and controversial, particularly as part of end-of-life care.23 Studies have shown higher use of antibiotics and a greater risk of acquiring multidrug-resistant organisms among older people with advanced dementia or end-stage illness,24,25 highlighting the need to re-evaluate antibiotic prescribing in this group. Ideally, all new residents of RACFs should have an advance care plan, including decisions about future antibiotic therapy and palliation alternatives. This might prompt appropriate discussions with family and reduce pressure to prescribe in some situations.

In conclusion, significant issues with the existing organisational workflow and culture of RACFs have been identified that might contribute to poor antibiotic prescribing practices, underlying the need for targeted AMS initiatives in this setting. Further intervention should consider the limitations of institutional resources and health care professionals’ working relationships within this environment. Importantly, this study has highlighted areas and modifiable factors that will assist in developing future AMS interventions.

1 Logistical issues with offsite medical doctors and pharmacists

Issues with offsite doctors

Phone order of antibiotics

Q1: “[At the] MAC [medication advisory committee] meeting this morning they want me to sign off on a doctor that hasn’t seen her resident since she had a UTI [urinary tract infection] in February, and still hasn’t signed the drug chart … that patient hasn’t been reviewed for over 4 months, and that’s a fairly typical situation.” (GP; 27 years’ RACF experience)

Lack of instant support

Q2: “They [GPs] will prescribe something because if they don’t prescribe something it could be 3 or 4 days before that resident gets an antibiotic prescribed.” (NUM; 12 years’ RACF experience)

Q3: “You know I’m not going to come here every day and listen to their chest . . . so you tend to treat earlier.” (GP; 25 years’ RACF experience)

Difficulties of locum doctors

Q4: “And in many cases they [locum doctors] will prescribe an antibiotic because if the locum got the call out at night they think ‘I had better do something rather than nothing’.” (Pharmacist; 12 years’ RACF experience)

Q5: “They [locum doctors] have got even a lower threshold of prescribing antibiotics than perhaps I do, and it’s hard for them at 3 o’clock in the morning . . . it’s harder to assess properly, and therefore I think there is an overuse [of antibiotics].” (GP; 5 years’ RACF experience)

Issues with offsite pharmacists

Q6: “We just don’t have an Imprest [onsite source] of antibiotics. I have to fax the pharmacy and wait for the next delivery. And with the aged care, with our aged care clientele here, sometimes 4 or 6 hours, or maybe 7 hours until we get that antibiotic, they can really deteriorate rapidly. I know it sounds extreme, but that can happen with them.” (NUM; 37 years’ RACF experience)

Q7: “They [pharmacists] are not there at 6 o’clock at night when I make the decision which antibiotic to put them [residents] on and they’re not there, it’s not their role. I don’t see how they actually have a particular role. I’m happy to consider it, but I don’t see where they would fit in with the decision making of which antibiotic, the side effects or something that’s clinically assessed.” (GP; 5 years’ RACF experience)

Q8: “You see the drug chart, a course of antibiotics that happened 4 months ago, am I going to go back and look at what it was for, why it was for, did it have the right bugs? You know, it’s just, at this point in time it is irrelevant to the review of this resident’s medications.” (Pharmacist; 12 years’ RACF experience)


GP = general practitioner. NUM = nurse unit manager. Q = quote extracted from interview transcripts. RACF = residential aged care facility.

2 Mixed perceptions about nursing-driven infection management

General practitioner perspectives

Q1: “Well the nurses in fact are very good, they call me because they’re very much aware that the antibiotic
has been ordered but what suits you see. And that’s a good thing, because otherwise I’d forget the whole
story if I don’t hear anything.” (GP; 40 years’ RACF experience)

Q2: “… unfortunately from my perspective and my experience, the nursing staff are de-skilling, and I can’t
really rely on what they’re saying to a great degree … because there’s such a turnover of aged care nursing
staff, and a lot of international graduates are coming into the industry, that’s another good reason why I need
to be responsive.” (GP; 27 years’ RACF experience)

Q3: “So we don’t get really good feedback from nursing homes any more. We’re told about everything,
someone sneezed we get to hear about it … They often initiate MSUs [midstream urine tests] or urine ward
tests on their own, and report those to us, so often insisting the urge to prescribe antibiotics to people with
abnormal full ward tests or abnormal MSU even if they’re clinically well. So we do get pressured a little bit by
nursing staff to do something.” (GP; 32 years’ RACF experience)

Nursing staff perspectives

Q4: “Whereas if we’ve got a result that you know the antibiotics and the infection don’t match, we’ll call the
GP. If they have prescribed we’ll call the GP and say ‘um change’, or if they haven’t prescribed we’ll call them
and say ‘can we have a prescription’.” (NUM; 12 years’ RACF experience)

Q5: “That should be his [GP’s] role I suppose. It’s not up to me to go and check what the results are and hop on
the phone and say ‘… there’s resistant or sensitive bug, so what do you want them to have’.” (NUM; 25 years’
RACF experience)

Q6: “I am saying the patient doesn’t require antibiotic; that’s my feeling, what if my assessment is wrong? And
so we tend to follow someone else especially the GPs.” (RN; 2 years’ RACF experience)


NUM = nurse unit manager. Q = quote extracted from interview transcripts. RACF = residential aged care facility.

3 Institutional guides and external support for infection management

Institutional guides

Antibiotic policy and guidelines

Q1: “They [elderly residents] always get the acute bronchitis which the antibiotic guidelines say no evidence
that antibiotics make any difference to acute bronchitis. But what about in the 70s age group? What is the
data? Do we have any evidence? Obviously so little evidence pertains to elderly people.” (GP; 5 years’ RACF
experience)

Q2: “You will see particular prescribing habits from doctors. One particular doctor everything with the
cephalexin is always 10 days, but generally it is a 7-day course.” (Pharmacist; 4 years’ RACF experience)

Surveillance of antibiotic use

Q3: “I keep a spreadsheet so I know who’s getting antibiotics and when they’re getting them, how long
they’re on for, so I keep a note of that … I’ll start posting that [antibiotic register spreadsheet] out to all the
nursing staff … they can maybe become a bit more frontline with that as well, and saying to the doctors, you
know they [the residents] have had this [antibiotic] twice so do you not think maybe they should be using
something else.” (NUM; 9 years’ RACF experience)

Regular dipstick urinalysis

Q4: “I know staff sometimes they’re very very proactive, they’re checking urine non-stop, but in nursing
home we’re not supposed to do it, it’s not a good practice … some GPs will ask if they’re symptomatic
or asymptomatic, but some GPs they will give [antibiotic] order [without asking].” (NUM; 12 years’ RACF
experience)

Q5: “I have tried to tell every facility when they are resident of the day don’t check their urine. You know, of
course they are going to have white cell counts, of course they are going to have nitrites. I mean they are, most
of them are incontinent, they have got pads … I get frustrated with that. So I tend not to prescribe antibiotics
in those instances.” (GP; 20 years’ RACF experience)

External support

Q6: “I don’t think we rely on too much external sources for that [antibiotic prescribing], we make those calls
ourselves . . . very occasionally [I would] ring infectious diseases registrars and get advice from the major
hospitals, but that’s not very common.” (GP; 32 years’ RACF experience)

Q7: “… [Ordering investigations for] respiratory [infections], rarely, occasionally sputum [culture] if they’re not
improving. Chest x-ray, a lot of them aren’t in the position to go out and don’t want to go out. Often the next
step is if they are for hospital would be hospital.” (GP; 20 years’ RACF experience)

Q8: “Well one thing that would be helpful is the ability to get a blood test on the day if you wanted one . . .
most usually the [pathology service] they won’t come for 3 or 4 days. And if we could get immediate
pathology for what we wanted, then it would make it easier to know by the morning whether I really need to
treat it or not.” (GP; 25 years’ RACF experience)

Q9: “I would always send an MSU [midstream urine] if I suspected a UTI [urinary tract infection], because of
firstly wanting to confirm the diagnosis, and secondly wanting to make sure that there was not resistant bugs
there.” (GP; 20 years’ RACF experience)

Q10: “You see the trouble is that in terms of MSU that they are so common that every second person has it
every second week . . . So I think we are wasting resources if we order MSU every time.” (GP; 25 years’ RACF
experience)


GP = general practitioner. NUM = nurse unit manager. Q = quote extracted from interview transcripts. RACF = residential aged care facility.

4 Cultural factors related to patient, family and institutional factors influencing antibiotic prescribing behaviour

Patient factors

Q1: “I think the doctors’ kind of point of view is get them on antibiotics quite quickly before it gets any worse
or turns into anything else, so I think that’s probably part of the reason they tend to jump on antibiotics first . . .
they don’t do the tests to see actually what’s going on first, they’ll put the antibiotics out and then go from
there.” (NUM; 9 years’ RACF experience)

Q2: “First of all they don’t breathe as deeply, they’re more likely to develop pneumonia just from a cough, and
they deteriorate very very fast … So again you want to be more aggressive in terms of treatment, they’re more
likely to require things like the high powered antibiotics like ceftriaxone, for example.” (GP; 30 years’ RACF
experience)

Q3: “So a lot of our residents are incontinent so it makes it very difficult to get a clean sample for a full ward
test, but what we do do where we can’t get a sample is use a urine analysis strip to just sort of soak it in
the pad and just see if there’s any indication there. Sometimes it’s too difficult to get an MSU [midstream
urine], and doing an in-and-out catheter is not advisable to get an MSU, so we would just go mainly on the
symptoms of what we see … 99% of the time we won’t get a culture.” (NUM; 5 years’ RACF experience)

Q4: “But usually by this stage you know their behaviours have changed and they’ve got changes in their
urine . . . particularly we can’t wait to see whether it resolves, we’ve got to treat them just to get their
behaviours under control.” (NUM; 30 years’ RACF experience)

Family factors

Q5: “I think sometimes there is a potential for family members to push for use of antibiotics where they
shouldn’t have and the GP has gone with the wish of the family.” (NUM; 13 years’ RACF experience)

Q6: “Well the family, the resident and the staff … the bias is always an inappropriate expectation of the use of
antibiotics.” (GP; 5 years’ RACF experience)

Q7: “If I think it’s a viral thing and they’ve got a cough and they haven’t got fevers, I tend to kind of go ‘let’s just
see how they go’. But if the family is insistent or if they [residents] are insistent, then I do tend to prescribe
rather than argue with them.” (GP; 12 years’ RACF experience)

Institutional factors

Q8: “I would think so, because the other thing that’s happened in aged care is there’s a reluctance to let
people die from their chest infections, there’s a real push from nursing home staff to treat people. And often I
think that’s for secondary gain, you know they don’t want an empty bed, so they pressure GPs to treat people
that otherwise shouldn’t be treated.” (GP; 32 years’ RACF experience)

Q9: “I think staff sometimes worry, and that’s borne out of a litigious consciousness, and staff worry that ‘oh
my God they’ve coughed twice, better report it’. Because if they don’t report it then whose fault is that? That’s
our fault, and we don’t really like to be blamed for things. So there’s that potential to overreport I think.”
(NUM; 12 years’ RACF experience)

Q10: “Certainly in our area of work we have groups of people that are so advanced in their debility and
dementia that you have to ask the question ‘will we treat or not treat’. So there’s a bit of an algorithm
there. So I would like to think that a lot of my residents have got advance care plans.” (GP; 27 years’ RACF
experience)


GP = general practitioner. NUM = nurse unit manager. Q = quote extracted from interview transcripts. RACF = residential aged care facility.

Implementation research – its importance and application in primary care

Moving evidence from theoretical to practical levels requires a collaborative effort

The gap between what we know can optimise health care outcomes and what is everyday practice, remains a major challenge for health systems.1 Implementation research seeks to close this gap by using scientific methodologies to support the movement of research-based evidence into policy and practice.2,3 Sometimes used interchangeably with the terms translational research and implementation science, implementation research seeks to understand and maximise the uptake of quality research by potential users — in our case, the busy and complex clinical and health service environment. Interest in primary care-based implementation research is growing rapidly, as governments seek to maximise investment in research for its citizens.4

Last year, the Strategic review of health and medical research — better health through research (the McKeon Review) made 21 recommendations for improving the nation’s research quality and productivity. A focus on implementation research was central, with “strengthened partnerships between researchers, health professionals and the community”, facilitated “translation of research into evidence-based healthcare and policy” and measures to “enhance health services research” identified as important priorities.5 We are fortunate that the Australian Primary Health Care Research Institute (http://aphcri.anu.edu.au/about-us) has long promoted such strategies and encouraged our Centre of Research Excellence to explore this approach to industry–research partnership within all programs.

Research findings coming down the pipeline from clinical trials are not always fit for purpose across a complex health system. Clinical trials for efficacy emphasise internal validity, controlling for all factors except the one being tested. This means the application of these findings is frequently problematic in the real world, where external factors play a crucial role. Implementation research, with its requirement to work with end users, emphasises external validity. This highlights the need to develop hybrid designs, balancing both internal and external validity, to achieve maximum uptake.

Implementation research methodology is developing rapidly, using multiple theories and approaches to identify, operationalise and understand implementation processes, mechanisms and causal influences. There is an emphasis on mixed methods, including realistic review, hybrid efficacy–effectiveness trials, and implementation salvage to understand when and why interventions fail. In health, it often focuses on the complex barriers and enablers to the systematic uptake of evidence into routine practice. This includes an understanding of the interplay between science and health professional, and organisational behaviour, population-under-care and local delivery environment, in the adoption of new knowledge.

This supplement reports early results of a specific approach to implementation research, based on normalisation process theory6 and the co-creation paradigm.7 This approach closes the evidence–practice gap by involving end users in every step of the research process: shaping the research questions, methodological approach, implementation challenges and identifying the most important outcomes. Clinicians, managers, policymakers, consumers and bureaucrats are all involved. This process requires extensive consultation, flexibility and front-end review and adaptation.

Articles in this supplement describe the positive impact on practitioner participation, policy intelligence and end-product use. Janamian, Jackson and Dunbar report the perspectives of influential national organisations partnering with researchers to use this approach (doi: 10.5694/mja14.00273). Abou Elnour and colleagues describe surveyors’ perceptions of the impact of accreditation on patient safety in general practice (doi: 10.5694/mja14.00198). Crossland and colleagues report on the development of a quality and safety practice e-tool, co-created with a range of partners, which they then pilot tested in several general practices in Queensland (doi: 10.5694/mja14.00262). Hernan and co-workers report on patient perceptions of safety and quality in rural general practice (doi: 10.5694/mja14.00193). In a “for debate” article, Wilkinson and colleagues call for increased clarity and general practice involvement in caring for women during and after a pregnancy complicated by gestational diabetes mellitus (doi: 10.5694/mja14.00251).

Health care reform is a feature in many countries, driven by global trends such as diminishing health returns for investment in health care, and demographic trends in populations that age and become more diverse in health need. Primary health care is the generally accepted road towards a robust, cost-effective health care system,8 which makes its inclusion in research partnerships a pivotal component. An essential objective of health care reform is to respond to the needs of populations, and this requires the system to understand and adapt to local circumstances. Effective implementation research must therefore be directed bottom-up from the community, through effective and consultative partnerships at every stage.9 Although this requires a refocus on the way we conduct health services research, such relationships are essential to ensure limited investigative and implementation resources are deployed to maximum community benefit.

Key elements of high-quality practice organisation in primary health care: a systematic review

There has been a growing international evolution of the role and purpose of quality improvement in primary care; particularly in the United Kingdom, Europe, Australia and New Zealand. Research has focused on improving clinical care programs, with a corresponding focus on the identification and development of clinical measures and indicators of quality care. Subsequently, attention has been given to the role of clinical governance in the delivery of high-quality care in general practice, and exploration of the relationship between clinical management and patient health outcomes.15

The past 12 years also witnessed an international movement from funders paying for activity to paying for outcomes. The UK introduced “pay for performance” in 2002, resulting in general practices receiving up to 25% of their funding from measuring and reporting against 134 quality benchmarks.6 The United States debated options including significant bundled payments to family practitioners for quality targets.7 New Zealand developed a framework to guide clinical quality in primary care.8 Australia’s quality measures, including the Practice Incentives Program and Service Incentive Payments, were introduced in 2002, but their funding has been progressively decreased over recent years. The Royal Australian College of General Practitioners standards form the basis of Australian general practice accreditation, and include elements such as infrastructure and clinical management.9

There is a growing international consensus regarding the impact of organisational elements on the delivery of high-quality care and as enablers of successful continuous quality improvement.1012 Elements include leadership; practical and human resources; active engagement of all staff; and attention to multifaceted interventions and coordinated action at all levels of the health system, such as investment in training and development of robust and timely data through supported information technology.1315 The relationship between practice assessment, organisational development and assessment, and quality improvement is complicated. An understanding of the elements of high-performing practices may contribute to the development of organisational and cultural assessment processes, which in turn lead to organisational development relevant to primary care as part of the broader concept of successful continuous quality improvement. Conversely, undertaking successful continuous quality improvement through activities associated with organisational development, and using organisational assessment approaches may, in turn, indicate elements integral to high-quality practice performance (Box 1). Indeed, there is dearth of evidence related to the impact of organisational components of general practice and patient outcomes.16

In this article, we sought to identify elements, contained in the literature, which have been demonstrated as integral to high-quality practice performance. For the purpose of this study, practice organisation was defined as “‘systems, structures and processes aimed to enable the delivery of good quality patient care’, excluding clinical processes and clinical outcomes”.17

We defined the term tools as surveys, questionnaires or assessment instruments designed to measure overall or specific elements related to practice organisation, as defined above.

Methods

We undertook a narrative systematic literature review. The specific questions addressed were:

  • What elements (attributes or characteristics) are integral to high-quality primary care practice organisation?
  • What are the current key considerations relating to organisational performance in primary care?

Key methods are summarised below; full details can be found in Appendix 1.

We searched several electronic databases: PubMed, the Cochrane Library, CINAHL, Embase, Emerald Insight, PsycInfo, the Primary Health Care Research and Information Service (PHCRIS) website and Google Scholar. Additional articles and reports were identified through the reference lists of all reviewed studies. A complete description of the search strategy, including search terms and study eligibility criteria, is found in Appendix 2.

Data were extracted from eligible articles and reports using a data extraction form guided by the template used by Dunbar and colleagues.18

A qualitative inductive thematic approach was used to explore the discussion sections of all articles (surveys; trials; frameworks, models or approaches to organisational improvement or assessment) to explore information about the application and perceived impacts of tools and frameworks. Incorporating this information added further clarification, particularly of the relevance of identified elements to general practice settings.

Data were configured at the study level to allow for the inclusion of findings from a broad range of study types (systematic literature reviews, trials, frameworks, descriptive, knowledge-building papers and key informant discussions). Results were compared and combined to identify the elements of organisational assessment in primary health care that are integral to high-quality practice performance.

Results

A total of 241 manuscripts were obtained for review. Of these, 210 manuscripts were excluded due to no or insufficient information about the tool and elements of practice performance. Tools that focused on elements of patient safety (eg, the Frankfurt Patient Safety Climate Questionnaire for General Practices; the UK National Health Service [NHS] Manchester Patient Safety Framework – Primary Care; NHS Education for Scotland’s SafeQuest) or on the developing patient role in health care decision making (including the General Practice Assessment Questionnaire and Europep) were excluded from data extraction.1925 A full description of the systematic review screening process is presented in Box 2.

All citations were imported to Endnote. A total of 31 articles were included for data extraction, including one systematic review; 25 developmental trials or surveys of organisational assessment and tools or guides and six descriptive articles or reports. Of these, three were Australian; 13 were from the US; 14 from the UK and Europe; and two were Canadian. These articles included information on 10 organisational assessment tools or methods.

Elements identified as integral to high-quality practice performance

We identified 10 elements that were integral to high-quality organisational performance in general practice. Appendix 3 lists these elements according to the tools that include them. It should be noted that this table highlights elements that were specifically contained in the tools. However it should also be noted that several externally facilitated tools could draw out broader issues in practice management during facilitation.

The following 10 elements were most frequently included in existing organisational assessment tools:

Patientcentred approaches: This element included tailoring service delivery to the context of family and the broader local community; the importance of a community focus; use of community resources; and cultural competence in relation to a knowledge and understanding of the local community the practice serves.

Leadership and leading: This included the concepts of knowledge of, and attitudes to, practice leaders in practice organisation, administration and clinical care. The element also related to individual practice members who may lead in relation to innovation and change; it addressed concepts of effective leadership and “leading” behaviours, regardless of individual positions and roles.

Focus on staff: This element contained the concepts of staff satisfaction, autonomy, skills and professionalism. It also addressed monitoring of staff workloads and job stresses.

Clinical governance: Closely associated with the element of communication and collaboration, the element of clinical governance related to the formal systems and structures in place to ensure effective care delivery and clinical safety, such as patient complaints procedures; patient call-back processes and medicine alerts; with a specific emphasis on clinical care structures and risk management.

Multiprofessional teams: This element contained concepts of the ease of forming multiprofessional teams in practice; effective teamwork in relation to important diseases; and relationships between clinical and non-clinical staff, including understanding each other’s roles and the ability to learn through conflict.

Communication: This element encompassed a range of concepts — formal and informal processes of communication internal to the practice, including delegation; environmental and cultural factors that support effective collaboration and linkage between the practice and outside services; methods of timely referral; and sharing of patient information. It also encompassed environmental factors that supported sharing information with patients.

Education and training: This element was seen as a fundamentally important part of quality improvement. It relates to provision of, and access to, appropriate training for staff, as part of existing roles. It also included education and training tailored to changes undertaken in the practice.

Process improvement: Closely linked to the element of performance results, this element also most commonly related to clinical processes of care, the systems in place for monitoring the process of practice health care delivery, and internal improvements to the practice.

Performance results: This encompassed processes to support reporting of results of performance measures internally and externally. It included benchmarking against other services.

Information and information technology: Finally, the use of information and information technology included aspects such as the effective collection and use of information and the effective use of technology (eg, practice clinical software). This element most commonly focused on the use of patient clinical information, less common was the inclusion of information and data on practice finances and billing, and data related to human resource management. It also encompassed the sharing of patient clinical information internally, and between the practice and external services.

Three less commonly included characteristics were identified from the discussion sections of descriptive articles and trials of some tools. During the inductive thematic review, phrases were grouped into the most commonly occurring themes or attributes associated with high-quality practice performance, namely:

Incentives and rewards: This attribute included the capacity for all staff to receive recognition and reward for their work — not just financially, but also in recognition from peers, ability to attend conferences or join professional groups. Financial incentives as part of organisational development facilitated and sustained effective team-based approaches to care. However, this element was not specifically included in existing tools but was linked to discussions in organisational governance and change management.

Organisational governance: This element included the definition of a shared direction, mission and values; strategic planning and implementation; and collection and inclusion of administrative data.

Change and change management: This attribute included the ability, willingness and flexibility of the practice staff to adapt to new standards and procedures; the ability and willingness of the practice staff to make, manage and sustain change. A practice with a history of change was also identified as an important structural part of successful and ongoing performance improvement.

Synthesis of results

Combined, these 13 elements represent the characteristics of organisational context that are integral to high-performing practices (Box 3). Rather than being discrete elements, they are also interlinked. For example, the element of communication — information availability, defined as the sharing and communication of information internally and externally, is closely linked to the development of multiprofessional team-based care approaches. The element of education and training for all staff and incentives is integral to successful change management and ongoing readiness for change.

Discussion

Most existing quality improvement tools are designed for tertiary care settings or for non-health care organisations.5 Those developed for general practice and primary health care are single strategies such as audit, professional education (continuing medical education) and frameworks for patient safety and risk management. A review of organisational assessment tools used in the UK concluded that while externally led quality improvement approaches, such as accreditation, are reasonably well developed, internally led approaches are much less so.46

There are several considerations relating to organisational performance. First, a primary health care tool should define elements essential to primary health care, be sensitive to clinical management, enable the users to better understand their own practice context, and include staff in the process of identifying and addressing improvement activities of relevance. Second, as health care delivery becomes more complex and technology-driven, the organisational context in which qualitative improvement initiatives take place becomes a crucial determinant of their effectiveness.10,11 Research on primary care practice development identified these contextual elements as “adaptive reserves”, or features that represent a practice’s internal capability.47 Finally, many of the elements identified here are also organisational attributes that enable the success of practice-based improvement initiatives.13 Thus, the challenges are to develop a tool bespoke to primary care with a whole-of-practice approach; that can fit a wide range of contexts; that is relevant to the clinical management aspects of general practice and effectively takes into account organisational aspects of care; that includes elements relating to organisational culture; that is low or no cost; and that can be used effectively as part of an internally led quality improvement process.

The literature in relation to quality improvement is large and diverse; however, studies relating specifically to practice management performance are poorly defined in relation to specific search terms. We deliberately used broad search terms to capture the totality of elements, domains and characteristics included across all tools, frameworks, models and approaches.

There are presently no validated organisational improvement tools, designed specifically for primary care, which can be used internally in a best-practice approach that facilitates both organisational improvement and also raises awareness about the present culture of a practice. Based on the findings from this systematic review, we have now undertaken the development and pilot of a new internally led Primary Care Practice Improvement Tool (PC-PIT), incorporating the elements identified here.49 A national trial is now underway, and future work will explore the link between improved organisational performance and patient outcomes at the practice level. With the continued focus on the important place of general practice and primary health care in the broader health care context, and a refocus on the importance of organisational aspects of practice in relation to quality care delivery, the time is now right to focus on a standardised internally led approach to improving practice performance, designed for the dynamic context of primary health care.

1 Relationship between key terms

2 Flow diagram depicting selection process of studies for analysis

3 Combined elements of high-quality organisational performance

Element

Source

Association between elements

References


Patient-centred care

Development of a tool; multisite trials of existing tools; research article

Linked to clinical governance and team-based care

26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36

Leadership and leading

Multisite trial of existing tool; descriptive framework

Linked to organisational governance, team-based care; communication; process improvement and performance results

28, 29, 30, 37, 31, 32, 33, 38, 39

Focus on staff

Multisite trial of existing tool; descriptive framework

Linked to leadership and organisational governance

40, 41, 26, 27, 28, 29, 32, 37, 31, 32, 34, 35, 38, 39

Clinical governance

Development of a tool; multisite trial of existing tool; research article

Linked to team-based care

9, 29, 30, 34, 35, 42, 38, 39, 36

Multiprofessional teams

Development of tools; multisite trial of existing tools; research article

Linked to communication and patient-centred care

28, 29, 30, 43, 33, 34, 35, 38, 39, 36

Communication

Descriptive framework

Linked to collaborative and integrated approaches to care; team-based care

9, 40, 41, 28, 29, 30, 38, 39

Education and training

Multisite trial of existing tools; descriptive framework

Linked to change management

9, 27, 28, 29, 34, 35, 42

Process improvement

Multisite trial of existing tool; descriptive framework

Linked to performance results

28, 29, 43, 37, 31, 32, 34, 35

Performance results

Multisite trial of existing tool; descriptive framework

Linked to element of information and information technology

28, 29, 37, 31, 32, 35, 42, 29, 44

Information and information technology

Development of tool; multisite trial of existing tool; research paper to identify attributes

Linked to clinical governance; process improvement and performance results

9, 40, 28, 29, 34, 35, 36

Incentives and rewards

Descriptive framework

Linked to change management

45, 46

Organisational governance

Multisite trial of existing tool; descriptive framework; descriptions of cultural diagnostic tools

Linked to leadership and change management

9, 47, 48

Change and change management

Descriptive framework

Linked to leadership, education and training, process improvement, performance results and incentives

38, 39, 36, 48

Co-creating value in research: stakeholders’ perspectives

A Centre for Research Excellence reflects on collaborating with policymakers and front-line staff to bring evidence into practice

Last year’s Strategic review of health and medical research – better health through research (the McKeon Review) highlighted strengthened partnerships between researchers, health care professionals, government and community as central to a productive research sector.1 Our Centre for Research Excellence (CRE) has, from inception, adopted such an approach to facilitate translation of our research into evidence-based health care and policy.2 Implementation research works best when the research partners who make policy or deliver care have been involved at all stages of the research process — from the research question through to the analysis and implementation strategy.3,4 In using these approaches, our CRE has partnered and worked closely with a variety of influential primary care organisations (Box). Collectively, they represent members delivering more than 100 million patient consultations per year or organisations responsible for setting the quality and safety benchmark for Australian primary care.

From 2011, our CRE has had regular “linkage and exchange”5,6 activity with all partner organisations. This includes a variety of different communication methods — regular full-day research planning meetings, providing opportunities to receive updates and provide feedback, and informal input and advice around the CRE’s research program. Our partner organisations also sit on our Research Stream Committees and National Advisory Committee, providing them with more formal opportunities to engage with the research team. As our partners reflect the heterogeneity of the end users of our research, this allows them to influence new approaches, generate fresh ideas and provide advice on existing frameworks.

In this article, we record insights from these nine organisations about their experience in working with our Centre. Our information was obtained from senior organisational representatives in open-ended telephone interviews, either individually or in small groups. Three key areas were explored: general perceptions about the partnership to date, the benefits and challenges of coproduction and implementation, and thoughts on future initiatives of this kind. A journalist independently recorded the representatives’ responses, and the transcriptions of these are included in this reflection piece.

Benefits of the collaboration

Most key informants perceived the collaboration to be value-adding and enriching.

Partnering with the CRE has helped us identify new opportunities and has added credibility to the quality frameworks we have in place. The ideas the Centre has brought to the table have developed our thinking. We have been able to consider and incorporate their quality improvement activities into our existing processes to add value to what we do. The open communication channels have been excellent throughout the process. (RACGP)

Most partners reported the collaborative relationship as respectful and open.

There has been good communication from the research team back to us, and the research has been professionally led and well managed. (AGPAL)

The partners were pleased to see the CRE bringing together key stakeholders from a range of disciplines to work together towards a common goal:

The thing that I’ve particularly valued has been the broader meetings that we’ve held at various times. To be able to hear people from a huge range of disciplines and perspectives actually sharing with one another and working towards a shared goal. (CIA)

The research team perceived working closely with the organisational end users to have been highly beneficial to the CRE research program. It allowed fine-tuning of research to produce outcomes implementable by partner organisations, particularly coproduction of research questions designed to generate the product identified by partners.

Partners identified issues of relationship, pragmatism and relevance as important.

The relationship is the important thing, and its what’s been missing in other forms of what you might call applied research where a researcher goes away, undertakes the research and then perhaps publishes a paper, which then misses the bit as to “how do we get it implemented” … This change from the top-down focus of previous programs could result in fewer failures and more successes and, generally speaking, better value for money. (IFA)

We wanted research that is practical, with commonsense outcomes that people can understand. That is what we have achieved … and we recognise there will be useful outcomes. (AGPAL)

Partnership has permitted progressive road testing of processes, findings and recommendations, which has been invaluable. Partners appreciate that the CRE conducts research that is practical, relevant, and will produce outcomes that can be operationalised by partner end users almost immediately.

A lot of the research that’s normally done on the policy level is at a macro level — good ideas but vary rarely implemented in practice. People on the frontline are actually having significant input to the process and being able to inform the way that the practice improvement tool is developed. I think that’s really important. (AAPM)

The partnership with the CRE has enabled us to actually have discussions so that we can make clear what are the needs of the organisations to enable them to make change, and the CRE gets involved in taking that on board in their research to indicate what might work best to help with patient safety improvement. We’ve also been working with the CRE in helping identify the best practices throughout Australia so we can work more closely and find out what makes them the best practices. By and large, it’s been a process that has enabled us to have communication with the researching body who have worked with us in identifying the needs, the topics and of course now are involved in an interaction in how it might be implemented within our improvement framework. (IFA)

Further benefits relate to the CRE assisting stakeholders to improve quality and build accreditation options. Involvement in our research program has offered an opportunity to gain quality improvement and continuing professional development points through the RACGP, and, more recently, professional development points for practice managers through the AAPM.

It assists in their accreditation. They’ve got a system in place that will help them with continuous improvement and that does flow onto patient care and safety. It has empowered the practices to make changes towards quality improvement. (AAPM)

The CRE has found access to the partner organisations’ membership and networks for recruitment to its research program invaluable. Through these, we have successfully engaged hundreds of practices across Australia to participate in our research program. This helps develop research capacity in primary health care organisations and practices and is consistent with both APHCRI’s mandate and the McKeon Review, which states that “research capacity among health professionals is critical for conducting research, promoting research translation and improving the health system”.1 Most partner organisations raised these benefits, and noted that the CRE has promoted involvement of the entire practice and primary care staff, not only general practitioners.

Previously, I think, people have thought it’s really the physician’s role and nothing to do with the office staff at all but this [CRE] has made it really clear that it’s the responsibility of the whole team and shows how they can all contribute to the end result which, of course, is patient safety … people who have participated in the research have found it beneficial to their practices and to them personally. (AAPM)

It is well documented that only a fraction of research is translated to policy and practice.7 Our Centre addresses this gap by involving influential partners in both the creation and dissemination of evidence-based research into policy and practice.8 We have regularly engaged with policymakers to ensure that our research production aligns with their needs for easy uptake into policy and service delivery. It is pleasing that this style is welcomed by government, but is an area that requires more work.

This relationship with the CRE reflects the broader move in government to have evidence at the centre of policy making … whilst we articulate that as an ideal, we are still in the process of determining how we do that. (DoH)

Challenges of the collaboration

Working across the research–policy interface often poses challenges related to differing cultures, priorities, preferred style of communication, and time frames.

The research method takes years to produce its outputs and the questions that policymakers seek answers on don’t always coincide with the time scales in the research … the challenge that we face is to how to articulate the policy need and the importance of this research in the absence of outputs. (APHCRI)

The policy-making process is not necessarily a linear process that happens in discrete time frames. The capacity for the CRE to work with us in that environment is going to be different at times for the CRE where they want to start a project and progress through in a neat timeframe. (DoH)

It was acknowledged that it takes commitment and time to build relationships and address cultural differences.

It is early stages and is still a maturing relationship. I think from both sides, there are different cultures and different contexts in which we work. It takes time to actually build that relationship up and understand those different contexts, and for two different cultures to come together to do something new. (DoH)

When asked regarding enhanced collaboration, several partners felt that their involvement was limited and would have preferred to be engaged more intensively:

To continue involvement we want to be kept involved at a higher level. There is the quarterly magazine, APNA annual conference … it is a great opportunity for the CRE and really good for APNA to be able to let people know what we are involved in. (APNA)

It has worked well, but sometimes, I feel disconnected from it. That is probably largely from the Commission end rather than the CRE end. If we were starting again I would push harder to be more involved. (ACSQHC)

The future

APHCRI CREs have unique assets in staff and skills linked to extensive national and international networks for primary care capacity building.

It would be useful to extend some of this preliminary work. Good primary health care has a positive impact on the overall health system and research is essential to achieving those improvements. (RACGP)

Most partners felt that it has taken significant time and energy to build the relationships required to effectively conduct research in partnership, but there is much work yet to be done.

We’ve brought them to a level where they’re working well together and delivering … so how can we maintain these relationships? It often is reliant on the personal relationships that have been built up. (CIA)

I think it has been good in terms of starting that relationship, working together and a willingness to cooperate but I don’t think we’ve got the fullness of maturity yet that we would like. (DoH)

All informants recognised the importance of the CRE in building “grassroots” capacity to deliver practical solutions for improving patient safety, clinical outcomes and overall quality of care, and indicated an interest in continuing their involvement in research development of this nature. The interlocking of end user and researcher across the entire Centre research journey has taken time, patience and flexibility on both sides. Yet the benefits in terms of research translation and utility have already been significant, and are documented in each paper in this Supplement. Research end users, are critical and willing partners in closing the primary care evidence–practice–policy loop, for the benefit of all Australian communities.

Centre for Research Excellence in Primary Health Care Microsystems Research partner organisations

Australian Association of Practice Managers (AAPM)

Australian Commission on Safety and Quality in Health Care (ACSQHC)

Australian General Practice Accreditation Limited (AGPAL)

Australian Government Department of Health (DoH)

Australian Primary Health Care Nurses Association (APNA)

Australian Primary Health Care Research Institute (APHCRI)

Chronic Illness Alliance (CIA)

Improvement Foundation (Australia) (IFA)

Royal Australian College of General Practitioners (RACGP)

Surveyors’ perceptions of the impact of accreditation on patient safety in general practice

Accreditation of health services and its potential role towards improving health care has been described previously.13 Improving patient safety through the process of accreditation has been noted in the acute care setting.46 Further research is needed to evaluate patient safety in accreditation of primary care, its impact, and how to improve it.

The Royal Australian College of General Practitioners (RACGP) has developed a set of standards to protect and improve the safety and quality of health care provided in general practices. These standards serve as a “template for safe and high quality care”, for the general practices that have joined an accreditation program (about 80% of practices in Australia).7 These standards are used by accreditation agencies to carry out the accreditation process through experienced surveyors who are involved in primary care. GP surveyors and co-surveyors, such as practice managers or practice nurses, carry out the accreditation process, which is approved by the agency accreditation review committee.

One of the RACGP standards is to provide a systematic approach for clinical risk management, to recognise and avoid near misses, slips, lapses or mistakes.7,8 Risk management is defined by the RACGP as “the culture, processes and structures that are directed toward the effective management of potential opportunities for adverse events”.7

Patient safety in primary care is underestimated due to poor use of available data and difficulties in measuring safety incidents,9,10 although several studies have described the errors and harms that occur in primary care in Australia11,12 and internationally.1317

The Australian Safety and Quality Framework for Health Care,18 endorsed by heath ministers in 2010 as an important driver of quality, has highlighted three key domains for creating safe, high-quality care. One of these domains requires health services to be “organised for safety”, which further emphasises the importance of accreditation in reducing harm in general practice.

This study aimed to explore Australian General Practice Accreditation Limited (AGPAL) surveyors’ perceptions of the impact of accreditation on patient safety, and to elicit suggestions for improving patient safety in Australian general practices.

Methods

We asked AGPAL to recruit a national purposive sample of their surveyors on our behalf to represent most Australian states and territories, their experience in the use of different editions of the RACGP standards for accreditation, and number of practices they had accredited. AGPAL sent an email invitation with the study information and consent form to surveyors. Interview questions centred on the process of accreditation, general practice performance and patient safety (Box 1).

We conducted semi-structured telephone interviews (40–60 min) with participant surveyors from 2 July to 14 December 2012. All interviews were audio recorded, transcribed and summarised using the interview schedule as a guiding framework to identify participant perspectives of the impact of accreditation on safety in general practice.

This project was granted ethics approval from Flinders University Social and Behavioural Research Ethics Committee (project no. 5609).

Results

Eleven surveyors consented to participate; one declined at a later time due to time constraints. The 10 AGPAL surveyors who participated in the study were involved in the accreditation of 2022 general practices over 15 years across the Australian states of New South Wales, Victoria, Queensland, Western Australia, South Australia and Tasmania, and the Australian Capital Territory. Seven were GP surveyors and three were co-surveyors. The number of practices accredited by each surveyor varied from 100 to more than 400 practices, except for two surveyors who had accredited only five practices (Box 2). Several editions of RACGP standards had been used by eight surveyors.

Accreditation and overall general practice performance

Overall, participants were of the view that accreditation improved general practice performance. This was particularly noted as an improvement over time and as a result of the accreditation process. Examples of improvement centred on the physical environment of general practice, such as equipment safety, appointment systems, patient records and electronic records.

No doubt. Over the years I’ve seen a significant improvement in general practice systems and the way they approach patient care, and a lot of that is directed to the standards. (Participant 10)

Some participants mentioned that the systematic approach of accreditation provided a method for improving general practice systems, such as through establishing business thinking and activity in general practice.

It’s made general practices realise that they’re a business, like any other business that has standards that they must conform to. I think what it’s also done is raise the profile and the importance of good staff and good nursing staff. (Participant 2)

However, doubts were also expressed about accreditation and its impact on improved practice performance, such as the “one-off” nature of accreditation and sustainability of improvement efforts.

… there is often a nagging doubt, are they [general practices] like this all the time? (Participant 4)

General practice staff awareness of patient safety

There were mixed responses regarding general practice staff awareness of patient safety, evident in the two quotes below, from concerns about an overall lack of awareness to views that awareness was related to staff roles and responsibilities; especially for practice managers and practice nurses, who were regarded as having high awareness because they were mainly responsible for the accreditation process and activity.

I don’t think there’s a huge awareness, I don’t think it’s great, I think it’s certainly an area that can be improved a lot. (Participant 6)

It’s clinical staff, not medical staff, that adhere to it and embrace it more enthusiastically. (Participant 3)

The following participant noted that safety awareness was discipline-specific, with GPs being aware of the clinical components of safety and other staff being aware of the physical safety elements of general practice.

I would say that doctors would be highly aware of clinical component. Staff I would say would be awfully conscious of the physical environment. (Participant 5)

Patient safety as a component of the accreditation process

Most participants stated that patient safety indicators are included in the accreditation process. The indicators primarily mentioned were from section five of the RACGP standards,7,8 which covers the physical environment of the practice such as infection control and sterilisation, cold chain, vaccination and physical access. Here, it was noted that accreditation lacks the ability to effectively assess safety in clinical practice as distinct from this focus on safety processes in the physical environment, which are easily recognised as being achieved or not.

They say there are standards for patient safety but there’s nothing that you can really tie down to patient safety. (Participant 10)

Participants suggested that the accreditation process could be improved through the inclusion of tighter clinical safety indicators and the requirement of verifiable evidence of a working clinical risk management system.

Evidence of clinical risk management systems in general practice

Participants confirmed that most general practices did not have sufficient evidence to demonstrate the existence of a clinical risk management system.

I think this was a really important standard introduced into general practice without anywhere near enough education for practices to understand. So most practices I go into, when I talk about slips, lapses and mistakes they look at me blankly; that would be 70%–80% of practices that I go to. (Participant 6)

The general practices considered to be high performing on patient safety indicators were described as having evidence that verified an active and effective clinical risk management system. These included having a working clinical risk management document, incident register or policy, and staff participating in meetings and discussion about slips, lapses and mistakes, and producing documented outcomes and actions.

I guess a living, breathing document, not one that’s just for the surveyor team but one that’s got quite a few entries in it and better still they can go into that area [and] show an improvement that has been effective as a result of that. (Participant 3)

Participants were asked to estimate the number or proportion of practices performing well in patient safety indicators and in clinical risk management. There were mixed estimates; five of the participants estimated that 5%–10% of general practices they had accredited were high performers in patient safety, three participants estimated 30%, and one participant estimated less than 1%. Only one participant gave a high estimate of around 90%. It was noteworthy that the more experienced surveyors (accredited more practices) provided lower proportions of general practice performing well on patient safety indicators.

Improving patient safety culture in general practice

Participants were asked to recommend approaches to improve the safety culture in general practice. Their responses included further education and training, and novel ways of thinking, emphasising the roles of practice managers and practice nurses, instilling an interest and inclination towards improvement and safety, establishing open, honest, and sharing communication practices along with reflection and documentation. Also mentioned were introducing a business model to practices, creating systematic and “multi-pronged” interventions to introduce change, and funding and incentives for change. While the above recommendations were viewed as enabling change, some also acknowledged the difficulties and challenges required when attempting to change practice behaviour and activities.

To optimise change in general practice, you have to think about all the ways in which you might influence GPs to bring about change. Change is not one simple thing — it takes a range of things. (Participant 6)

Following on with discussions around possible ways to improve patient safety culture in general practice, participants were asked about the Australian Primary Care Collaboratives (APCC) Program. One surveyor who had recently joined AGPAL was not aware of the program. Nine surveyors believed that the APCC Program is commendable, with potential to promote and improve patient safety culture in Australian primary care because of the systems that it introduces to practices.

Absolutely, I’ve seen it time and time again that when the practice is involved in APCC, patient safety and their interest in recall systems [and] registers becomes high and they encourage it. (Participant 10)

Discussion

This is the first study in Australia to examine AGPAL surveyors’ perceptions of the impact of accreditation on patient safety in general practice. The findings suggest that accreditation has improved the safety and quality of Australian general practice, but there is still room for improvement, particularly concerning clinical safety and providing verifiable indicators that require practices to demonstrate evidence around clinical risk management.

Participants affirmed that the physical factors of the environment affecting safety, such as infection control and sterilisation, cold chain, vaccination and physical access, are well addressed during the accreditation process. Conversely, clinical risk management indicators lacked sufficient verifiable evidence needed to demonstrate acceptable levels of safety. Furthermore, this type of evidence was thought to be provided by only 5%–10% of Australian general practices.

One solution could be the addition of extra procedures in the accreditation process that require evidence of clinical risk management. Those suggested by participants included: a) having a significant incidents register; b) providing documentation of near misses, slips, lapses or mistakes; and c) engaging in regular clinical meetings to discuss incidents and how to avoid them in the future.

Accreditation could advance the use of clinical risk management in general practice, as outlined in the RACGP standards with the proposed recommendations listed above. Additionally, these recommendations are a step forward to meeting the proposed actions to prevent or minimise harm from health care errors reported in the Australian Safety and Quality Framework for Health Care.18

Incident registers with documentation of significant safety incidents could be the foundation to developing a national register for anonymous reporting of errors and near misses.

The APCC Program’s success in improving quality is evident,19,20 and was well endorsed by participants in our study to be a program that could promote and improve the patient safety culture in Australian primary care. With this in mind, we recommend that the APCC Program add patient safety to its agenda for improvement.

Limitations to this study include the possibility of selection bias and the use of self-report. The number of participants was small and surveyors not sampled for this study may have different responses and hence different recommendations and conclusions to study participants. Finally, the proportion of practices who were perceived as high performers for clinical risk management activities are based on self-reported estimates from participants, and therefore cannot be considered to be an actual estimate.

Our study suggests the current “softness” around patient safety indicators in the accreditation process for general practice needs to be improved. The inclusion of tighter indicators that require verifiable evidence is a step forward to retaining the positive role of accreditation in improving general practice performance in quality and safety. Furthermore, given the APCC’s previous success in general practice quality improvement, it would be an appropriate organisation to further improve patient safety in general practice.

1 Interview questions posed to surveyors

  • Do you think accreditation improves general practice performance? If yes, how?
  • In general, are general practice staff aware of patient safety?
  • Is the accreditation process examining patient safety? If yes, how?
  • During accreditation, have you ever seen evidence of patient safety indicators (ie, a clinical risk management system)?
  • Do general practice staff have regular meetings to review slips, lapses and mistakes?
  • Can you estimate the percentage of best practices in patient safety?
  • What is the optimal way to improve and disseminate patient safety culture in general practice?
  • Do you think the Australian Primary Care Collaboratives Program could help improve patient safety culture?

2 Characteristics of participating surveyors (n = 10)

Characteristic

Number


Sex

 

Male

7

Female

3

Role

 

General practitioner surveyor

7

Co-surveyor

3

Number of accredited practices

 

Five

2

100–300

5

350 or more

3

Location

 

Australian Capital Territory

1

New South Wales

1

Queensland

2

South Australia

2

Tasmania

1

Victoria

1

Western Australia

2

Best-practice integrated health care governance – applying evidence to Australia’s health reform agenda

Is Australia ready for evidence into policy?

When you run on your own you run fast, when you run together you run far. (Proverb)

Internationally, health reform initiatives have identified improved integration between community and acute care delivery as key to sustainability.1,2 Australian reform initiatives have been no exception. In 2009, Australia’s National Health and Hospitals Reform Commission laid the “blueprint” for Australia’s health care future.3 It stressed the importance of “connecting and integrating health and aged care services for people over their lives”. However, it also observed that “each level of government formulates policy in relation to its own responsibilities, not necessarily taking account of the health system as a whole”, and that “current governance arrangements are contributing directly to weaknesses in the quality, effectiveness and efficiency of the Australian health system”.3

Three years later, the National Healthcare Agreement 2012 committed all federal, state and territory governments to support an integrated approach to the promotion of healthy lifestyle, and prevention, diagnosis and treatment of illness across the continuum of care.4 Despite the critical nature of joint community and acute care cooperation in delivering on the plethora of mutually agreed objectives, there was no mention of any commitment to the integrated governance arrangements pivotal to such success.

Concurrently, Australia’s first National Primary Health Care Strategy established a network of 61 primary health care organisations, Medicare Locals (MLs), across Australia.5 While the Strategy stated that MLs “will be an integral component of the National Health and Hospitals Network” and “have some common governance membership with the Local Hospital Networks [LHNs] in their region”, an integrated governance model was never developed.5

Given the priority placed on effective governance frameworks to deliver clear roles and responsibilities to both funders and providers of health care, what is the governance vehicle best suited to achieving our national reform outcomes, and how is it best crafted in the current Australian health care reality?

In 2013, we conducted a systematic review to explore international peer-reviewed articles and relevant websites for effective and sustainable integrated primary–secondary health governance models. Ten key elements were identified, many interdependent, from 21 articles that met the inclusion criteria.6 The evidence suggests the following specific governance elements are important to support integrated care across the primary–secondary care continuum:

  • Joint planning was identified as key in 18 of the 21 articles. Governance arrangements included formal agreements such as memoranda of understanding (MOUs), joint board memberships and multilevel partnerships in the planning process.
  • Integrated information communication technologies were noted in 17 articles, particularly, a shared electronic health record, and systems that link clinical and financial measures.
  • Effective change management was noted in 17 articles, requiring a shared vision, leadership, time and committed resources to support implementation.
  • Sixteen studies agreed on the importance of shared clinical priorities, including the use of multidisciplinary clinician networks, a team-based approach and pathways across the continuum to optimise care.
  • Aligning incentives to support the clinical integration strategy, noted in 15 studies, includes pooling multiple funding streams and creating equitable incentive structures.
  • Providing care across organisations for a geographical population, noted in 13 articles, required a form of enrolment, maximised patient accessibility and minimised duplication.
  • Use of data as a measurement tool across the continuum for quality improvement and redesign, found in 12 studies, requires agreement to share relevant data.
  • Professional development supporting joint working, supported by 11 articles, allowed alignment of differing cultures and agreement on clinical guidelines.
  • An identified need for consumer/patient engagement, noted in eight studies, is achieved by encouraging community participation at multiple governance levels.
  • One-third of articles acknowledged the need for adequate resources to support innovation to allow adaptation of evidence into care delivery.6

Governance elements identifiable in Australia’s current health care reform environment

We reviewed key statements regarding integrated care delivery from federal, state and regional perspectives to identify evidence of integrated primary–secondary governance support. Although several elements above are noted as goals, formal documents mostly relate to silos of sector activity and not the interface (Box).

The following integrated governance elements are currently well documented:

  • Joint planning is documented in agreements at both federal and state level. It is identified as a key role for MLs and LHNs, and there is evidence to support it as a key objective in both strategic plans.9,11 Some MLs and LHNs have created joint board positions and local MOUs, demonstrating a commitment to managing deliverables, risk and processes through a collaborative approach.12,13
  • A key objective of MLs7,8 and federal–state agreements4 is to work in partnership to document and together address shared clinical priorities for action. ML–LHN MOUs identify agreed shared clinical priority areas,12,13 some based on local need (eg, mental health),13 others on national benchmarks set by the National Health Performance Authority (NHPA), Close the Gap and national priority areas.12
  • At local level, ML–LHN MOUs have documented evidence of commitment to patient, consumer and community engagement.12,13 This includes joint planning fora and input into informed patient choice regarding options for care. A joint consumer engagement approach including co-hosting of events is supported in one ML–LHN MOU.13
  • Federal and state health departments and authorities produce documentation on the health of their populations, and MLs and LHNs must focus on population health service planning as part of their reporting. MLs and LHNs have collaborated to provide population health reports for regions. Lack of enrolment is currently a limitation to accurate geographical population health data in Australia.

Areas still to operationalise:

  • Policy direction requires “e-health tools to link providers and improve quality of care”.4 However, as an integrated information communication technologies tool, the personally controlled electronic health record (PCEHR) has some way to go before it becomes a shared electronic health record capable of providing “access to more health information, creating a more efficient system, making continuity of care easier and improving treatment decisions”.14 This remains a significant barrier to integrated health care going forward. Federal support for the rollout of the PCEHR is articulated,7,9 although this is not reflected in state plans.10,11 The PCEHR review was completed on 20 December 2013, but the findings have yet to be released.15
  • Federal and state governments “will … look to improve quality and accessibility of data to inform planning and service delivery with a ‘whole of system’ view”.7 One ML and LHN have agreed to use shared data as a measurement tool to meet performance requirements articulated by NHPA.12

Areas still to evolve:

  • There is little in current policy documents to incentivise integrated care. Primary care functions on a largely fee-for-service model, moving patients to emergency departments or hospitals when more comprehensive care is required. State-funded acute care has few current funding or governance levers to link with private or federal-funded care. New models in New Zealand employ governance frameworks that create the funding and business rules to better incentivise care models across the interface. Instead of input-defined, competitive, fee-for-service contracts with penalties for underperformance, it has moved to “alliance” contracting to create joint incentives to manage cost.16,17 Preliminary evaluation shows wins in patient acceptability, quality of care and hospital avoidance.16
  • There is no documented evidence that LHNs or MLs have currently committed resources to jointly manage the change required to working collectively across the interface. This can be complex, challenging and resource intensive.18
  • There is no documented evidence of organisational commitment and resourcing to deliver interprofessional training across the continuum or to develop training programs that align differing cultures and integrated ways of working.19
  • The Council of Australian Governments supports the need to “invest in research that promotes evidence based practice and innovation”.4 Although one ML noted the importance of building a culture of innovation and the need to invest in and demonstrate leadership in innovation, evidence of this occurring is lacking.

The Australian reform environment has made steady progress in building integrated governance arrangements around joint planning, shared clinical priorities, consumer involvement and population health service planning. However, other areas, such as integrated information communication technologies, using shared data as a measurement tool, shared resources to support change, and interprofessional or interorganisational training and innovation remain ad hoc or non-existent. Despite their importance, incentives for integrated care still fall predominantly into short-term programs, rather than robust governance arrangements at federal, state or local level.

If we are to apply important evidence to health care policy, and maximise reform success, we must review current governance frameworks to address the gaps identified in this paper. While it is challenging to bring historically disparate partners together into formal agreements, they are essential to creating the “business rules” and sustainable environment required to achieve the new care models we seek.

Identification of evidence supporting integrated primary–secondary health care governance in the Australian policy environment

 

Federal–state


Federal


State


Local


Integrated governance elements6

Council of Australian Governments National Healthcare Agreement 20124

National Primary Health Care Strategic Framework 20137

Medicare Local Operational Guidelines 20138

Medicare Local strategic plan9

State health department agreement with Local Hospital Network10

Local Hospital Network strategic plan11

Medicare Local/Local Hospital Network local agreements12

Joint planning

Nil

Demonstrated

Demonstrated

Demonstrated

Demonstrated

Demonstrated

Demonstrated

Integrated information communication technologies

Demonstrated

Limited

Nil

Demonstrated

Nil

Nil

Limited

Change management

Nil

Nil

Nil

Nil

Nil

Nil

Nil

Shared clinical priorities

Demonstrated

Demonstrated

Demonstrated

Demonstrated

Nil

Demonstrated

Demonstrated

Incentives

Limited

Nil

Nil

Nil

Nil

Nil

Nil

Geographical population focus

Nil

Demonstrated

Demonstrated

Demonstrated

Nil

Demonstrated

Demonstrated

Measurement of data as a quality improvement tool for clinical care

Nil

Limited

Limited

Nil

Nil

Nil

Limited

Continuing professional development supporting joint working

Nil

Nil

Nil

Nil

Nil

Demonstrated

Nil

Patient/community engagement

Nil

Demonstrated

Demonstrated

Demonstrated

Limited

Demonstrated

Demonstrated

Innovation

Demonstrated

Demonstrated

Nil

Demonstrated

Demonstrated

Nil

Nil

What should governance for integrated care look like? New Zealand’s alliances provide some pointers

Multidisciplinary leadership teams and flexible approaches are helping streamline New Zealand’s health care system

While the search continues for governance arrangements that support health system and service integration,1,2 developments in New Zealand provide useful new insights. New Zealand presently has 20 district health boards (DHBs) planning and funding regional hospital and other services, and around 30 primary health organisations (PHOs) that plan and fund elements of general practice and primary care for enrolled patients. These two sets of arrangements have functioned largely separately from one another, despite DHBs funding PHOs and both having common populations.3 New Zealand’s policymakers and health care providers have concluded that it is no longer acceptable nor sustainable to operate a health system with parallel structures that lack coordination or a governance model that supports this.

In response, from mid 2013, New Zealand moved to implement a governance model across the entire country, aimed at integration by requiring an alliance between each DHB and corresponding PHOs. This followed investment in 2010 in nine pilots. The alliance concept derives from the construction industry, where independent companies collaborate, rather than compete, to ensure that large, complex projects are delivered on time and within budget. While the health alliances are forced by policy, they are an example of an experimental governance model4 that, evaluations of the pilots suggest, provide considerable promise.5 For example, alliances have helped drive important new initiatives that provide better support for complex patients in primary care settings by enabling general practitioners to work together with hospital specialists and other providers. While early days, there is some evidence of reductions in emergency department admissions and of more services traditionally provided in hospital settings being delivered in the community, such as specialist outpatient consultations, older people’s health, and emergency response services that might otherwise require a hospital visit. Importantly, those involved in alliances believe it is a model that helps steer health system and service design in an important new direction.5,6

Some important factors underpin the alliances. Members should

  • be clinical leaders from across the health system, with influence and respect among colleagues;
  • have capacity to bring resources to the alliance table so decisions can be implemented; and
  • very importantly, cast aside sectoral interests, work to assist one another, and take a whole-of-system approach to planning and decision making based on what is best for the patient and health system.

Alliance goals variously include shifting services from hospitals to primary care or creating new arrangements combining elements of both service domains to, for example, reduce avoidable hospitalisation or improve chronic condition management. The key, as noted, is to focus on and work towards what makes best sense in the context of integration to the players in the local health system.

All DHBs now have an alliance leadership team (ALT), membership of which is determined by the DHB and PHO and evolves as an ALT sees fit. Members are likely to include doctors, nurses, allied health professionals, others from hospital and primary care settings, and those with resources, such as the chief executives of the DHB and respective PHOs and consumer representatives. Each member signs a charter spelling out the rules of engagement and focus of the ALT, which then sets local priorities and plans how these will be met.

There is flexibility for how an alliance goes about its activities. Many ALTs are focused on developing service-level alliance teams (SLATs). These are work streams that include, again, a combination of clinical leaders and management. The Southern Health Alliance Leadership Team, of which I am Independent Chair, has chosen initially to create SLATs for acute service demand management; outpatient services; diagnostics; rural health; community and hospital pharmaceuticals; frail older people; and respiratory conditions. To illustrate how a SLAT functions, initial respiratory SLAT work involved a workshop including hospital emergency department and respiratory physicians, GPs, nurses and ambulance services. Resulting actions include identifying frequently hospitalised patients, providing nurse-led care plans for them and ensuring that the patient’s GP and, where necessary, hospital services are involved in this, and developing primary care-based options for ambulance services. Development of web-based clinical pathways aimed at integration, involving health professionals from the primary and hospital sectors, is also governed by the ALT.

In the Canterbury region, where alliance development is more established, dozens of people from different parts of the health system are involved. With care design decided on advice of a SLAT, it is then up to the ALT and its member organisations to pool or shift resources to support new configurations. This process is being propelled by new flexible funding arrangements, whereby the PHO can use existing ring-fenced allocations in new ways as decided by the ALT. The DHB is expected to contribute to this pool which will grow with time, along with the level of joint risk sharing, as an alliance work program advances.

How alliance performance will be measured is an important question that the government is tackling. An impending Integrated Performance and Incentive Framework incorporates a range of system-wide measures, including patient experiences with the system, requiring an effective alliance and integration in order to perform well.7

Like Australia and other countries, New Zealand’s public hospitals and GPs work with quite different incentives and business models.8 Yet, alliances have provided a powerful method of bringing health professionals together from different parts of the system and motivating them to work collaboratively on what services should look like from a patient and clinical perspective. Given their relatively embryonic state, the challenge now is to monitor closely how the alliances perform over time and consider lessons for policymakers elsewhere.

Aboriginal community controlled health services: leading the way in primary care

Incorrect statement: In “Aboriginal community controlled health services: leading the way in primary care” in the 16 June 2014 issue of the Journal (Med J Aust 2014; 200: 649-652), there was an error in the “Workforce and training” section on page 651. The sentence “The Leaders in Indigenous Medical Education (LIME) Network has recently signed an agreement with the National Aboriginal Community Controlled Health Organisation seeking to increase Aboriginal medical student placements in Indigenous primary health care settings with a view to increasing participation in and enhancing the effectiveness of the medical workforce” should have stated that the agreement was made with Medical Deans Australia New Zealand, not the LIME Network. The LIME Network is a project of Medical Deans that orchestrates many of their Indigenous health initiatives, but the partnerships between organisations are made at the Medical Deans level.

A systematic review of the challenges to implementation of the patient-centred medical home: lessons for Australia

Australia’s first National Primary Health Care Strategy1 and resulting National Primary Health Care Strategic Framework2 initiated growing interest and development in our primary care sector, particularly general practice. Clinicians, governments and organisations are now actively searching for new approaches, models of care and business levers to support the primary care quality, efficiency and access gains sought. In December 2012, then Minister for Health Tanya Plibersek announced a focus on the patient-centred medical home (PCMH) as a model of interest.3 The Royal Australian College of General Practitioners (RACGP) has also been a consistent champion of the model, urging adoption of its elements as part of current reforms and calling for the federal government to fund and implement key elements in its 2013–14 Budget submission.4

The PCMH concept of care was introduced by the American Academy of Pediatrics in 1967, and was adopted in 2002 by the family medicine specialty. Four major primary care physician associations in the United States, along with other stakeholders, formed the Patient-Centered Primary Care Collaborative (PCPCC), and in 2007 endorsed the Joint principles of the patient-centered medical home.5 These include: access to a personal physician; physician-directed medical practice; whole-person orientation; care coordination and/or integration; quality and safety benchmarking through evidence-based medicine and clinical decision support tools; enhanced care availability after hours and via e-health; and practice payment reform. We used this definition of PCMH in our review because it concords strongly with the RACGP’s statement, A quality general practice of the future,6 endorsed by all general practice organisations nationally in 2012.

There is evidence that adoption of the PCMH model can improve: access to care;710 clinical parameters and outcomes;1115 management of chronic and complex disease care;79,11,12,1422 preventive care services (eg, cholesterol tests, influenza vaccinations, prostate examinations);9,10,12,13,17,18,20,2326 and provide improved condition-specific quality of care14,15,18,19,22,27 and palliative care services.8 Data also indicate that the PCMH model can decrease the use of inappropriate medications,8,22,23 and significantly reduce avoidable hospital admissions and readmissions, emergency department use and overall care costs.8,14,22,2831

While the PCMH model shows promise in transforming the primary care system into a more integrated and comprehensive model, studies report challenges and barriers to the implementation and adoption of this model. Before its potential can be achieved, more robust information is needed on the actual change process, challenges and barriers associated with implementation of this model.32,33

We undertook a systematic review to identify the major challenges and barriers to implementation and adoption of the PCMH model. The findings from this review will provide lessons for Australian primary health care reform and future PCMH initiatives in Australia.

Methods

A complete description of the methods is provided in Appendix 1.

In December 2012, we searched the PubMed and Embase databases for studies published between January 2007 and December 2012 using the search terms patient centered medical home, patient centred medical home, medical home, or PCMH. Appendix 2 provides details of the search strategy. A snowballing strategy was used to identify other related citations through the reference list of all reviewed articles.

Abstracts were included if they met the following inclusion criteria: 1) published between 2007 and 2012; 2) in English; 3) reported information or data related to the review objective; 4) defined PCMH using the PCPCC Joint Principles, or at least mentioned some of its components.5 There were no restrictions on study design or country of study.

Articles included during the initial screening by either reviewer underwent full-text screening. One reviewer with expertise in the area reviewed the full text of each article and indicated a decision to include or exclude the article for data abstraction. We applied 10 quality criteria that were common to sets of criteria proposed by research groups for qualitative research (Box 1).3436 Two reviewers independently assessed the quality of each study, and discrepancies were resolved through discussion.

Data extraction and synthesis

A data extraction form was created by the investigative team to assist in systematically extracting information on the study design (type of study, methodology and setting) and key findings related to the review objective. One researcher with content knowledge in the area abstracted the data, while a second researcher reviewed the abstracted data alongside the original article to check for accuracy and completeness.

Thematic synthesis was used in three stages: the free line-by-line coding of data; the organisation of these “free codes” into related areas to construct descriptive themes; and the development of analytical themes.37 Data were configured at a study level using a top-down approach, which allowed individual findings from broad study types to be organised and arranged into a coherent theoretical rendering.38 Synthesis matrices allowed data to be recorded, synthesised and compared.

Results

The search strategy identified 2690 citations, of which 28 studies met the inclusion criteria (Box 2). All studies were from the US. This was not surprising, as the PCMH model is a North American model and the PCPCC Joint Principles of the PCMH definition we used as part of the inclusion criteria is from the US. Of the 28 articles, there were nine exploratory studies, 13 descriptive studies, and six experimental or quasi-experimental studies. All studies met five or more of the 10 quality criteria, and nine of the 28 studies met all 10 quality criteria. Descriptions of included studies (including type of study, method, setting and quality rating) are provided in Appendix 3.

This systematic review identified six key overlapping challenges and barriers to implementation and adoption of the PCMH model. These are presented below, and Appendix 4 includes a summary table of themes identified in each study.

Challenges with transformation and change management in adopting a PCMH model

Eleven studies discussed varying challenges and barriers to transforming to a PCMH model. Transformation calls for significant changes in the routine operations of practices, and these are difficult to achieve and require more than a series of incremental changes.16,27,3944 Key requirements are: long-term commitment,17,39,43,45 local variation,17,39,45 a focus on patient-centredness,39,45,46 and support through reform of the larger delivery system to integrate primary care within it.17,27,40,47 Even with external payment reform, practices need extensive assistance coaching from external facilitators and expert consultants to transform to a PCMH.16,27,39,43

There were reported challenges41,43,44,48 relating to a shift in paradigm for individuals and practices, which required them to move away from a physician-centred approach towards a team approach shared among other practice staff.17,39,43,44,49 Transformation efforts were slowed or ceased by ineffective change management processes;39,50 lack of leadership,51,52 readiness for change, communication and trust;17,44,5053 and culture.39,43,52,53 Misinformation or lack of understanding about the PCMH could lead to misunderstandings about what was being asked of practices and staff,41,45,53 causing resistance to change.39,43 Furthermore, practices without capacity for organisational learning and development, or what is called “adaptive reserve” (such as a healthy relationship infrastructure, an aligned management model and facilitated leadership), were more likely to experience “change fatigue”,17,41,43,44,50,54 and less likely to successfully implement the PCMH model.17,43,44

Difficulties with electronic health records

Implementing an electronic health record (EHR) with a clear, meaningful use, and which administers the principles of PCMH, has been a difficult task for primary care practices in transition.17,41,46,55 Implementation and use of an integrated EHR has proved to be more difficult than originally envisioned,27,39,41,43,52,53 requiring significant investment of time, effort, resources (eg, new equipment, training material) and money.39,41,44,52,54 Reported challenges related to setting up EHRs at practices, and providing ongoing technical support and resources to service.

There were also difficulties with functionality (eg, EHR could not provide data for population management; a disease registry was absent or extremely awkward to activate; and e-visits such as telephone, email or video consultations presented challenges), and use of EHRs (eg, accessing electronic records in a timely, easily digestible manner, and accuracy and reliability of information in the EHR).39,42,48,50,51 Furthermore, single-practice EHRs were reported as insufficient and a barrier to effective coordinated care,47 and the lack of interoperability of EHRs hindered collaboration between providers, crucial to the PCMH model.17,46,47,52,54

Challenges with funding and payment models

Sixteen studies reported challenges with the current funding models for PCMH. Most stated that current available funding and reimbursements were likely to be inadequate for the transitional costs and sustainability of the PCMH,3942,45,49,50,5459 and the essential functions of the PCMH are not supported by traditional fee structures.41,47,49,55,56 Many studies recommended that new payment structures and incentives for practices and providers be developed to support implementation and sustainability of the PCMH model.39,40,43,45,49,50,52,5459

Insufficient practice resources and infrastructure

Eighteen studies reported barriers related to insufficient resources within practices to implement the PCMH model. These included lack of resources (eg, equipment, human resources, training material), structural capabilities, time and financial capacity to develop the necessary building blocks to transform their practice into a PCMH.17,45,5153,59 Substantial support (including non-monetary support) and resources were required to implement change at the practice level.16,27,41,49,50,57,58,60 Smaller practices typically could not employ the same resources as larger facilities due to budget and resources constraints. Therefore, implementation at small practices was challenging due to lack of internal capabilities.21,41,42,44,61

Inadequate measures of performance and inconsistent accreditation and standards

There were several reported challenges relating to variations in PCMH standards, inadequate accreditation and measures of performance.16,17,3942,45,47,56 Most tools developed to measure achievement of the medical home did not directly correspond to the seven Joint Principles that define the PCMH, and many of these principles were difficult to measure.45 Furthermore, accreditation does not yet capture all the key aspects required for a fully functioning medical home,16 and the criteria for evaluating PCMH were inconsistent.56 Establishing standards, measures and targets proved difficult.16,17,40,42

Discussion

In our systematic review, we found evidence of challenges and barriers to implementation of a PCMH model, including difficulties with transformation to a new system, change management issues, adopting EHRs and adapting payment models. Other challenges were inadequate resources, performance measurement and accreditation.

Our findings have significant importance for current Australian reform initiatives. The RACGP, as part of its 2013–14 Budget submission, called for the federal government to fund and implement key elements of the PCMH, as it “encapsulates the very definition of [future] general practice in Australia”.4 Evidence-based assessment of the barriers and enablers to such transition presented in this article is an essential step to effective implementation.

As in the US, primary care practices in this country are challenged by growing complexity of care, accreditation pressures, and perverse funding and reward systems. Clinicians and organisations are often on the receiving end of policy implementation that is top-down rather than bottom-up, and, as small businesses, struggle to adapt in the defined time frames.62,63 Our review also notes the importance of reform across the larger delivery system to integrate primary care change within it. It demonstrates the importance of a long-term and tangible commitment to change adoption at the practice level (strong “adaptive reserves”), with a focus on teamwork, leadership, high-quality communication, staff development and ongoing support for a culture of change. Appropriate practice resourcing for infrastructure and system support over the “transformation” period is essential, as identified in our National Primary Health Care Strategy.1,2

The literature also highlights the importance of practice and practitioner funding that promotes patient centredness, preventive health, and a focus on complex chronic disease support, case management and hospital avoidance. This is timely in the Australian context, as is the focus on EHRs that promote care coordination, quality and safety benchmarking, and clinical decision support.54

Finally, our findings suggest that reform initiatives should involve accreditation review, such that these frameworks reflect measures of performance and standards that match the key benchmarks of importance, with minimal administrative barriers. Such initiatives are in early development, with the RACGP and Australian Commission on Quality and Safety in Health Care partnering in a review of accreditation process and outcome.64

Our review had some limitations. The search strategy did not include grey literature, and unpublished evaluation studies or reports may have been missed. There could also be other challenges or barriers not reported in the reviewed publications. The review was limited to studies that used the Joint Principles,5 because this definition concords strongly with the RACGP’s A quality general practice of the future,6 but may have missed literature published outside this definition. Data abstraction from qualitative studies can be complicated by the varied reporting styles.65 Relevant study “data” were often not presented in the results section, but integrated into the discussion or recommendations. Hence, a second researcher reviewed abstracted data alongside the original article to check for accuracy and completeness. Furthermore, the synthesis of qualitative data is problematic and dependent on the judgement and insight of the researchers (interpretation bias).37,66,67 To limit this bias, two independent researchers were used in the synthesis process.

Our systematic review indicates that implementation of significant primary care change should be cognisant of several considerations, mostly at the practice–practitioner interface. It comes at an important juncture for Australian health care reform, with reviews into the personally controlled electronic health record and Medicare Locals, and recent ministerial statements regarding funding reform for chronic disease management likely to have a major impact on the sector. For policymakers, they underline the approach and resourcing required to effectively influence service delivery. For clinicians, they highlight the teamwork, commitment and practice infrastructure critical to success. Australian health care reforms demand “a stronger, more robust primary health care system”.2 Addressing documented barriers to change adoption relevant in the Australian context will be a critical evidence-into-policy initiative.

1 Criteria for assessing quality of studies3436

  • Aims and objectives clearly stated
  • An explicit theoretical framework, study design and/or literature review
  • A clear description of context
  • A clear description of the sample and how it was recruited
  • A clear description of methods used to collect and analyse data
  • Attempts made to establish the reliability or validity of data analysis
  • Inclusion of sufficient original or synthesised data to mediate between evidence and interpretation
  • Use of verification procedure(s) to establish credibility
  • Conclusions supported by results
  • Relevance

2 Flow diagram outlining selection process of studies for analysis

Who’s responsible for the care of women during and after a pregnancy affected by gestational diabetes?

Gestational diabetes mellitus (GDM) is the strongest single population predictor of type 2 diabetes,1 and current Australian prevalence is 10%–13%, depending on the criteria used.2 Poor health outcomes extend to children of mothers who had GDM, due to increased risk of obesity and abnormal glucose metabolism during childhood, adolescence and adulthood.3

Antenatal lifestyle intervention is shown to improve short- and long-term maternal and infant health outcomes.3 In addition, it can effectively prevent type 2 diabetes among women who have had GDM.1 However, although some centres of excellence exist, in many cases, antenatal care is not delivered systematically.4

After their babies are born, women who have had GDM can be described as falling into a health care “chasm”.5 When these women leave hospital, their obstetricians and endocrinologists feel that their work is done. Lack of coordination between the hospital and primary care sectors can mean that no one assumes responsibility for the care of these women.

The opportunity to prevent or delay type 2 diabetes in this high-risk population through primary care was noted more than a decade ago.6 However, defined care pathways and coordination remain elusive; implementation of evidence has not occurred. In many cases, general practitioners may not be aware that the woman has had GDM, and may not have a clear pathway directing responsibility for follow-up care.

There is an urgent need to implement a widespread and coordinated approach to prevent progression to type 2 diabetes in this population. Rectifying this situation requires cooperation and collaboration between all care providers.

Antenatal care: navigating the new gestational diabetes landscape

The health care sector operates under guidelines with conflicting content and differing levels of comprehensiveness and professional endorsement (Box). The Australasian Diabetes in Pregnancy Society (ADIPS) recently released revised consensus guidelines for testing and diagnosing GDM in Australia and New Zealand.7

Women with GDM are managed in hospitals because they are identified as having pregnancies at higher risk of adverse outcomes. The ADIPS guidelines recommend an oral glucose tolerance test (OGTT) for all women (unless already diagnosed with GDM in early pregnancy) at 24–28 weeks’ gestation.7 These guidelines were informed by several studies, including the Hyperglycemia and Adverse Pregnancy Outcome (HAPO) Study, which indicated a strong continuous association of maternal glucose levels with increased diabetic fetopathy.14

A change to testing protocols will be introduced in July 2014 and diagnostic criteria on 1 January 2015 (Aidan McElduff, Clinical Associate Professor of Medicine, University of Sydney and ADIPS President; personal communication). Concerns exist about their potential workload implications and evidence base.

Health service and pathology database analyses have resulted in equivocal projections of the potential workload increases; it is most likely that many will see a doubling of cases.2,15 Workload projections can be difficult, as true prevalence is not known, but it has been suggested that the increasing rate reflects the prevalence of abnormal glucose metabolism in the general population.16

In considering potential workload costs and changes, we need to consider the results from two well executed randomised controlled trials, which demonstrated that treatment of GDM can prevent adverse outcomes.17,18 For most women (80%–90%), GDM could be managed through dietary counselling delivered by a dietitian. In some centres, this proportion will be lower, depending on population characteristics. Medical nutrition therapy is a cornerstone intervention for women with GDM,19 and its appropriate delivery results in reduced insulin requirements and improved blood glucose control.19 However, systematic, evidence-based dietetic care of women with GDM does not occur in many centres in Australia.4 Australian health services require clinician leadership and commitment to partnership and change in (re)allocation of resources to support a multidisciplinary team in providing evidence-based care for improved maternal and infant outcomes.

Some clinicians raise concerns about diagnostic criteria changes based on observational study outcomes, but the previous diagnostic criteria were the product of an ad-hoc working party and lacked the strong evidence base that underpins the current criteria.20

Postnatal follow-up: who’s taking responsibility?

Australian guidelines recommend that all women who had GDM should undertake a 75 g OGTT between 6 and 12 weeks after delivery.7 International guidelines also highlight the importance of lifestyle modification, breastfeeding, birth control and risk counselling to improve health outcomes for these women and their children.12,13

The extent to which these recommendations are integrated into postnatal GP visits is not known, but some studies suggest diabetes testing is suboptimal.21 Self-report surveys of women with prior GDM indicated that about half of participants returned for OGTTs, but only a quarter in the appropriate period.21,22 The potential use of glycated haemoglobin testing instead of the OGTT appeals to many, but the approach may not change until it is approved on the Medicare Benefits Schedule.

Appropriate strategies to engage women in screening are paramount, as the motivation to manage a GDM diagnosis transforms to apathy once GDM resolves.23 Barriers to ongoing screening include a lack of awareness of the need for screening, difficulty attending screening with an infant, dislike of the OGTT process, being a mobile population, and inconsistent advice from health care providers about testing, lifestyle modification and risk.2123 Findings from the United Kingdom suggest that health care professionals need to balance between reassurance of likely resolution of GDM and adequate information about potential progression to type 2 diabetes.23 Perception of risk is an important motivator; a lack of perceived risk of developing type 2 diabetes is common and can be related to timing, content and tone of messages.23,24

Prevention of diabetes in primary care

Which guidelines?

Three Australian guidelines exist for the follow-up of women who are at risk of type 2 diabetes (Box).79 Their core messages are similar, but they vary in several areas, diluting GP awareness and implementation. Beyond the timing of testing regimens, recommendations regarding lifestyle interventions to prevent type 2 diabetes progression are absent from the ADIPS guidelines, but the Diabetes Australia/Royal Australian College of General Practitioners (RACGP) Diabetes management in general practice 2014–20158 and Guidelines for preventive activities in general practice (the “red book”; also distributed to GPs in Australia)25 outline diabetes management and dietary advice for diagnosed cases in general practice and for diabetes prevention.

Many similarities exist between the diet for GDM and diabetes prevention (ie, focus on low glycaemic index, low saturated fat, high fibre content). However, during a pregnancy complicated by GDM, there is a major focus on tightly controlled blood glucose levels, although appropriate diet quality for pregnancy requirements and gestational weight gain is also paramount. By contrast, diabetes prevention diets have a greater focus on weight reduction. Currently, there is no effort to explain to women who have had GDM the difference in approach.

A missed opportunity?

Although GPs view follow-up care as their role within the broader context of general health screening and promotion, this is often opportunistic.26 Advice from GPs is a powerful motivator for women to adopt lifestyle modification.27 However, GPs report not being well versed in guidelines for GDM follow-up care, potentially reflecting the lack of clarity in the literature and their varying knowledge and confidence in provision of lifestyle advice and interventions.28 GPs generally give appropriate exercise advice, but can be less clear about dietary or weight loss goals.26

These practices are reinforced by systems and process barriers of prioritisation of issues during a consultation, a lack of integration of recall tools and intervention resources in daily workflow, and uncertainty about responsibility for screening, as well as poor communication between secondary and primary care sector and fragmentation of pre- and postnatal care services.28

Right information, right people, right time

Clinical trials have demonstrated that lifestyle modifications with weight loss and moderate exercise can reduce the incidence of type 2 diabetes by up to 58% for people at high risk, with an impact still evident 8 years from the intervention onset and 4 years after the active intervention ceased.29 Real-world implementation in the Australian health care system has achieved 40% reduction in the risk of progression to diabetes.30

Agreement between and willingness to work in partnership with key stakeholders — such as ADIPS, Diabetes Australia, the RACGP and the Royal Australian and New Zealand College of Obstetricians — is required for a collective approach to delivering diabetes prevention to this high-risk population.

However, despite convincing evidence about effective programs in Australia, postnatal support after a pregnancy with GDM is lacking and is without coordination. Interventions using technologies such as telephone, SMS and the internet have been trialled for diabetes care and may be useful in prevention. These must be underpinned by behaviour change theories and address barriers to making changes regarding future risk.23 Women have been identified as being receptive to messages several months after birth, which may align with “transition times” (eg, introduction of solids).23 Further efforts are urgently needed to develop lifestyle strategies that meet the specific needs of this group of women.

Diabetes Australia’s National Gestational Diabetes Register (NGDR), part of the National Diabetes Services Scheme, was launched in 2011 as a free service to women with a Medicare card to help those who have had GDM to manage their health and prevent progression to type 2 diabetes. One function of the NGDR is to send regular reminder letters to women and their GPs regarding diabetes checks (at registration, 12 weeks after birth, and annually thereafter). These reminder letters also include general information for the women and their families to help them continue a healthy lifestyle.

Although the NGDR outlines what testing to undertake, its potential to allow implementation and dissemination of a comprehensive, consolidated set of guidelines is perhaps underused. It could facilitate effective connection of women with a history of GDM with specific, effective, evidence-based lifestyle advice as well as clinical guidance for their GPs.

A call to action: the need for a collaborative approach

A clear pathway, developed between all stakeholders, with delineated roles and responsibilities to ensure that best-practice care is delivered along the continuum of antenatal, postnatal, interconception and longer-term care is required. Delivery of coordinated, effective programs is essential for this group of women. Without such clarity, and in the absence of a systems approach to care, we are failing to seize an opportunity to reduce the incidence of type 2 diabetes and promote the wellbeing of these women and their children. After a diagnosis of GDM, women view their GP as the most appropriate source of follow-up care,24 so it is imperative that GPs are given the right guidelines and education to advise these women about preventing or delaying progression to type 2 diabetes.

A comparison of current gestational diabetes mellitus diagnosis (GDM), treatment and follow-up guidelines

 

Details of guidelines


Guideline/society (country)

ADIPS (Australia and New Zealand)7

Diabetes Australia and RACGP (Australia)8

Therapeutic guidelines: endocrinology (Australia)9

ACOG (US)10

ADA (US)11

NICE (UK)12

CDA (Canada)13

Antenatal testing protocol

Universal OGTT at 24–28 weeks; earlier if clinically indicated

Universal screening at 26–28 weeks. Two-step approach recommended (GCT then OGTT).

Universal GCT or OGTT at 26 weeks. Early screening if high risk

Universal OGTT at 24–28 weeks in women not previously diagnosed with overt diabetes

At 24–28 weeks if the woman has any risk factors or earlier if GDM in a previous pregnancy

Universal screening 24–28 weeks. Two-step approach preferred (GCT then OGTT)

Timing of first postpartum follow-up visit

6–12 weeks

6–12 weeks

6–12 weeks

6–12 weeks

6–12 weeks

6 weeks

6 weeks – 6 months

Which test(s) for postpartum screening

75 g OGTT

75 g OGTT

75 g OGTT

FPG or 75 g OGTT

75 g OGTT; not HbA1c

FPG

75 g OGTT

Who with?

GP

Frequency of follow-up and recommended test

Dependent on future pregnancy plans and perceived risk of type 2 diabetes, yearly OGTT if planning pregnancy. 1–2 yearly FPG (low risk); OGTT/HbA1c (higher risk)

3-yearly; with FPG

If postnatal test normal: annual fasting or random blood glucose or OGTT every 2 years and before subsequent planned pregnancies

3-yearly, as above

Minimum 3-yearly; with OGTT. If IFG or IGT, yearly

Yearly; no blood test specified

At least 3-yearly and before each pregnancy; not specified

Other postnatal advice included

No recommendations

Increase physical activity, weight loss/healthy diet. Refer to dietitian and/or physical activity program. Preconception advice.

Risk counselling for future type 2 diabetes. Lifestyle advice: diet/physical activity. Subsequent pregnancy: early screening 12–16 weeks repeated at 26 weeks.

Weight loss and physical activity counselling as needed

Women with a history of gestational diabetes found to have prediabetes should receive lifestyle interventions or metformin to prevent diabetes.

Lifestyle advice: weight control, diet and exercise

Lifestyle advice to prevent diabetes and cardiovascular disease should begin in pregnancy and continue postpartum. Encourage breastfeeding for at least 3 months postpartum. Provide risk and preconception counselling.


ACOG = American College of Obstetricians and Gynecologists. ADA = American Diabetes Association. ADIPS = Australasian Diabetes in Pregnancy Society. CDA = Canadian Diabetic Association. FPG = fasting plasma glucose. GCT = glucose challenge test. HbA1c = glycated haemoglobin. IFG = impaired fasting glucose. IGT = impaired glucose tolerance. NICE = National Institute for Health and Clinical Excellence. OGTT = oral glucose tolerance test. RACGP = Royal Australian College of General Practitioners. UK = United Kingdom. US = United States.