The global health agenda identifies non-communicable diseases, including asthma, as a key priority area for improvement in care and outcomes. Despite effective treatments and guideline recommendations supporting careful diagnosis and good patient care, a significant proportion of the estimated 235 million people globally with asthma,1 live with on-going symptoms and there are nearly 250,000 deaths each year.2,3 This is the equivalent of 10 jumbo jets crashing every week of the year causing the deaths of nearly 700 people on board each time.4 Most of this burden of disease is avoidable with proactive, evidence-based care. A systematic approach to identifying poor asthma control and addressing the problems that make asthma “difficult to manage” is within the capabilities of a trained and activated primary care system.4
The International Primary Care Respiratory Group (IPCRG) is a network of national organisations committed to improving assessment and treatment of those common chronic respiratory diseases (CRD) managed predominantly in primary care. A key principle of the network is “working locally, collaborating globally to improve respiratory health in primary care”.5 In line with the 2010 Lancet Commission on Education, we believe we have a role in extending academic learning into communities, developing global collaborative networks for mutual strengthening, and leading in the promotion of a culture of critical inquiry and public reasoning6 about the best ways to deliver effective respiratory care. As a charity, IPCRG supports improvements in health systems within member countries by distilling and disseminating research evidence.
A recent example is a “Teach the Teacher” programme to promote the findings from U-BIOPRED (Unbiased BIOmarkers in PREDiction of respiratory disease outcomes) research into different phenotypes of asthma7 by the dissemination of short practical guidance distilled from the evidence on a structured asthma review (Table 1) contained in a desktop helper on difficult to manage asthma.8,9
“Difficult-to-manage” asthma describes a condition that either the person affected or the clinician finds challenging. This includes people:
-
who – for various reasons – don’t or can’t take their treatment as recommended
-
with other conditions affecting their asthma, including allergy, other diseases and psychosocial factors
-
those misdiagnosed with asthma, for example recent studies have raised concerns that up to a third of patients diagnosed (and treated for) with asthma do not have a robust diagnosis.10
-
with severe asthma, which remains uncontrolled, despite best treatment. This is a minority of people with ‘difficult to control’ asthma in whom less common phenotypes, co-morbidity or complications mean that they will benefit from specialist care.
One approach to building capacity in primary care highlighted in the IPCRG’s education strategy11 is a model called “Teach the Teacher” (TtT). This is an educational intervention which seeks to develop capacity for teaching subject-specific knowledge and skills through a cascade approach. It supports adaptation to local contexts in order to address challenges faced by local teams, overcome barriers and optimise facilitators within the political, financial and healthcare systems. Evaluation of the impact of TtT interventions requires a multilevel approach.
METHODS
In January 2015, we launched a TtT: “Difficult to Manage Asthma” programme. We convened an expert faculty, including professionals with clinical and educational expertise, and patient representation from the European Federation of Asthma and Airways Diseases Patients Associations (EFA). We brought together two clinical colleagues from each of eight European countries (Romania, Greece, Turkey, Ireland, Italy, Netherlands, UK and Portugal) to develop their skills in teaching primary care peers and then to design educational programmes within their own country adapted to local health systems and needs. Romania and Turkey are categorised as upper-middle-income countries, the remainder are high-income economies, but all are working within financial constraints that require better outcomes for the same level of resource.
Our aim was to build a trusted network of in-country teachers with the knowledge, influence, communication and teaching skills to deliver effective workshops to adult learners, which was relevant to the local context and which could be embedded in local primary care practice and cross sector healthcare pathways. We emphasised both subject specific knowledge (U-BIOPRED /difficult to manage asthma) and teaching skills, including facilitating learning, teaching methods, and programme design. We wanted our colleagues to think about what they were teaching but also the process of learning and change. Each country delegation were given the task of developing a local training programme on “difficult to manage” asthma, which was supported by on-going access to the TtT faculty and a small budget. We explored impact using an adapted professional development/educational evaluation framework12 informed by: i) participant reactions, ii) participant learning, iii) organisational support and change, iv) use of new knowledge and skills, v) impact on participants, practice and service users. The framework was selected because it is simple and has good face validity. It is based on the educational evaluation work of Kirkpatrick13 – which, although developed in a business context, has been used in the context of medical education.14 In the context of a TtT initiative, the evaluation has to be applied at both the initial programme training and in-country project level.
RESULTS
The TtT meeting was attended by 16 clinicians (13 general practitioners, 2 secondary care colleagues and 1 specialist nurse). The programme was facilitated by a faculty of three primary care respiratory specialists (HP, DR, JCS) working with an educationalist (JMcD);, we also involved a patient representative (EFA).15
Programme level evaluation
At programme level we had strong ‘positive participant reaction’ following the event, captured by post-workshop questionnaires (response rate 15/15). The workshop was rated highly by all participants, with overall scores of 4 or 5 (where 5 was ‘excellent’). We had excellent engagement throughout the programme, with evidence of “participant learning”, "use of new knowledge’ and ‘organisational change’ in the form of seven written proposals planned at the event and subsequently submitted to the expert faculty for approval. These proposals covered the plans for national/local events and plans for evaluation; evaluation strategies were discussed at the workshop, although we did not impose any standardised evaluation methods. At the end of the project we conducted an online/email survey of the eight country leads. Seven in-country programmes were delivered within project timescales March - December 2015. An important feature of the programme level evaluation shows considerable variation in the design and focus of in-country events.
-
Four countries (Italy, Turkey, UK, Greece) opted for focused educational event(s); one was a multi professional meeting, one focused on early career doctors, two held events in different regional locations.
-
Three countries (Netherlands, Portugal, Romania) opted for a cascade approach – training an in-country faculty with the purpose of rolling out regional events.
-
One country, Ireland, has yet to run a programme.
Over 230 health professionals participated in these educational events in seven countries, including specialist nurses, physiotherapists, general practitioners (GP), early career GPs, and GPs with a special interest in respiratory disease.
In-country programme level evaluation
Findings from the survey of in-country leads showed the importance of local needs assessment and adaptation.
Local needs assessment
This involved thinking about the audience and not assuming the teaching faculty knew what it was they need to learn. This was completed in some country programmes using methods such as questionnaires, interviews or email correspondence. This groundwork was felt to be important as it allowed adaptation of the educational event so that it was responsive to local social and healthcare context and allowed local variation and needs to be highlighted. An additional benefit of the needs assessment was that it engaged the potential audience and ensured their buy-in to the programme at an early stage (unpublished communications, JMcD).
Local adaptation
In the Netherlands, colleagues conducted a three-round Delphi exercise with all of their stakeholders to adapt and agree the learning material and approach.16 This led to the adaptation of SIMPLES, an acronym that does not work in all languages, to the Alphabet – “A–I of difficult-to-manage asthma” which resonated with an established Dutch “A–E” acronym for determining asthma control (Table 2). Crucially, this approach ensured that the programme was ultimately adopted into the routine training of primary care clinicians thus ensuring sustainability (unpublished communication, JMcD).16
More generally, the evidence provided from in-country programmes which evaluated ‘participant learning’ – tended to be short term and derived from pre- and post-workshop questionnaires which test knowledge but do not assess changes in clinical practice. In the survey of in-country leads we asked about organisational context which may have helped or hindered the in-country intervention. A strong educational intervention may be hindered by organisational factors. Results included logistics/geography, different systems in primary care, lack of incentives and/or finance (unpublished communications, JMcD). It was difficult to evaluate participants’ use of new skills and knowledge from in-country programmes. Similarly evidence of impact on participants, practice and service users is difficult to assess (unpublished communications, JMcD). We concluded that it may be too early to assess this factor especially in view of the small scale of the intervention, the lack of predetermined outcome measures coupled with the complexity of data collection and reconciliation across different healthcare systems.
DISCUSSION
The cascade TtT model is an affordable method for delivering specific education from a central source of knowledge to learners at a local level (eg, healthcare professionals) through multiple layers or programmes. This model is commonly used for in-service training in various professional environments, and has been shown to rapidly build knowledge and skills in healthcare settings.17 However, despite its perceived advantages, a key question relates to whether core educational messages become diluted or are misinterpreted through repeated cycles involving multiple teachers. This question of ‘fidelity’ has also been explored in the context of implementation science relating to evidence based interventions for improvement.18 Stirman et al suggest that modifications may enhance or may compromise proposed interventions outcomes.18 The IPCRG’s TtT model uses the principles of cascade but actively encourages adaption to local contexts in order to promote adoption in different health systems. Understanding the rationale and quantifying the adaptation are of interest as advocated by Stirman et al.18 Examples include who makes the modification; what was modified; at what level; what is the nature of the context modification; what is the nature of the content modification?
We believe a further important consideration relates to the leadership of the educational programme. While the research and evidence base underlying any educational or service improvement is important, it is also important to select teachers or leaders who are trusted and respected by colleagues – and in this case knowledgeable and committed to respiratory and primary care. Researchers or hospital-based clinicians may be able to cite the evidence, but they may not have direct experience of the community based professional context of the people they are teaching.
This evaluation helped us understand the challenges of local implementation. We know that over 230 health professionals took part in educational events in seven countries; that there was variation in the design and focus of in-country events. We know that teams encountered various challenges in assessing learning needs, setting up education programmes and in supporting clinical practice change. We conclude that evidence for clinical practice change is harder to achieve without additional local resources and a longer-term strategy. It is evident that some of our partners in this project had a longer-term strategy while others did not (unpublished communication, JMcD).16
CONCLUSIONS
The partnership between IPCRG and colleagues in European primary care organisations supported the promotion of a strategy to address “difficult to manage asthma” by increasing the capacity to teach in primary care settings and selecting appropriate and welcomed content. We developed a network of colleagues who can work on other programmes. With an established network of teachers we can now explore the potential for working in different ways eg, e-learning or virtual programmes which may require a different skill set.
Acknowledgements
We would like to acknowledge our collaborators, the Teach the Teacher Faculty, including colleagues at the European Federation of Asthma and Airways Diseases Patients Associations and the first cohort of in-country Teachers.
Funding
An educational grant was provided by The European programme U-BIOPRED and the education programme included an update on the findings of U-BIOPRED on severe asthma. The funder had no role in the education programme design, evaluation, data collection, data analysis, or write-up of the paper.
Competing interests
The authors completed the Unified Competing Interest form at http://www.icmje.org/coi_disclosure.pdf (available upon request from the corresponding author), and declare no conflict of interest.
Correspondence to:
Juliet McDonnell IPCRG,
PO Box 11961
Westhill, Aberdeen
AB32 9AE, UK
[email protected]