Académique Documents
Professionnel Documents
Culture Documents
2010****************************************************
Co-investigators:
Dr Angela M Alexander BPharm MSc FRPharmS FCPP MBE
Dr Pamela M Denicolo AFBPsS CPsychol FHEA (Hon)MRPharmS
Research Assistant:
Rebecca Z Herbert BA MSc
September 2010
Page i
Abstract
Background
Currently, all pharmacists and technicians registered with the Royal Pharmaceutical Society
of Great Britain must complete a minimum of nine Continuing Professional Development
(CPD) record (entries) each year. From September 2010 a new regulatory body, the General
Pharmaceutical Council, will oversee the regulation (including revalidation) of all pharmacy
registrants in Great Britain. CPD may provide part of the supporting evidence that a
practitioner submits to the regulator as part of the revalidation process. Gaps in knowledge
necessitated further research to examine the usefulness of CPD in a pharmacy revalidation
model in Great Britain.
Project aims
The overall aims of this project were to summarise pharmacy professionals past involvement
in CPD, examine the usability of current CPD entries for the purpose of revalidation, and to
examine the impact of revalidation standards and a bespoke Outcomes Framework on the
conduct and construction of CPD entries for future revalidation of pharmacy professionals.
We completed a comprehensive review of the literature, devised, validated and tested the
impact of a new CPD Outcomes Framework and related training material in an empirical
investigation involving volunteer pharmacy professionals and also spoke with our
participants to bring meaning and understanding to the process of CPD conduct and
recording and to gain feedback on the study itself.
Key findings
The comprehensive literature review identified perceived barriers to CPD and resulted in
recommendations that could potentially rectify pharmacy professionals perceptions and
facilitate participation in CPD.
The CPD Outcomes Framework can be used to score CPD entries
Compared to a control (CPD and revalidation standards only), we found that training
participants to apply the CPD Outcomes Framework resulted in entries that scored
significantly higher in the context of a quantitative method of CPD assessment.
Feedback from participants who had received the CPD Outcomes Framework was positive
and a number of useful suggestions were made about improvements to the Framework
and related training.
Entries scored higher because participants had consciously applied concepts linked to the
CPD Outcomes Framework whereas entries scored low where participants had been
unable to apply the concepts of the Framework for a variety of reasons including
limitations posed by the Plan & Record template.
Feedback about the nature of the revalidation standards and their application to CPD was
not positive and participants had not in the main sought to apply the standards to their
CPD entries but those in the intervention group were more likely to have referred to the
revalidation standards for their CPD. As assessors, we too found the process of selecting
and assigning revalidation standards to individual CPD entries burdensome and
somewhat unspecific.
Page ii
We believe that addressing the perceived barriers and drawing on the facilitators will help
deal with the apparent lack of engagement with the revalidation standards and have been
able to make a set of relevant recommendations.
We devised a model to explain and tell the story of CPD behaviour. Based on the concepts
of purpose, action and results, the model centres on explaining two types of CPD
behaviour, one following the traditional CE pathway and the other a more genuine CPD
pathway.
Entries which scored higher when we applied the CPD Outcomes Framework were more
likely to follow the CPD pathway in the model above. Significant to our finding is that
while participants following both models of practice took part in this study, the CPD
Outcomes Framework was able to change peoples CPD behaviour to make it more inline
with the CPD pathway.
The CPD Outcomes Framework in defining the CPD criteria, the training pack in teaching
the basis and use of the Framework and the process of assessment in using the CPD
Outcomes Framework, would have interacted to improve participants CPD through a
collective process.
Participants were keen to receive a curriculum against which certainly CE-type activities
could be conducted and another important observation relates to whether CE has any role
to play in pharmacy professionals revalidation.
We would recommend that the CPD Outcomes Framework is used in the revalidation of
pharmacy professionals in the future provided the requirement to submit 9 CPD entries
per annum is re-examined and expressed more clearly in relation to what specifically
participants are being asked to submit i.e. the ratio of CE to CPD entries.
We can foresee a benefit in setting more regular intervals which would act as deadlines
for CPD submission in the future.
On the whole, there is value in using CPD for the purpose of pharmacy professionals
revalidation in the future.
Page iii
Acknowledgements
This study was supported by the RPSGB with Department of Health funding. We thank Dr
Candice Stockton at the University of Reading for her assistance during the initial process of
grant application. We would like to thank the RPSGB research steering committee, including
Dr Andreas Hasman and of course all current members including Beth Allen, Janet Flint and
Sadia Khan and in particular Professor Christine Bond and Dr Peter Wilson for supporting the
fruition of our initial proposal. We extend a special thanks to a number of CPPE staff
including its Director, Dr Chris Cutts, office manager Julie Kennedy and a host of CPPE tutors
for sanctioning the recruitment of study participants from a variety of venues hosting joint
CPPE-RPSGB CPD workshops during July and September 2009. We are of course grateful for
the contribution and input of all participants in this study, regardless of the degree of their
involvement. A special thanks to all colleagues in the Pharmacy Practice Department at
Reading School of Pharmacy for their unfailing support.
The Principal Investigator would also like to extend a special thanks to Dr Paul Weeks for
facilitating time management.
There are things we can measure, like time, but yet our minds do not grasp their meaning. There
are things we cannot measure, like happiness or pain, and yet their meaning is perfectly clear to
us. Robert M MacIver.
University of Reading 2010
Page iv
Contents
Abstract .................................................................................................................................................... ii
Acknowledgements .................................................................................................................................. iv
Contents ................................................................................................................................................... v
Chapter 1: Introduction ............................................................................................................................. 1
Chapter 2: Literature review ...................................................................................................................... 6
Chapter 3: Design and methodology ........................................................................................................ 17
Chapter 4: Results ................................................................................................................................... 21
Chapter 5: Discussion ............................................................................................................................. 26
Chapter 6: Summary, main conclusions, and recommendations ............................................................... 33
References .............................................................................................................................................. 35
Appendix 1 ............................................................................................................................................. 38
Annex C: The GPhC Standards of proficiency for pharmacy professionals .......................................... 38
Appendix 2 ............................................................................................................................................. 52
Annex E1: GPhC Continuing Professional Development Standards and Framework ............................ 52
Appendix 3 ............................................................................................................................................. 60
Tables, figure and box relating to the literature review ......................................................................... 60
Appendix 4 ............................................................................................................................................. 84
Planned interventions .......................................................................................................................... 84
Flow of participants ............................................................................................................................ 85
Appendix 5 ............................................................................................................................................. 86
Ethical application .............................................................................................................................. 86
Appendix 6 ............................................................................................................................................. 89
Letter to Director of CPPE .................................................................................................................. 89
Appendix 7 ............................................................................................................................................. 92
Recruitment documentation ................................................................................................................. 92
Appendix 8 ........................................................................................................................................... 100
Seeking initial opinions on the face-validity, clarity/complexity, user-friendliness of the CPD Outcomes
Framework........................................................................................................................................ 100
Appendix 9 ........................................................................................................................................... 116
Seeking to verify the content of the CPD Outcomes Framework using the Content Validity Index ..... 116
Appendix 10 ......................................................................................................................................... 118
Quality assuring the training material: internal reviewer feedback form ............................................. 118
Appendix 11 ......................................................................................................................................... 124
Instructions for submission of CPD records ....................................................................................... 124
Appendix 12 ......................................................................................................................................... 128
The printed material sent to the intervention group.......................................................................... 128
Appendix 13 ......................................................................................................................................... 192
The printed material sent to the control group ................................................................................. 192
Appendix 14 ......................................................................................................................................... 198
Template used for scoring the CPD entries ........................................................................................ 198
Blank template for assessment of CPD cases ..................................................................................... 199
Appendix 15 ......................................................................................................................................... 200
Scoring by two pharmacist raters ....................................................................................................... 200
Appendix 16 ......................................................................................................................................... 202
Information relating to the focus group interviews ............................................................................. 202
Appendix 17 ......................................................................................................................................... 208
Information relating to the telephone interviews ................................................................................ 208
Appendix 18 ......................................................................................................................................... 212
Exploring the data using quantitative analyses ................................................................................... 212
Page v
Page vi
Chapter 1: Introduction
Background
Continuing Professional Development (CPD) in broad terms refers to the idea that learning
continues throughout ones professional career, through educational courses, work
experience and practice.1, 2 CPD is not the same as continuing education (CE) alonewhich is
the more traditional approach to learning via structured educational activities such as
lectures, workshops, and distance-learning courses.3 Underlining CPD in pharmacy is the
notion that professionals can take responsibility for their own learning, behaviour and career
development.4 As a process, CPD centres on experiential learning, which Kolbs model
simplifies into a cycle of reflection, planning, action, (recording) and evaluation. 5
Documentation is an integral part of CPD and a personal portfolio can be used for this
purpose.6 For pharmacists in Great Britain (GB), a CPD template supported online by a
bespoke website Plan & Record (and also available in print) is recommended by the Royal
Pharmaceutical Society of Great Britain (RPSGB) at the present time (September 2010).7
A consultation with GB pharmacists in 1996 identified potential for CPD to be introduced and
made mandatory for all those registered with the RPSGB.8 CPD was piloted in 1999 and
together with an approved recording format CPD was introduced to the pharmacy profession
during 20022004.9 Subsequently, amendments to the Pharmacy Code of Ethics replaced a
previous requirement to undertake 30 hours of CE with a CPD requirement and since January
2005 all pharmacists and pharmacy technicians registered with the RPSGB have given an
annual undertaking to comply with CPD requirements.10 Currently, all GB-registered
pharmacists and technicians must complete a minimum of 9 CPD record (entries) each year.11
Internationally too, there has been a shift towards CPD from traditional models of CE.12 The
International Pharmaceutical Federation (FIP) adopted the concept of CPD in 2002 describing
it as the responsibility of individual pharmacists for systematic maintenance, development and
broadening of knowledge, skills and attitudes, to ensure competence as a professional, throughout their
careers.13 One of the reasons for the shift towards CPD is the limited evidence of effect of
formal CE activities on the behaviour of the practitioner.14 But CPD could also be useful in
helping to assess pharmacy professionals fitness-to-practise.
While the RPSGB has traditionally acted in both a professional and a regulatory capacity,
from the end of September 2010 a new regulatory body, the General Pharmaceutical Council
(the GPhC), will oversee the regulation of all pharmacy registrants (pharmacists and
registered pharmacy technicians) in GB. The GPhC will become responsible for supporting
CPD, which will become a statutory requirement for pharmacy registrants 15, but the GPhC
will also gain responsibility for the revalidation of pharmacists and technicians. Revalidation
of statutorily-regulated health professionals in GB relates to arrangements that will enable
them to periodically demonstrate their continued fitness-to-practise. To prepare for
revalidation, the RPSGB in 2009, guided by the recommendations of the Department of
Health Non-Medical Revalidation Working Group and its own Revalidation Advisory Group
(RAG) report, agreed to a set of ten principles to underpin revalidation design and delivery in
pharmacy.16 Among the principles were the requirements that the process of revalidation
should be effective and cost-effective, evidence-based and standards-based and be consistent
across the country. The recommendation to Ministers from the Non-Medical Revalidation
Working Group stipulated that CPD may provide part of the supporting evidence that a
practitioner submits to the regulator as part of the revalidation process.
This
recommendation was reflected within the RPSGBs submission to the Department of Health
in February 2009. Within the principles for implementation of revalidation in pharmacy the
RPSGB argued that:
University of Reading 2010
Page 1
Page 2
awaiting preparation and in fact were launched at BPC in Sept 2009 and then online in Oct
2009. See Appendix 1 for the version of the revalidation standards (also referred to in this
study as proficiency standards) and Appendix 2 for the version of CPD standards available at
the start of the study and again used throughout. A distinct feature of the current project
was the requirement to explore the applicability and sustainability of the use of these
revalidation standards within the RPSGB CPD framework (Plan & Record). The RPSGB was
awarded a grant by the Department of Health to investigate evidence for revalidation, and we
were subsequently commissioned by the RPSGB to explore the value of CPD for revalidation
of pharmacy professionals in GB. Based on the New Zealand model, we proposed to develop
a bespoke CPD Outcomes Framework to guide participants in the completion of their CPD
against the RPSGB revalidation standards. In this way we set out to help pharmacy
professionals conduct and demonstrate the practical application of their CPD in terms of
safety, quality and effectiveness where possible in relation to patient care, or as stated above
through the concepts of relevance and effectiveness.
Page 3
Our objective was to address this point via the collation and analysis of the literature and
empirical evidence gathered through the course of the research to form a concrete set of
recommendations about the appropriateness of the existing CPD frameworks as part of
revalidation.
Summary of chapters
Summary of Chapter 2: Literature review
This chapter outlines a comprehensive review of the published literature to chart the
participation and beliefs of pharmacy professionals in GB in relation to CPD in a decade
(2000-2009) that had seen a formal transition from CE to CPD requirements. The
implications of the findings, which primarily concern the decade in question, are related to
regulatory, professional, work-related and ultimately personal responsibilities, resulting in a
set of recommendations for each.
Summary of Chapter 3: Design and methodology
We set out to conduct the practical element of this work with volunteer pharmacy
professionals who would join as study participants. We proposed to develop a CPD Outcomes
Framework accompanied by training material to guide participants in the completion of their
CPD against the revalidation standards. To fulfil the objectives of this study, we wanted
participants to submit CPD entries before and after receipt of the Outcomes Framework (or
CPD and revalidation standards only) to enable assessment of the impact of the standards on
both the conduct and the writing of CPD records. Participants would also be invited to
attend focus group interviews in order to discuss their experience of participating in the
study and their understanding of CPD in light of the new revalidation standards. This
chapter explains the methods used with cross reference to the appropriate Appendices.
Summary of Chapter 4: Results
Having outlined the manner in which the study was conducted, the results were presented
under two distinct headings relating to the quantitative analyses of the entries as well as the
qualitative interpretative analyses conducted with the entries and the interview transcripts.
A separate section examines the usability of the revalidation standards. We examined the
impact of the CPD and revalidation standards (with and without the training related to the
CPD Outcomes Framework) on both the conduct and the writing of CPD records in this
parallel-group before and after experiment. It must be emphasised that these revalidation
standards were in draft format at the time. The primary outcome measure for the
quantitative analyses was the CPD score obtained by averaging the ratings assigned by the
two investigators. We also wanted to identify gaps in relation to revalidation. We used
grounded theory analysis to examine the CPD entries, and thematic analysis to examine the
transcripts of the focus group interviews and the transcripts of the phone interviews to
devise and further validate a model to explain CPD behaviour. In relation to the revalidation
standards, we looked both at the use of these standards by the participants as well as
participants feedback about the standards. This chapter outlines the results with cross
reference to the appropriate Appendices.
Summary of Chapter 5: Discussion
We completed a comprehensive literature review of the literature, devised, validated and
tested the impact of a new CPD Outcomes Framework and related training material in an
empirical investigation involving volunteer pharmacy professionals and also spoke with our
Page 4
participants to bring meaning and understanding to the process of CPD conduct and
recording and to gain feedback on the study itself. This chapter outlines our commentary
and interpretation of those results with final recommendations according to the initial aims.
Summary of Chapter 6: Summary, main conclusions, and recommendations
Based on the findings of this study and our interpretations we made a series of conclusions
and recommendations against the original objectives of this research. This chapter outlines
those conclusions.
Page 5
2010) the
and 2009:
Literature
Education
Page 6
Index (BEI), Educational Resources Information Centre (ERIC), and Australian Education Index
(AUEI). An extensive search of the pharmacy specific literature was also conducted by
searching the following journals: Pharmacy Practice, the Pharmaceutical Journal (PJ) and
Pharmacy Education, to include where possible conference proceedings from Health Service
Research and Pharmacy Practice (HSRPP), British Pharmaceutical Conference (BPC), and
International Social Pharmacy Workshop (ISPW).
In addition, the search engine
GoogleScholar as well as the database of the National Electronic Library for Medicine
(NELM) were used in an attempt to capture studies published online not at first identified by
the more traditional means. The reference lists of all the critical articles were scanned to
check for other important studies that may have been missed via the database searches.
A variety of search terms was constructed for use within the databases including pharmacy,
pharmacist, education professional retraining, continuing pharmacy education, professional
development, learning, reflect, continuing education, CPD, continuing professional
development, professional portfolio pharmacy, work based learning, continuous professional
development and combined suitably according to the database used.
Study selection
The titles and abstracts of all articles and conference presentations were scanned and studies
of any design that had examined either the attitude of pharmacists to CPD or the uptake of
CPD in pharmacy in GB published from 2000 to 2009, inclusive, were included for initial
review by a research assistant under the guidance of the lead author (PD). Studies that were
identified as potentially relevant were initially screened (1329) after duplicates were
removed. A total of 54 articles, abstracts and research papers were selected for full-text
assessment from which 22 were included in this review after screening by two reviewers (a
research assistant and the lead author, PD) (see, Appendix 3, Figure 1 for a flow diagram
outlining the steps). The selected articles met at least one of the main criteria for this review
by presenting data on barriers or facilitators and attitudes in relation to pharmacy
professionals participation in CPD and/or mapping engagement with and uptake of CPD in
pharmacy in GB.
The methodology that had been adopted in the papers included quantitative research using
postal/emailed questionnaire surveys and qualitative research using mainly semi-structured
interview techniques. We chose to include papers with differing epistemology because we
wanted to capture the breadth of themes relating to CPD barriers rather than to measure and
quantify them. Some of the papers were investigating attitudes to CPD as part of a related
learning intervention. The majority of studies focused on pharmacists (rather than
technicians) and their engagement with and perceptions of CPD. Community pharmacy was
the main area of focus but some studies had examined other sectors or compared CPD
between sectors. Until recently pharmacy technicians have not been the subject of much
focus but two studies did examine this cohort.
A comprehensive search of PJ returned a variety of letters of communication and
commentaries sent to the journal, which were examined separately in this review for
identification of additional relevant themes.
Exclusion criteria
In relation to research papers, studies were excluded if the focus was on a different group of
health professionals with no orientation towards pharmacy. Papers were excluded if the
focus was simply on CE or professionalism per se or if the focus was only on the pharmacy
student cohort. Studies were also excluded if the country of focus was outside of GB; i.e.
studies conducted in Northern Ireland were excluded. In addition, papers were excluded if
the focus was purely on sub-sets of skills usually associated with CPD, such as reflective
Page 7
learning by itself, or on actual content relating to CPD, for example learning clinical
pharmacy. We did not include in the review a study examining feedback on CPD provided by
RPSGB because this very specific study did not investigate general attitudes to CPD but was
instead a form of satisfaction with feedback study. We did nonetheless acknowledge the
contribution of this study to the field in the discussion section of this paper. We did not
include any studies published or relating to the period before 2000 but viewed them as
providing context ahead of the launch of CPD. This review forms part of a bigger
investigation into CPD and while some studies were excluded from this review, they were
retained for use in the overall project.
Page 8
nomothetic approach using the quantitative survey method.18, 30-34 However, only three of
the thirteen research papers had been published in an indexed journal. 18, 31, 33 Six conference
abstracts or papers were identified, with four having used a qualitative approach 35-38 and two
a quantitative approach39, 40 to the research. In total six of the studies included in this review
(i.e. from the 13 papers and 6 conference abstracts mentioned above) evaluated CPD as part
of another programme or intervention related to CPD and learning.26, 27, 38, 40 Two news items
reporting the outcome of RPSGB surveys were also included in this review 41, 42 as was the
report of a relatively recent RPSGB-commissioned study by the PARN (Professional
Associations Research Network) consultancy firm (which compared data with other
professionals surveyed at the same time).43 None of the 22 studies that had met the inclusion
criteria were excluded on the basis of quality alone, but quality was expressed as the number
of QARI criteria met by each study and also considered in the discussion of our findings.
The facilitators and barriers to CPD were grouped into eight broad categories of time,
financial costs and resource issues, understanding of CPD, facilitation and support for CPD,
motivation and interest in CPD, attitudes towards compulsory CPD, system constraints, and
technical problems as described below.
Page 9
comfortable with identification of learning needs and assessing the value of what they had
learnt and with applying it to practice18, and a study conducted in 2006/2007 reported the
main benefit of the CPD process related to pharmacists increased understanding and use of
reflection, compared to CE.24 However, studies conducted as late as 2007 and 2008 still
reported confusion over what to record, how to record it, difficulty with choosing
competencies (to relate to ones CPD) and what counted as CPD. Pharmacy technicians were
also reported to have faced uncertainly about how to record CPD.40
Page 10
Page 11
views.44 Nearly one half of respondents thought changing Plan & Record to a more
accessible format would encourage them to record CPD.
Page 12
might find CPD challenging and 70% of technicians evaluated after a CPPE workshop
indicated they had used their learning to create a CPD entry.40
However, a recently published questionnaire study conducted in Wales found 50% of
respondents (n = 473) stated they did not have up-to-date CPD records with 255 not having
recorded any CPD in that 6-month period only one-third had up-to-date CPD records39.
Page 13
Discussion
This is the first comprehensive literature review to examine barriers to pharmacy
professionals participation in CPD in GB during the past decade (2000-2009). The barriers
have been categorised as time, financial costs and resource issues, understanding of CPD,
facilitation and support for CPD, motivation and interest in CPD, attitudes towards
compulsory CPD, system constraints, and technical problems. An absolute summary of the
findings is presented Appendix 3 in Box 1. It must be emphasised that this literature review
primarily concerns the decade investigated (2000-2009). While pharmacists on the whole
might agree with the principle of engaging with CPD there is little evidence in the literature
to suggest widespread and wholehearted acceptance and uptake of CPD, which would be
necessary before CPD could be reasonably expected to contribute to the universal
revalidation of pharmacy professionals in GB. However, we note with interest the following
extract from personal correspondence with an officer from the Regulation Directorate of the
RPSGB, which might indicate the beginnings of a shift in behaviour since the introduction of
call and review45:
There is anecdotal evidence of a change in attitude towards CPD since the RPSGB started calling
in and reviewing CPD records in July, 2009. During the first 6 months of the call and review
process, when just under 2,500 CPD records had been reviewed, the referral rate for noncompliance was just 1.5%. Furthermore, 80.3% of those who have had their records reviewed
achieved an overall assessment of excellent, meaning that for the entries reviewed they had
met 75% or more of the total assessable review criteria. A further 17.8% achieved an overall
assessment of good (between 50 and 74% of total assessable criteria met). This suggests that
the vast majority of the profession are now engaging with CPD and, when required to do so, are
comfortably meeting regulatory requirements.
The principal investigator (PD) has argued previously that it is peoples internal motivations
(identities and beliefs) that drive participation in developmental programmes.46 While a
number of pharmacists expressed negative personal attitudes towards CPD, the majority of
the research participants within the various studies seemed beset by the compound
interaction of barriers apparently outside of their control, such as time and resource issues.
A number of theories have been developed to examine the process by which people attribute
behaviour (including their own) to internal or external causes and there is now a large body
of evidence showing that peoples judgements about the causes of behaviour are not
completely rational but biased.47 A common observation is that people attribute successes
internally, as within their control, whereas failures are attributed externally to others or to
the circumstances, a concept captured by the term self-serving attribution bias.48 A selfserving bias is therefore said to exist where an individual's assignment of responsibility
affects his or her beliefs in an optimistic waya way that makes things appear better than
they are from the individual's point of view. We believe there may be an element of selfserving attribution bias at play in terms of pharmacy professionals stated barriers to CPD.
This importance of external influences would seem to indicate that making CPD a statutory
requirement would compel pharmacy professionals to engage with the process at some level.
Nonetheless, if CPD is to be truly successful, it seems that peoples beliefs and attitudes must
be addressed through the modification of the various other external barriers perceived to be
impacting on CPD behaviour.
The implications of the current findings can be considered as follows. If CPD is to succeed,
peoples beliefs and attitudes must be addressed by recognising and modifying barriers
through a combination of four main categories of regulatory, professional, work-related and
personal channels (see Appendix 3 Figure 2). We believe it is possible to draw on the current
Page 14
Page 15
Page 16
Page 17
Collating the new CPD records and examining both before and after records against the
revalidation standards as well as the Outcomes Framework devised.
Holding focus group interviews with study participants.
Analysing the data using qualitative interpretive methods as well as quantitative scoring
against the Outcomes Framework.
Project plan
A description of planned interventions and a depiction of the flow of participants are shown
in Appendix 4.
Ethical considerations
An ethical application (see Appendix 5) was made to the Chair of the School of Chemistry,
Food Bioscience and Pharmacy ethics committee on 2 July 2009 and appropriate University of
Reading ethical exemption was granted on 15 July 2009.
Participants
Volunteer participants attending joint RPSGB-CPPE (Centre for Pharmacy Postgraduate
Education) CPD training workshops in Reading, Banbury, Southampton, Kingston-uponThames and Guildford were recruited to the study in July and September 2009. The
agreement of the Director of CPPE, Dr Chris Cutts was sought on 14 July 2009 and granted on
17 July 2009 (see Appendix 6 for copy of letter to Dr Cutts).
Workshop participants received information about the intended recruitment activity in
advance of the sessions, where one of the researchers (PD or AMA) was at hand to provide
information about the study. An information letter and a statement of frequently-asked
questions formed the basis of discussions and willing participants were recruited to the study
after completion of a consent form and demographics questionnaire (see Appendix 7 for
material relating to the recruitment process).
A total of 83 participants were recruited to the project (exceeding a recruitment target of 72).
Our aim was to retain at least 60 participants for the final analysis. A total of 61 participants
submitted their initial CPD records to the study team and 48 (25 control and 23
intervention) remained in the study to the end.
Research Instruments
We developed and validated a grid to enable quantitative scoring of the records against
revalidation standards and named it the CPD Outcomes Framework. One purpose of the
Outcomes Framework was to guide participants in the intervention group through the
process of completing CPD records, to test the frameworks impact as an intervention
compared to a control group (who received the CPD and revalidation standards only).
The Outcomes Framework was based on a theoretical construct relating to CPD relevance and
CPD impact and specifically Standard 4 of the GPhCs CPD framework: include in your record
CPD that is relevant to safe and effective practice and the Standards of Conduct, Ethics and Performance of
the profession and Standard 5: record how your CPD has contributed to the quality or development of
your practice and has benefited patients and the public as well as the Proficiency Standards (i.e. the
revalidation standards). The Outcomes Framework was developed as a means of both
helping participants with the conduct and construction of CPD records for revalidation as
Page 18
well as helping assessors to rate CPD records for revalidation. The Outcomes Framework was
tested for face and content validity, as explained below.
The face-validity, clarity/complexity, user-friendliness of the Outcomes Framework was
established by obtaining feedback from five volunteer academic pharmacist practitioners
who were presented with the documentation detailed in Appendix 8. The documentation
explained the conceptual basis of the Outcomes Framework and sought detailed comments
from the expert practitioners. Where possible, the suggestions received were incorporated
into the Outcomes Framework as part of its development.
The content validity of the Outcomes Framework was established using the Content Validity
Index (see Appendix 9 for rationale and results). Later, the CPD Outcomes Framework
training material (see below) was passed on to two independent internal reviewers for their
assessment and quality assurance (see Appendix 10 for the reviewer information).
Training material
Based on the initial framework we produced a comprehensive training package for the
intervention group, which used as its basis the Outcomes Framework together with 11 new
CPD case scenarios. This training was reviewed by two internal reviewers from within the
University, in line with other course-related QA practices. The aim of the training package
was to encourage learning via the application of knowledge (active learning). To this end, we
asked participants to read through a minimum number of case studies before assessing the
example cases using the Outcomes Framework. We also provided answers to these 11 case
studies. We presented the training package as an Adobe Acrobat file (.pdf with embedded
links), a series of PowerPoint Presentations (.ppt) including presentations with narration (i.e.
as video files .avi) as well as a full-colour print version.
Research procedures
Upon recruitment, participants deemed experienced at recording CPD were asked to submit
copies of 3 existing records. Those considered CPD beginners submitted one record, which
they were permitted to construct following the CPD workshop if none existed beforehand.
All initial entries were submitted by the end of October 2009. See Appendix 11 for
instructions for submission of CPD records, as sent to the study participants. The
participants were subsequently assigned to either a control group or an intervention group
using stratified random sampling
Stratified sampling took account of professional grouping (pharmacist vs. pharmacy
technician), experience of CPD recording (practised vs. beginner) and sector of practice
(community, hospital, other). We randomised 61 study participants to one of two groups of
control (31) vs. intervention (30).
All participants received either the control (CPD and revalidation standards) or an
educational training intervention (CPD and revalidation standards plus training related to
the CPD Outcomes Framework) at the end of December 2009. See Appendix 12 for a copy of
the letters and printed material sent to the participants in the intervention group and
Appendix 13 for a copy of the letters sent to the participants in the control group [both
Appendices are minus the revalidation standards and CPD Standards (which are already
presented in Appendix 1 and Appendix 2 of this report)].
The training package was posted to all participants in the intervention group in December by
recorded delivery. Participants in the control group also received their material by recorded
delivery in December. All participants were asked to work through the revalidation-related
material during January and February with the target of returning two new CPD records by
University of Reading 2010
Page 19
28 February 2010. The participants were also asked to sign and return a statement of
learning related to their packs before or at the same time as submitting their new records.
Participants were asked to refrain from discussing the detail of their packs with others.
Participants then submitted two further CPD records by the end of February 2010. One of
the new CPD entries involved participants in rewriting an already-submitted record and the
other in conducting a CPD activity afresh using their knowledge of the CPD and revalidation
standards, with or without the related training.
Assessing the CPD entries via quantitative means
All CPD records were anonymised, pooled and assessed independently by two of the
pharmacist investigators (PD and AMA) blinded to the study stage and intervention type (i.e.
no obvious information to relate entries to each other or to stage of study remained on the
copies assessed). The raters independently scored the entries against the CPD Outcomes
Framework (see Appendix 14 for a copy of the assessment template used in order to grade
the entries). The detail of the scoring is included in Appendix 8 and further explained as part
of the text in Appendix 15. In summary, values for each of the variables consequence (C)
and likelihood (L), were assigned using the CPD Outcomes Framework to produce the
relevance (R) score (R = C x L), and also values were assigned for quality and benefit (Qb)
and strength of evidence (E) to produce the impact (I) score (I = Qb + E) for each entry. The
product of R and I scores (R x I) resulted in the CPD score. The investigators also sought to
assign one or more revalidation standards to the entries to test the possibility of relating the
entries to these standards.
Initially, the ratings of 56 of the records (selected at random) were entered onto the software
package SPSS and explored for a number of relationships detailed in Appendix 15. From
these analyses it was possible to demonstrate that in fact consensus agreement was equal to
averaging the scores assigned by each of the two pharmacist raters. Based on these analyses,
a decision was made to calculate an average CPD score (by taking the mean of PD and AMA
ratings for each record) for all of the CPD entries scored (226) and to use this average score
for all further analyses.
Data for 96 CPD entries written before and rewritten after the educational intervention were
transferred to SPSS and explored then subjected to tests for analyses of differences in CPD
scores (see Appendix 18 and Appendix 19). Further analyses involved exploring the data
relating to all of the CPD entries (226) submitted by the study participants both before and
after the intervention. More detail is provided in the results section. In addition to the
above, we examined the detail of 96 entries submitted at the after stage of the study
(rewritten and new) to quantify the number that explicitly referenced the revalidation
standards.
Assessing CPD entries, focus groups and interviews via interpretative methods
The CPD entries were analysed using interpretative methods and together with data from the
focus group interviews and the telephone interviews were used to devise a model to explain
CPD behaviour. We invited and recruited a total of 12 participants to two separate focus
group interviews (6 control and 6 intervention) lasting half a day each. See Appendix 16 for a
copy of the documentation relating to the focus groups. The transcripts of both focus groups
were analysed using thematic analysis and used in the formation of a model that explains
CPD behaviour. The template used for the focus group interviews was further developed into
an interview schedule for phone interviews with the participants. In total, 34 of the 48
participants who completed the study were interviewed over the phone in 20-30 minute
conversations, which also acted as feedback and debriefing sessions. See Appendix 17 for
copy of documentation relating to the phone interviews. More detail is provided in the
results section.
University of Reading 2010
Page 20
Chapter 4: Results
Foreword
Having outlined the manner in which the study was conducted, the results are presented
here under two distinct headings relating to the quantitative analyses of the entries as well as
the qualitative interpretative analyses of both the text of CPD entries and the focus group
and interview transcripts. A separate section examines the usability of the revalidation
standards. It must be emphasised that these revalidation standards were in draft format at
the time. We examined the impact of the CPD and revalidation standards (with and
without the training related to the CPD Outcomes Framework) on both the conduct and the
writing of CPD records in this parallel-group before and after experiment. The primary
outcome measure for the quantitative analyses was the CPD score obtained by averaging the
ratings assigned by the two investigators. We also wanted to identify gaps in relation to
revalidation. We used grounded theory analysis to examine the CPD entries, and thematic
analysis to examine the transcripts of the focus group interviews and the transcripts of the
phone interviews to devise and further validate a model to explain CPD behaviour. We also
used the interview transcripts to gain a better understanding of why some CPD entries had
scores high and some low.
Page 21
The linear model (linear regression model) was used to compare the intervention groups
adjusting for work setting, a linear effect of baseline (CPD scores before the educational
intervention) as well as an interaction between work setting and baseline scores (work
setting * mean CPD score at baseline). See Appendix 19 for the detail of the analyses.
Adjusting for baseline, work setting and an interaction between work setting and baseline
scores, the intervention effect was estimated to be a mean difference of 9.864 (95% CI = 0.418
to 19.310). This effect is statistically significant (p-value = 0.041).
Page 22
The second type of behaviour is captured in the upper part of the model and represents a
genuine connection with Kolbs model of experiential learning. Here, although an
immediate and necessary external condition will appear to be driving the CPD, for example,
a problem at work or a new role, it is the persons internal developmental motivations that
will drive the CPD. So while the need may exist externally, the individuals involvement in
the CPD will be driven internally, via an existing understanding of what it means to practise
continuing professional development. Although the activity may involve this type of pharmacy
professional in some element of learning, it is the integration of the learning with the work
setting that is at the crux of this behaviour. The impact is demonstrated through use of
language such as I have done. or I have been able to. This type of CPD is also accompanied
by some level of documentation that would demonstrate its application or at least reference
to feedback from patients and colleagues. This type of CPD invariably impacts the greatest
on practice and that in turn can be related back to the individuals own development, as
indicated by the top arrow in the diagram shown in Appendix 20.
Thematic analysis of the focus group and interview transcripts
Once the model above had been developed, we sought to conduct focus group interviews
with the participants as a first step towards verifying the model and its application to
participants own expressed understanding of their CPD. The interview guide for use during
the focus group discussions is presented in Appendix 16 and was based on the emerging
themes that informed the model, as highlighted in the left-hand column of the interview
schedules entitled theory. We categorised the transcripts according to the themes identified
in the model and looked for additional themes. In fact, while a number of interesting and
additional features were obtained, the model itself remained unchanged and it was possible
to categorise participants approach to CPD using either the CE or CPD pathways. The
additional supporting themes are described in Appendix 20. In summary, they related to
Time spent on CPD and the Plan & Record CPD template and Understanding of current
assessment of CPD. With the former concept, it meant that those following the CE
pathways are more likely to view CPD as something that can be easily conducted and
recorded to result in the completion of an entry but those following the CPE pathway
appreciated that time, perhaps their own, would need to be invested before truly worthwhile
CPD could come into fruition and be recorded as complete.
Some also expressed a level of anxiety in relation to the current assessment of CPD and its
robustness.
As well as obtaining opinions about participants understanding of CPD, the focus groups and
telephone interviews were used as an opportunity to gain participants opinion of the CPD
Outcomes Framework to enable its further development. The participants were also asked
about their general experiences with the study. While the main concepts are presented in
Appendix 21, a summary is provided below.
Feedback about the CPD Outcomes Framework
Although some found the framework difficult to grasp at first and sought clarification of
some of the descriptors, on the whole, the CPD Outcomes Framework appeared to have
caused a paradigm-shift with participants reporting it had directed their thoughts and
focussed their CPD activities for the better. A number also commented that it would be
difficult to conduct CPD to this level 9 times a year. Some specifically useful feedback
provided by the participants related to the perception that more experienced professionals
practice would be deemed less risky and therefore naturally return a lower relevance score.
And also ideas around risk and shared responsibility for risk, making it difficult to
conceptualise anyones individual practice as having the potential to impact on overall
organisational risk to any great extent. Overall, participants found the quantification of CPD
Page 23
helpful, the electronic storage of entries useful and the framework applicable to practice.
One participant expressed anxiety about other pharmacy professionals ability to grasp the
concept.
Other comments related to perceptions that the framework made CE-type learning invalid,
did not value potential benefit in the absence of proof and interestingly that the CPD
Outcomes Framework could not feasibly be used if out of work (non-practising). Participants
also picked up that the framework would direct a portfolio-based approach to CPD.
Participants feedback about the study itself and further suggestions
Feedback about the study was very positive overall. The most relevant feedback related to
perceptions about the incompatibility of the current CPD template of Plan & Record and
what the CPD Outcomes Framework was attempting to achieve. Similar to views expressed
in the focus groups, there was a perception again that the current assessment of entries
lacked tangible criteria. Some interesting views were also expressed about a need for a direct
and focussed curriculum that would enable more focussed CE type learning and a view that
CPD could be presented to assessors as structured case scenarios to convey the information
more than can be achieved with the current Plan & Record template.
A number of direct quotes about participants positive perceptions of the CPD Outcomes
Framework are included in Appendix 21.
Participants own perceptions of high- and low-scoring CPD entries
In addition to the quantitative assessment of the CPD entries, we wanted to assess particular
features of entries that scored high or those that did not. We did this by examining the
content of the entries and the feedback that participants themselves gave about these entries.
Interestingly, one participant who used case scenarios to construct their after entries scored
high in these. We chose to examine information from the interviews because we wanted to
bring participants own understanding to the analyses. The findings are presented in
Appendix 22. In summary entries scored high because participants could relate these to risk,
relevance and actual practice, participants understood the CPD Outcomes Framework and
made a conscious decision to comply, or entries were chosen for which good evidence
existed. CPD entries scored low if there was insufficient evidence of impact at the time of
writing/completion, if participants had not understood the requirements because of a lack of
information and feedback, if Plan & Record hindered appropriate expression of CPD or if
participants were unable to apply their learning to practice because they were out of work.
Page 24
intervention). However, see below for a quantitative comparison that did demonstrate a
small difference in approach.
We used NVivo 8 (qualitative data analysis software) to examine the interview data from the
34 participants using thematic analysis. This resulted in the identification of a number of
themes. First-order coding resulted in a number of descriptive labels, which were then
grouped under five main categories during second-order coding, resulting finally in the
identification of two dominant themes during third-order coding. The two dominant themes
of Working with the Standards of Proficiency and Yet to accept the Standards of
Proficiency and the respective second-order and first-order codes are shown in a schematic
in Appendix 23.
Because a number of themes have been identified in relation to both working with and
yet to accept the revalidation standards, we take the view that addressing the perceived
barriers and also drawing on the facilitators will help deal with the apparent lack of
engagement with the Proficiency Standards. We provide our recommendations on how CPD
can be linked to proficiency standards in the discussion section.
The use of Revalidation Standards in CPD
Under closer scrutiny, we were able to quantify the use of the Revalidation Standards in
participants CPD entries. We examined the detail of 96 entries submitted at the after stage
of the study (rewritten and new) to quantify the number that had drawn on the Revalidation
(Proficiency) Standards. The data were cross-tabulated and examined in relation to the
number that had used the Revalidation Standards in each of the intervention arms; control
vs. active intervention groups. We found that participants had not in the main sought to list
the revalidation standards in their CPD entries. A similar number of rewritten entries (9)
and new entries (7) had referred to the Proficiency Standards. However, a higher number of
entries from those in the active intervention group (i.e. from participants who had received
the CPD Outcomes Framework) compared to those in the control group (i.e. from participants
who had received the Revalidation and CPD Standards only) had referred to the Proficiency
Standards in their re-written or new CPD entries (p = 0.005) submitted at the after stage of
the study.
Page 25
Chapter 5: Discussion
We completed a comprehensive review of the literature, devised, validated and tested the
impact of a new CPD Outcomes Framework and related training material in an empirical
investigation involving volunteer pharmacy professionals and also spoke with our
participants to bring meaning and understanding to the process of CPD conduct and
recording and to gain feedback on the study itself.
The comprehensive literature review identified a collection of perceived barriers to CPD and
resulted in a set of recommendations that could potentially remedy pharmacy professionals
perceptions and participation in CPD. These recommendations included a need to reexamine the process of CPD recording and related training. The CPD Outcomes Framework
has proved an important step in this direction. Not only were we able to use the Outcomes
Framework as a tool for the scoring of CPD entries, but compared to a control (CPD and
revalidation standards only), we found that training participants to apply the CPD Outcomes
Framework resulted in entries that scored higher (statistically significant). Feedback from
participants who had received the CPD Outcomes Framework was on the whole positive and
a number of useful suggestions were made about improvements to the Outcomes Framework
and related training material. What is more, speaking with participants also revealed that
for entries that scored high, participants had consciously applied concepts linked to the
Outcomes Framework and for those that scored low, they had been unable to apply the
concepts of the Outcomes Framework for a variety of reasons including limitations posed by
the Plan & Record template. In contrast, feedback about the nature of the revalidation
standards and their application to CPD was not on the whole positive. In fact, although
participants had not in the main sought to apply the standards to their CPD entries, we did
find a higher number of entries from those in the active intervention group compared to
those in the control group had referred to the revalidation standards in their re-written or
new CPD entries submitted at the after stage of the study. As assessors, we too found the
process of selecting and assigning revalidation standards to individual CPD entries
burdensome and somewhat unspecific. However, on analysing the interview data we were
able to order participants views about the revalidation standards into two broad categories of
barriers and facilitators that could help with recommendations to address the apparent lack
of engagement with the revalidation standards.
The application of interpretative methods proved very useful in brining meaning and
understanding to pharmacy professionals CPD practices and using this approach we were
also able to devise a model (CPD PARable) to explain and tell the story of CPD behaviour.
Based on the concepts of purpose, action and results, the model centres on explaining two
types of CPD behaviour, one following the traditional CE pathway and the other a more
genuine CPD pathway. While the first is associated with a person-centred need to
accumulate knowledge through numerous, quick, mainly passive learning activities with no
prolonged or direct application to practice, the second is associated with a more considered
approach that involves a motivated individual in recognising their ability to make an impact
at working and bringing this about through their CPD, which is invariably more practical.
We also believe that entries which scored higher when we applied the CPD Outcomes
Framework were more likely to follow the CPD pathway in the model above, which is of
course intuitive. However, the significance of our finding is that while participants following
both models of practice took part in this study, the CPD Outcomes Framework was able to
change peoples CPD behaviour to make it more inline with the CPD pathway.
There were some other interesting and useful discussions with the participants about CPD in
general and CPD for revalidation, some of which reflected the perceptions already identified
in the comprehensive literature review. One important discussion related to the assessment
Page 26
of entries for revalidation. As well as expressing a liking for the quantitative criteria
presented in the CPD Outcomes Framework, participants expressed anxieties about the
system currently used to assess CPD records submitted for review. In fact, some participants
in this study had had direct involvement with the RPSGB call & review process and reported a
view that current assessment of entries lacked tangible criteria, which brought the meaning
of the exercise into question. Of course, this general concept is familiar to those working in
educational settings where constructive alignment is used as a good basis for ensuring that
learning, teaching and assessment support each other51. In essence, constructive alignment
is a design for teaching calculated to encourage deep engagement and uses as its basis clear,
specific criteria for attainment, complementary teaching methods and directly related
assessment tasks to address those criteria, which will enable clear and transparent
judgement of whether or not the objectives have been. It would be our interpretation that in
fact the CPD Outcomes Framework in defining the CPD criteria, the training pack in teaching
the basis and use of the Outcomes Framework, and the process of assessment in using the
CPD Outcomes Framework, would have interacted to improve participants CPD through a
process similar to constructive alignment. Interestingly, the participants were also keen to
receive a curriculum against which certainly CE-type activities could be conducted.
In fact, another important observation and interpretation of the findings relates to the role of
CE in pharmacy professionals revalidation. While it was not the scope of this research to
examine the specific contribution that CE could make as part of revalidation, it has become
apparent during the course of this research that pharmacy professionals engage in and
understand CE to a greater extent than CPD. We do not believe that this practice is a simple
legacy of previous CE requirements because so many pharmacists expressed a genuine need
to follow the CE pathway (as described in the PARable model) for their own feelings of
confidence and competence. So while, CPD has been shown to provide direct evidence of
application to work, CE is contributing indirectly to pharmacy professionals sense of self and
personal esteem. In fact, since CPD that follows the recommendations of the Outcomes
Framework is a more involved exercise, and based on our own and the participants
feedback, we would recommend that the requirement to submit 9 CPD entries per annum is
re-examined and expressed more clearly in relation to what specifically participants are
being asked to submit i.e. how many CE and how many CPD entries. During the course of
this research, we also personally came across a number of pharmacists whose records had
been called in for review. Interestingly, as we had predicted, the call & review process acted
as a great influence on those peoples engagement in the CPD process resulting in significant
and systematic attempts to ensure CPD completion and submission. We would not
recommend that more than 2 CPD entries (constructed according to the CPD Outcomes
Framework) are submitted each year the remainder could perhaps demonstrate CE type
learning. However, we can foresee a benefit in setting more regular intervals which would
act as deadlines for CPD submission (of either type) in the future.
Based on the findings of this study and our interpretations we are able to make the following
recommendations against the original objectives of this research
Identifying areas or groups of registrants in which implementation of the RPSGB CPD
framework is most and least advanced
At the outset of the project, we used a comprehensive review of the existing literature in an
attempt to address this point. The literature identified a number of groups of registrants
with more positive views and better levels of engagement in CPD compared to others. For
example, there is some evidence that hospital pharmacists are better engaged than
community pharmacists and there may also be a trend towards increased CPD recording in
more recent years. However, conflicting findings of the research make it difficult to define
any one area or group of registrants in which implementation of the RPSGB CPD framework
Page 27
is most and least advanced and indeed we would question the value of such an exercise.
Because, in fact, as noted in correspondence with an officer from the Regulations Directorate
of the RPSGB, the call and review process itself appears to have acted as a real catalyst in
terms of enhancing pharmacy professionals engagement with CPD, seemingly across the
board. More fundamentally, in relation to this study objective, we are now in a position to
argue that categorising people according to their occupational or other demographic
characteristics is not as helpful as representing engagement in CPD via the behavioural
model devised through this study. Our conclusion is that there are pharmacy professionals,
regardless of their sector of practice, who are more at ease with the CE model of learning and
there are those who understand and embrace genuine CPD. What is significant is that we
have proven through empirical investigation that peoples CPD output can be impacted on by
teaching and assessing their entries using the CPD Outcomes Framework devised and
validated in this study.
Identifying if current barriers to CPD uptake would jeopardise the use of CPD in
revalidation
After careful analysis of the data unearthed by the comprehensive literature review we
derived a set of recommendations for moving towards improving participation in CPD using
regulatory, professional, work-related and personal channels.
Through these
recommendations, we believe that current barriers to CPD uptake can be addressed to
minimise risk in relation to the use of CPD in revalidation. It is likely that making CPD a
statutory requirement will in itself compel pharmacy professionals to better engage with the
process and indeed as stated above, it appears that the call and review process is already
acting as a catalyst in that way. Nonetheless, if CPD is to succeed, our recommendation is
that peoples beliefs and attitudes must be addressed by recognising and modifying barriers
through a combination of four main categories of regulatory, professional, work-related and
personal channels, as outlined below.
In light of consistent and continuing difficulties with the CPD recording template, anxieties
expressed in relation to the process of review and the difficulties with conceptualising
possible consequences of non-conformance, we believe there are three clear areas that must
be addressed by the new regulatory body for pharmacy (GPhC), namely modifying the
process of recording, explaining the process of record reviews and clarifying the outcome of
these reviews. There are also three distinct implications for the new professional body for
pharmacy. In light of the perceived difficulties with understanding the concept, conduct and
application of CPD, firstly we believe there is scope for further improvements to be made to
the process of CPD facilitation. Secondly, we believe there must be scope for improving the
current guidance documents and example cases as well as, thirdly, explanatory courses
provided by the new professional body for pharmacy. Pharmacy professionals should also be
supported in their CPD at work by means of protected CPD-time, such that perhaps in due
course CPD-time will be considered in the same vein as other essential breaks from formal
work. A second work-related proposal relates to employer support for educational courses,
either in-house or sponsored external training. The third and most pertinent area related to
work is the opportunity for application of CPD and its integration in the workplace. Based
on previous evidence, the benefits of direct experience of effective CPD are hypothesised to
impact on personal development, career development and of course on others, for example
patients and work colleagues, thus strengthening personal beliefs in the value of CPD.
Our study in fact tested some of the recommendations relating to both the regulatory
(assessment) and professional (teaching and support) elements. Through the CPD Outcomes
Framework we believe it is possible to align peoples understanding of CPD and its
assessment in such as way as to enhance meaningful engagement in quantifiable CPD.
Combined with the significant influence that call & review would generate in itself, we
Page 28
believe the CPD Outcomes Framework could be reasonably expected to facilitate the
submission of meaningful CPD for use in revalidation.
Explore the applicability and sustainability of the use of revalidation standards within
the CPD framework
We devised the CPD Outcomes Framework based on the revalidation standards and the CPD
Standards and gave these standards alone to a control group of participants, with the active
group receiving the CPD Outcomes Framework as well as the standards. It must be
highlighted that the revalidation standards used as part of this research were in draft format
at the time and were not subsequently adopted by the GPhC. The majority of the
participants in both intervention and control groups failed to engage with the revalidation
standards in any meaningful way within their CPD entries. That is, we found that
participants had not in the main sought to list the revalidation standards in their CPD
entries. However, a higher number of entries from those in the active intervention group
(i.e. from participants who had received the CPD Outcomes Framework) compared to those in
the control group (i.e. from participants who had received the revalidation and CPD
Standards only) had referred to the revalidation standards in their re-written or new CPD
entries submitted at the after stage of the study. Thus it seems that the CPD Outcomes
Framework did also encourage the use of the revalidation standards within the CPD entries.
However, of grave importance is the fact that currently the Plan & Record template does not
facilitate the integration of revalidation standards within CPD entries. In fact, some of the
participants in the active intervention group, who had referred to the revalidation standards
for the purpose of their CPD did so using the CPD Outcomes Framework Blank template for
assessment of CPD cases, which invites participants to record the GPhC standards of
proficiency to which each CPD record relates (see Appendix 14).
On speaking with the participants we found that a large number in fact expressed very
negative views about the use of revalidation standards in CPD and revalidation. While it was
possible for the CPD assessors (two of the investigators) to assign specific revalidation
standards to the CPD entries, this process proved onerous and did not add to the weight of
the assessment. Certainly at times the investigators found the use of revalidation standards
for the assessment of CPD burdensome to purpose of assessment using the CPD Outcomes
Framework. This was partly because of the large number of revalidation standards available
for application to each CPD. However, the most useful analysis of perceptions relating to
revalidation standards came from a thematic analysis of interview data from the research
participants. The two dominant themes of Working with the Standards of Proficiency and
Yet to accept the Standards of Proficiency were derived with their respective second-order
and first-order codes. We take the view that addressing the perceived barriers and also
drawing on the facilitators will help deal with the apparent lack of engagement with the
revalidation standards.
Those yet to accept the revalidation standards viewed these with scepticism, had expected
something new or were simply rebelling against them. Under the first heading, participants
found there were simply too many revalidation standards, they were too detailed, did not
relate to any specific area of practice or knowledge-base, and participants also needed
clarification and instructions on how the standards would relate to CPD. Under the second
heading, participants had expected something different to the existing code of conduct and
viewed the standards as already part of everyday thinking and practice. There was resilience
to the standards under the third heading. A number of participants took a more positive
approach, indicating a desire to work with the standards, either trying to understand their
application to CPD or simply viewing them helpful to the construction of better CPD. These
findings indicate that is it in theory possible to move towards refining the revalidation
standards and the accompanying literature by addressing the main points of concern.
Page 29
Page 30
on practice and that in turn can be related back to the individuals own development. In
terms of the current content of CPD portfolios, entries that follow the CPD pathway possess
the largest strength and quality of existing information for the purpose of revalidation. In
fact, participants own interpretation of their CPD brings additional insight into the
application of the right concepts to the conduct and construction of better quality CPD. The
participants who produced better CPD entries related them to risk, relevance to practice,
integrated the CPD with practice and selected entries for which there was evidence of
impact. While participants following both models of practice took part in this study, the
CPD Outcomes Framework was able to change peoples CPD behaviour to make it more
inline with the CPD pathway. Therefore, although the content of CPD entries may present
gaps for the purpose of revalidation, we have proven scientifically that training people to use
the CPD Outcomes Framework will result in better CPD for revalidation.
Produce recommendations, based on evidence garnered and analysed, on the
appropriateness of existing CPD frameworks as the basis of revalidation or as support
documentation for the revalidation process.
We believe that it is possible to use CPD for revalidation, provided the CPD Outcomes
Framework features as a strong component of the learning, teaching and assessment of the
entries. The current CPD framework of Plan & Record is not necessarily facilitating the
process of CPD conduct and construction and we would recommend that the CPD Outcomes
Framework is incorporated into the current CPD framework to ensure alignment of peoples
activities with assessment of outcomes. We make the following overall recommendations:
1. In order for CPD to succeed as part of pharmacy professionals revalidation in the
future, our first recommendation is that peoples beliefs and attitudes towards CPD in
pharmacy be addressed by recognising and modifying expressed barriers to CPD in
general through a combination of four main categories of regulatory, professional,
work-related and personal channels, as outlined below:
a. In light of consistent and continuing difficulties with the CPD recording
template, anxieties expressed in relation to the process of review and the
difficulties with conceptualising possible consequences of non-conformance,
we believe there are three clear areas that should be addressed by the new
regulatory body for pharmacy (GPhC), namely modifying the process of
recording, explaining the process of record reviews and clarifying the outcome
of these reviews.
b. There are also three distinct implications for the new professional body for
pharmacy. In light of the perceived difficulties with understanding the
concept, conduct and application of CPD, firstly we believe there is scope for
further improvements to be made to the process of CPD facilitation. Secondly,
we believe there must be scope for improving the current guidance documents
and example cases as well as, thirdly, explanatory courses provided by the new
professional body for pharmacy.
c. Pharmacy professionals should also be supported in their CPD at work by
means of protected CPD-time, such that perhaps in due course CPD-time will
be considered in the same vein as other essential breaks from formal work. A
second work-related proposal relates to employer support for educational
courses, either in-house or sponsored external training. The third and most
pertinent area related to work is the opportunity for application of CPD and its
integration in the workplace.
d. Based on previous evidence, the benefits of direct experience of effective CPD
are hypothesised to impact on personal development, career development and
of course on others, for example patients and work colleagues, thus
University of Reading 2010
Page 31
Page 32
Page 33
Review the current content of CPD portfolios to assess the overall strength and
quality of existing information, and information gaps for the purposes of
revalidation
The aim was to examine current usability of CPD entries. We were able to use the CPD
Outcomes Framework to assess the overall strength and quality of CPD entries and found
that participants who followed a genuine CPD pathway (as defined in the CPD model of
behaviour) scored higher than those who followed the CE pathway. The better entries
demonstrated relevance to practice and impact on practice as assessed by the Outcomes
Framework of course but it was the participants own interpretation of their CPD that
brought insight into the application of the right concepts to the conduct and construction
of better quality CPD. The participants who produced better CPD entries related them to
risk, relevance to practice, integrated the CPD with practice and selected entries for which
there was evidence of impact. While the content of CPD entries may present gaps for the
purpose of revalidation, we have proven scientifically that training people to use the CPD
Outcomes Framework will result in better CPD for revalidation.
Produce recommendations, based on evidence garnered and analysed, on the
appropriateness of existing CPD frameworks as the basis of revalidation or as
support documentation for the revalidation process.
We believe that it is possible to use CPD for revalidation, provided the CPD Outcomes
Framework features as a strong component of the learning, teaching and assessment of
the entries. The current CPD framework of Plan & Record is not necessarily facilitating
the process of CPD conduct and construction and we would recommend that the CPD
Outcomes Framework is incorporated into the current CPD framework to ensure
alignment of peoples activities with assessment of outcomes. Our recommendations are
grouped according to five themes; addressing general attitudes to CPD, the constructive
alignment of the learning/teaching/assessment of CPD for revalidation, addressing
attitudes to revalidation standards, clarifying the ratio of CE vs. CPD entries for
submission, intervals for submission of CPD entries.
Page 34
References
1.
2.
Royal Pharmaceutical Society of Great Britain, General FAQs. In
http://www.uptodate.org.uk/faqs/General.shtml, 2010.
3.
Accreditation Council for Pharmacy Education, Accreditation Standards for
Continuing Pharmacy Education. http://www.acpe-accredit.org/pdf/CPE_Standards_Final.pdf 2007.
4.
Donyai P. Student assessment and a Professional Development Portfolio in the first
year of a new MPharm degree course (invited presentation). Academic Pharmacy Group
Seminar on Student Assessment, London, UK, 2005.
5.
Kolb DA. Experiential Learning: experience as the source of learning and development. PrenticeHall: New Jersey, 1984.
6.
Rouse MJ. Continuing professional development in pharmacy. American Journal of
Health-Systems Pharmacy 2004, 61, 2069-2076.
7.
Royal Pharmaceutical Society of Great Britain, Call and review for CPD records starts
this summer. In FAQs, http://www.rpsgb.org/pdfs/cpdfaqs.pdf, 2009.
8.
The Royal Pharmaceutical Society of Great Britain, The New Horizon: Pharmacy in a
New Age:. In London: The Royal Pharmaceutical Society of Great Britain: 1996.
9.
Hancox D. Making the move from continuing education to continuing professional
development. The Pharmaceutical Journal 2002, 268, (7180), 26-27.
10.
Royal Pharmaceutical Society of Great Britain, Medicines, Ethics and Practice: a guide for
pharmacists and pharmacy technicians. 2009.
11.
Royal Pharmaceutical Society of Great Britain, Professional Standards and Guidance
for Continuing Professional Development. Available at:
http://www.rpsgb.org/pdfs/coepsgcpd.pdf, 2009.
12.
Driesen A, Verbeke K, Simoens S, Laekeman G. International trends in lifelong
learning for pharmacists. American Journal of Pharmaceutical Education 2007, 71, (3), 1-10.
13.
International Pharmaceutical Federation, Statement of professional standards.
Continuing professional development. . Available at:
http://www.fip.org/www/uploads/database_file.php?id=221&table_id=.
14.
Forsetlund L, Bjrndal A, Rashidian A, Jamtvedt G, O'Brien MA, Wolf F, Davis D,
Odgaard-Jensen J, Oxman AD. Continuing education meetings and workshops: effects on
professional practice and health care outcomes. In Cochrane Database of Systematic Reviews,
2009; Vol. 2.
15.
Department of Health, Health Care and Associated Professions (Pharmacy): The
Pharmacy Order 2009 Consultation Report. June 2009.
16.
485.
Hasman A. Get ready for revalidation in pharmacy. The Pharmaceutical Journal 2009, 283,
17.
Pharmacy Council of New Zealand, Recertification for Practising Pharmacists under
the Health Practitioners Competence Assurance (HPCA) Act 2003. Available at:
http://www.pharmacycouncil.org.nz/cms_show_download.php?id=42
18.
Power A, Johnson BJ, Diack HL, McKellar S, Stewart D, Hudson SA. Scottish
pharmacists' views and attitudes towards continuing professional development. Pharmacy
World & Science 2008, 30, 136-143.
Page 35
19.
Kostrzewski AJ, Dhillon S, Goodsman D, Taylor KMG. The influence of continuing
professional development portfolio records on pharmacy practice. International Journal of
Pharmacy Practice 2009, 17, 107-113.
20.
Patel JP, West D, Bates IP, Eggleton AG, Davies G. Early experiences of the mini-PAT
(Peer Assessment Tool) amongst hospital pharmacists in South East London. International
Journal of Pharmacy Practice 2009, 17, 123-126.
21.
General Dental Council, Continuing Professional Development (CPD) for dental care
professionals. In March 2008.
22.
Moher D, Liberati A, Tetzlaff J; Altman DG. Preferred reporting items for systematic
reviews and meta-analyses: the PRISMA statement. British Medical Journal 2009, 339, 332-336.
23.
The Joanna Briggs Qualitative Assessment Review Instrument (QARI),
http://qari.joannabriggs.edu.au/.
24.
Gifford A, Murphy R, Anderson C. Professional learning and development in
pharmacy. In Professional lifelong learning: critical perspectives on CPD, University of Leeds: Leeds,
2008.
25.
Gidman WK, Hassell K, Day J, Payne, K. The impact of mandatory continuous
professional development and training to deliver the new contract on female community
pharmacists: A qualitative study. Pharmacy Education 2007, 7, (3), 223-233.
26.
Swallow V, Clarke C, Iles S, Harden J. Work based, lifelong learning through
professional portfolios: challenge or reward. Pharmacy Education 2006, 6, (2), 77-89.
27.
Laaksonen R, Duggan C, Bates I. Overcoming barriers to engagement in continuing
professional development in community pharmacy: a longitudinal study. The Pharmaceutical
Journal 2009, 282, 44-48.
28.
Attewell J, Blenkinsopp A, Black P. Community pharmacists and continuing
professional development a qualitative study of perceptions and current involvement. The
Pharmaceutical Journal 2005, 274, 519-524.
29.
Middleton H. What do technicians think about registration and professionalism.
Hospital Pharmacy 2007, 14, 100-102.
30.
Mottram DR, Rowe P, Gangani N, Al-Khamis Y. Pharmacists engagement in
continuing education and attitudes towards continuing professional development. The
Pharmaceutical Journal 2002, 269, 618-622.
31.
Kostrzewski AJ, Dhillon S, Goodsman D, Taylor KMG, Weinman JA. The extent and
characteristics of United kingdom hospital pharmacists keeping, or not keeping, a
professional development portfolio. International Journal of Pharmacy Practice 2009, 17, 299-304.
32.
Swainson D, Silcock J. Continuing professional development for employee
pharmacists: a survey to compare practice in the hospital and community sectors. The
Pharmaceutical Journal 2004, 272, 290-293.
33.
Hull H, Rutter P. A cross sectional survey of UK community pharmacists views on
continuing education and continuing professional development. International Journal of
Pharmacy education 2003, 1, (2), 1-12.
34.
James D, Beaumont S, Carter S, Davies GA. Framework for Assessing the Continuous
Professional Development Needs of Community Pharmacists. Pharmacy Education 2002, 2, (2),
63-68.
35.
Miller D, Jones S. Focus group to explore issues surrounding continuing professional
development for locum community pharmacists. International Journal of Pharmacy Practice 2004,
12, R50.
Page 36
36.
Coglan W, Zargarani M, Hughes H, Smith I, Hall J. Barriers to continuing professional
development: the views of community pharmacists. International Journal of Pharmacy Practice
2009, 17(s1), A37.
37.
Lau SF. Continuing professional development facilitation under a protected time
scheme. International Journal of Pharmacy Practice 2004, 12, R85.
38.
Thompson G. Supporting continuing professional development (CPD) for pharmacists:
piloting a CPD portfolio development toolkit. International Journal of Pharmacy Practice 2002,
10(suppl), R75.
39.
Coulman SA, Chong WH, John DN. Are pharmacists in Wales recording CPD? .
International Journal of Pharmacy Practice 2010, 18, (s1), 36.
40.
Schafheutle EI, Higginson PJ, Cutts C. Pharmacy technicians uptake of continuing
professional development and impact of learning on working practice. International Journal of
Pharmacy Practice 2009, 17(s1), A29-A30.
41.
Anon. Nearly two-thirds of Sunderland members are engaged with CPD. The
Pharmaceutical Journal 2007, 278, 507.
42.
Anon. Survey results: mandatory CPD welcomes. The Pharmaceutical Journal 2003, 270,
456-457.
43.
Professional Associations Research Network, Survey results from: Professionals' Views
on Continuing Professional Development July - August 2008.
44.
Professional Associations Research Network, Professionals' Views on Continuing
Professional Development. In PARN, Ed. http://www.parnglobal.com/professionals-views-oncpd.htm, 2008.
45.
Flint J. Officer in charge of receiving CPD entries for RPSGB. Personal correspondence 6
September 2010.
46.
Wilkinson JN, Donyai P. Participation of future pharmacists in a professional
development certificate scheme: the paradox of personal identity. International Journal of
Pharmacy Practice 2009, 17(s1), A36-A37.
47.
Buchanan K. Anand P, Joffe H, Thomas K. Perceiving and understanding the social
world. In Mapping Psychology, Miell D, Phoenix A, Thomas K, Eds. The Open University: Milton
Keynes, 2007.
48.
Zuckerman M. Attribution of success and failure revisited, or: The motivational bias is
alive and well in attribution theory. Journal of Personality 1979, 47, (2), 245-287.
49.
Royal Pharmaceutical Society of Great Britain, Continuing Professional Development:
A guide to getting started - making CPD work for you. In RPSGB:
http://www.uptodate.org.uk/PlanandRecord/getting_started_guide/getting_started_1.pdf, 2010.
50.
James DH, Lambat Z, John DN. Pharmacists and pharmacy technicians views on the
value of feedback on CPD records submitted to the RPSGB for review: Phase 3. Available at:
http://www.rpsgb.org.uk/pdfs/cpdwelshreport.pdf, 2009.
51.
Biggs J. Teaching for quality learning at University. SRHE and Open University:
Buckingham, 2003.
52.
Streiner DL, Norman GR. Health measurement scales: a practical guide to their development
and use. Oxford University Press: Oxford, 2008.
53.
Corbin JM, Strauss A. Grounded theory research: Procedures, canons, and evaluative
criteria Qualitative Sociology 1990, 13, (1), 3-21.
Page 37
Appendix 1
Annex C: The GPhC Standards of proficiency for pharmacy
professionals
Page 38
Annex C
The General Pharmaceutical Council Regulatory
Standards Development Programme
Standards of proficiency for pharmacy professionals
Introduction
This document sets out the standards of proficiency for pharmacy professionals.
These are the standards necessary for the safe and effective practice of pharmacists
and pharmacy technicians and they are based on the abilities and scope of practice
of pharmacy professionals described in the Pharmacy Practice Framework, RPSGB
2009 and the Standards of Conduct, Ethics and Performance. They are the minimum
standards necessary to protect members of the public. You must meet all of these
standards when you first become registered. After that, you must continue to meet
the standards of proficiency that apply to your scope of practice.
Scope of practice
Your scope of practice may be different to that of a newly registered pharmacy
professional. Your scope of practice will be the area(s) of the profession in which you
have the knowledge, skills and experience to practise lawfully, safely and effectively,
in a way that meets the standards and does not pose any danger to patients and the
public or to yourself.
Your scope of practice will change over time and your practice may become more
focused and specialised than that of a new registrant. This might be because you
have specialised in a certain clinical area or with a particular client group, or moved
into a role in management, education or research. Your particular scope of practice
may mean that you are unable to demonstrate that you meet all of the standards that
apply for the whole of the profession.
As long as you make sure that you are practising safely and effectively within your
given scope of practice and do not practise in the areas where you are not proficient
to do so, this will not be a problem. If you want to move outside of your scope of
practice you should be certain that you are capable of working lawfully, safely and
effectively. This means that you need to exercise personal judgement by undertaking
any necessary training and experience.
The care of patients is at the centre of everyday professional practice. They must be
your primary and continuing concern when practising, irrespective of your field of
work. Even if you do not have direct contact with patients your actions or behaviour
can still impact on their care or safety. For this reason, Section 1 of the proficiency
standards - the expectations of a pharmacy professional - applies to you, regardless
of your scope of practice.
1
Page 39
1.4 Recognises and works within the limits of their professional competence
1.4.1 Practises only in areas in which they have the necessary education, training,
and skills.
1.4.2 Refers to others if a task is beyond their professional competence.
1.4.3 Responds constructively to performance assessments, appraisals and reviews
and undertakes further training where necessary.
1.5 Listens to patients and the public and respects their choices
1.5.1 Recognises and supports the right of patients and the public to be involved in
decisions about them if they wish.
1.5.2 Listens to patients and the public and responds constructively to their concerns
or preferences.
1.5.3 Respects a persons right to refuse professional services.
1.6 Gains consent for the professional services they provide
1.6.1 Explains the options open to patients and the public, including the risks and
benefits, to help them make informed decisions.
1.6.2 Gives information on the service they are planning to provide and gets consent
before commencing it.
1.6.3 Ensures that if a person is not legally competent, any services they provide to
them are in accordance with relevant legal requirements.
1.7 Communicates effectively
1.7.1 Communicates properly and effectively with patients, the public and others and
ensures they have sufficient language competence to do so.
1.7.2 Provides information that patients, the public and others want or need in a way
they can understand.
1.7.3 Takes reasonable steps to meet the particular communication needs of
individuals whenever possible.
1.8 Works with others in the interests of patients and the public
1.8.1 Works co-operatively with people from their own and other professions, sharing
information appropriately and utilising the knowledge, skills and expertise of others.
1.8.2 Shares their skills, knowledge and experience and contributes to the
development and training of others.
1.8.3 Treats those they work with fairly and ensures their actions do not prevent
others complying with their legal or professional obligations.
1.8.4 Ensures that, when working in a team, it is clear who is responsible for
providing particular services.
3
Page 41
1.8.5 Challenges the judgement of others if they believe that a decision could
compromise the safety or care of patients and the public.
1.9 Respects and protects confidential information
1.9.1 Uses information obtained in the course of their professional practice only for
the purpose it was provided for.
1.9.2 Does not disclose confidential information without consent, apart from when
lawfully permitted.
1.9.3 Takes reasonable steps to prevent accidental disclosure or unauthorised
access to confidential information.
1.10 Keeps clear and accurate records
1.10.1 Maintains timely, accurate and adequate records for the professional services
they provide.
1.10.2 Records all relevant information in a clear and legible form.
1.10.3 Records any significant incidents or interventions they make during the
course of their professional practice.
1.11 Ensures their working environment enables them to provide professional
services safely and effectively
1.11.1 Makes sure their working environment enables them to provide professional
services safely and effectively.
1.11.2 Provides a professional service only if the working environment enables them
to do so safely and effectively.
1.11.3 Ensures they have access to the necessary facilities, equipment and
resources.
1.11.4 Ensures the facilities and equipment they use are fit for purpose.
1.12 Delegates effectively
1.12.1 Takes responsibility for their decisions to delegate tasks to others.
1.12.2 Establishes that anyone they delegate a task to has the knowledge and skills
to carry out the task safely and effectively.
1.12.3 Does not ask others to do a task that they are not competent to perform.
1.12.4 Takes appropriate oversight of and provides suitable support to those they
delegate tasks to.
1.13 Behaves with honesty and integrity
1.13.1 Is honest and trustworthy and behaves in a way that maintains public
confidence in them and their profession.
1.13.2 Declares any professional or personal interests to those who may be affected.
1.13.3 Never asks for, or accepts any inducement, gift, hospitality or referral that
may affect, or be seen to affect, their professional judgement.
1.13.4 Provides or publishes accurate and impartial information and ensures they do
not mislead or make claims that cannot be justified.
4
Page 42
1.14 Acts promptly to protect patients and the public from risk if they are
concerned that they or someone else may be not be fit to practise
1.14.1 Takes action if they are concerned that their health, behaviour or professional
competence, or that of another person, may place patients and the public at risk.
1.14.2 Practises only if they are fit and competent to do so.
1.14.3 Promptly informs the General Pharmaceutical Council (GPhC), their employer
and other relevant authorities of any circumstances that may affect their fitness to
practise, including ill health, criminal convictions and findings by other regulatory
bodies or organisations.
1.14.4 Co-operates with any investigation or formal inquiry into their or another
persons fitness to practise.
1.15 Responds constructively to feedback, complaints or criticism
1.15.1 Informs patients and members of the public and others who wish to complain,
feed back comments or make suggestions for improvement, how to do so.
1.15.2 Deals with complaints or criticism promptly, openly and sensitively. Follows
established complaints procedures, documenting the complaint and the action they
have taken.
1.15.3 Ensures a persons feedback, complaint or criticism does not prejudice the
service provided for them.
1.15.4 Learns from and reviews their working practices in the light of feedback,
complaints or criticism.
2. The skills of pharmacy practice
Pharmacists at first registration must be able to apply the skills of critical evaluation
and a detailed knowledge of the concepts and principles of clinical and
pharmaceutical science gained from the MPharm degree and pre-registration
training to meet all the following standards. Pharmacy technicians at first registration
must be able to apply a general knowledge of clinical and pharmaceutical science
gained from an approved qualification and an approved or accredited underpinning
knowledge programme to meet those standards identified as applying to them when
working under the supervision, direction or guidance of a pharmacist.
5
Page 43
Pharmacy
technician
Pharmacy
technician
Page 44
2.3 Ensures safe and effective systems are in place to manage risk
inherent in the practice of pharmacy and the delivery of
pharmaceutical services
Pharmacy
technician
Page 45
Pharmacy
technician
8
Page 46
Pharmacy
technician
Page 47
have achieved the learning outcomes described in the initial education and
training standards. Pharmacy technicians have to demonstrate that they have
achieved the learning outcomes contained in the Requirements for Pharmacy
Technician Qualifications and Programmes.
11
Page 49
Workshop Members
Chairs
Sue Ambler MPI, Pharmacy Regulation, DH (Secondee)
Peter Wilson MPI, Pharmacy Regulation, DH (Secondee)
Department of Health
Diana Kenworthy MPI Pharmacy Regulation
Anne Spence MPI Pharmacy Regulation
Royal Pharmaceutical Society of Great Britain
Christine Gray Head of Corporate Governance (interim), GPhC
Stuart Heaney Senior Administrator, Support Staff Regulation
Janet Flint Head of Support Staff Regulation
Carol Evans Head of Professional Development Scotland
Damian Day Head of Education and Quality Assurance
Other organisations
Elizabeth Baker Medicines and Healthcare products Regulatory Agency
Melanie Boughen West Suffolk Hospitals NHS Trust
Liz Caines Chair of the Merritt Medical Centre Patient Participation Group
(Patient and Public Representative)
Christopher Cutts Centre for Pharmacy Postgraduate Education
Tess Fenn Association of Pharmacy Technicians United Kingdom
Nick Goss Patient and Public Representative
Emma Grace Boots the Chemists Ltd
Gareth Jones National Pharmacy Association
Amanda Kemp Leicester School of Pharmacy
Clive Jackson National Prescribing Centre
Jayne Lawrence RPSGB/Kings College, University of London
Diane Leakey Medicines and Healthcare products Regulatory Agency
Emma Lewis Boots the Chemists Ltd
Alison Littlewood University of Manchester
12
Page 50
13
Page 51
Appendix 2
Annex E1: GPhC Continuing Professional Development
Standards and Framework
Page 52
Annex E1
The General Pharmaceutical Council Regulatory
Standards Development Programme
Continuing Professional Development Standards and Framework
Introduction
The draft Pharmacy Order requires the General Pharmaceutical Council (GPhC) to
establish a framework for Continuing Professional Development (CPD) that specifies
the following:
(a)
(b)
(c)
(d)
The framework adopted by the GPhC must ensure that any continuing professional
development that is undertaken by a registrant demonstrates a relevance to:
(e)
(f)
a learning need for the individual registrant that is relevant to the current
scope of practice including any specialisation of that individual registrant and
the environment in which they practise.
This document sets out the CPD standards that must be met by all registrants and the
GPhCs framework for undertaking and recording CPD.
1
Page 53
new knowledge or developing your skills, although you should aim to include learning
from practice whenever possible.
The CPD you record must be relevant to your scope of practice as a pharmacy
professional including responsibilities such as superintendent or pre-registration tutor
and register annotations such as pharmacist prescriber. If you record CPD that arises
from experience at work, this is almost certain to be the case although you may wish
to include some continuing education relevant to your practice as well. If your scope of
practice is changing, you must reflect this in your CPD record.
Standard 4
Include in your record CPD that is relevant to safe and effective practice and the
Standards of Conduct, Ethics and Performance of the profession
You should review the proficiency standards for the profession at least once per year
and any other competence or standards frameworks that apply to your scope of
practice and identify any standards where you need to update your capability. While
your scope of practice may have developed to the point where you cannot meet all of
the Standards of Proficiency, you must be able to demonstrate that you meet all the
standards in Section 1, The Expectations of a Pharmacy Professional (based on the
Standards of Conduct, Ethics and Performance) and your CPD record should reflect
this.
This does not mean that you need to retain an up-to-date knowledge of medicines and
their uses if you do not use this knowledge in practice. You should, however, be able
to provide sound advice and/or appropriate referral to another professional if you are
consulted as a pharmacy professional by a patient in a formal or informal setting.
You should aim to think about your practice at least once per month and make some
entries that arise from this and some that arise from events in practice.
You should aim for your CPD to improve your practice as a pharmacy professional.
CPD that arises from critical incidents such as errors will be relevant to safe and
effective practice. Other forms of CPD may not appear to be directly relevant but CPD
that improves your confidence or improves the efficiency of your service can also have
an impact on safe and effective practice.
Standard 5
Record how your CPD has contributed to the quality or development of your
practice and has benefited patients and the public
This CPD standard is based on the principle that the outcomes of learning should be
beneficial to service quality and improvement. The outcomes of CPD are, therefore,
the most important part of a CPD record. Some CPD activities have very clear
beneficial outcomes such as the introduction of a new service. You do not, however,
always have to demonstrate significant benefits from CPD. Maintaining your
professional competence in a profession that is constantly changing and showing that
your skills and knowledge are improving can be evidence of beneficial outcomes.
Standard 6
Submit your CPD record to the GPhC on request so it can be reviewed
The GPhC will review the CPD records of every registrant every five years and for some
registrants, more often than this. When the GPhC asks to see your record you will be
3
provided with details of how to submit it and a clear deadline for submission. The CPD
record that you submit to the GPhC must be legible and in a format and medium
Page 55
make a record which demonstrates CPD that utilises at least three types of
learning activity in a five year period.
CPD Review
In order to ensure that registrants meet the CPD requirements, the GPhC, in common
with other regulators, will need to call in registrants CPD records for review and
confirmation that they comply with the requirements of the CPD framework and
standards. The GPhC plans to review the CPD record of every registrant every five
years although some registrants may be asked to submit their CPD records more
frequently than this.
When you are asked to submit your CPD record for review, you will be given details of
how to do this and how long you have to respond. If you are keeping your CPD record
in an unapproved format, you will have to copy it to an approved format before you
submit it for review. Submission in an electronic form is preferable but you can also
submit it on paper providing it is legible.
If you do not submit your CPD record when asked, it may be necessary to cancel your
registration. If you tell the GPhC that your CPD record does not comply with the
standards, you may be given a formal warning, which will remain on your record for
five years. You will also be given a timescale to improve your record and submit it for
review.
When your CPD record is received, it will be reviewed by a trained CPD reviewer
against the requirements of the CPD standards and framework.
You will be informed if your CPD record meets the CPD requirements. If your record
does not meet the CPD standards or is not fully compliant with the CPD requirement,
you will be asked to improve your record within a set timescale. If your record
demonstrates significant non-compliance with the CPD requirement or if you fail to
improve it when asked, it may be necessary to cancel your registration.
If there are grounds for thinking that your CPD record is fraudulent or contains false or
misleading information, this will be dealt with under the GPhCs fitness to practise
procedures.
5
Page 57
Workshop Members
Chairs
Sue Ambler MPI, Pharmacy Regulation, DH (Secondee)
Peter Wilson MPI, Pharmacy Regulation, DH (Secondee)
Department of Health
Diana Kenworthy MPI Pharmacy Regulation
Anne Spence MPI Pharmacy Regulation
Royal Pharmaceutical Society of Great Britain
Stuart Heaney Senior Administrator, Support Staff Regulation
Janet Flint Head of Support Staff Regulation
Carol Evans Head of Professional Development Scotland
Damian Day Head of Education and Quality Assurance
Other organisations
Christine Gray Head of Corporate Governance (interim), GPhC
Elizabeth Baker Medicines and Healthcare products Regulatory Agency
Melanie Boughen West Suffolk Hospitals NHS Trust
Liz Caines Chair of the Merritt Medical Centre Patient Participation Group (Patient
and Public Representative)
Christopher Cutts Centre for Pharmacy Postgraduate Education
Tess Fenn Association of Pharmacy Technicians United Kingdom
Nick Goss Patient and Public Representative
Emma Grace Boots the Chemists Ltd
Gareth Jones National Pharmacy Association
Amanda Kemp Leicester School of Pharmacy
Clive Jackson National Prescribing Centre
Jayne Lawrence RPSGB/Kings College, University of London
Diane Leakey Medicines and Healthcare products Regulatory Agency
Emma Lewis Boots the Chemists Ltd
Alison Littlewood University of Manchester
Rachel Marchant Pharmacist
Kay Marshall Bradford School of Pharmacy
Page 58
Page 59
Appendix 3
Tables, figure and box relating to the literature review
Table 1 The list of studies included in this review in chronological order from the start of the decade (2000-2009) There were 13 full research papers
(only 3 of which were published in indexed journals), six conference abstracts/papers, two news reports of RPSGB survey outcomes and one RPSGBcommissioned report published by the PARN consultancy firm. The number of QARI criteria met is also indicated.
Study
Type of
publication
Year study
conducted
Method of data
collection
Sector(s) of
pharmacy
Study location
Sample size
Attewell 28
QARI = 4 / 10
Paper published
in non-indexed
professional
journal
Paper published
in non-indexed
education
journal
2001
Semi-structured
interviews
Community
pharmacists
Nottingham,
England
21 community
pharmacists
2001
Community
pharmacists
Brighton,
England
14 community
pharmacists
Conference
abstract in
journal
supplement
Paper in nonindexed
professional
journal
Paper in nonindexed
professional
journal
Circa 2001
Focus group
interviews as part
of a CPD skills
assessment
programme
Focus group
interviews as part
of a study piloting
a CPD toolkit
Questionnaire sent
by internal mail or
e-mail with open
questions
Postal
questionnaire
Investigated community
pharmacists perceptions and ideas
about CPD as well as involvement
in CPD.
Identified training issues and
attitudes towards CPD.
Pharmacists
Wales
14 pharmacists
Hospital and
community
pharmacists
Leeds/Bradford,
England
88 (response rate
40%)
Pharmacists
Liverpool and
Wirral, England
291 analysable
questionnaires
(38.8% response
rate)
Paper in nonindexed
education
journal
Conference
abstract in
journal suppl.
2002
Pre-piloted postal
questionnaire
Community
pharmacists
Hampshire and
the Isle of Wight,
England
Circa 2003/4
Focus group
interviews
Locum
community
pharmacists
England
James 34
QARI = 7 / 10
Thompson 38
QARI = 3 / 10
Swainson and
Silcock 32
QARI = 5 / 10
Mottram 30
QARI = 6 /10
Hull 33
QARI = 5 / 10
Miller 35
QARI = 5 / 10
2002
2002
Page 60
Type of
publication
Year study
conducted
Method of data
collection
Sector(s) of
pharmacy
Study location
Sample size
Anon. 42
QARI = 2 / 10
Survey outcome
published in
non-indexed
professional
journal
Conference
abstract
published in
journal
supplement
Paper published
in non-indexed
professional
journal
2003
Survey
questionnaire
distributed to all
RPSGB registrants
All RPSGB
registrants
Across GB
1,000 analysed
Circa 2003
Feedback as part of
CPD facilitation
scheme
Community
pharmacists
Wales
40 participants
2002 and
2004
Face-to-face
interviews and
telephone
interviews
Community
pharmacists
London , England
Paper published
in indexed
pharmacy
journal
Paper published
in indexed
pharmacy
journal
Paper published
in non-indexed
education
journal
Paper published
in non-indexed
education
journal
2004
Questionnaire
study examining
CPD engaging
behaviour
Face-to-face semistructured
interviews
Hospital
pharmacists
London
43trained
pharmacists and
14 non-trained in
2002; 33 trained
pharmacist and 5
non-trained in
2004
132 completed
questionnaires
Hospital
pharmacists
London
9 pharmacists (4
male)
2005
Face-to-face semistructured
interviews
Female
community
pharmacists
North West of
England
Circa 2005
Face-to-face semistructured
interviews as part
of pilot of portfolio
system
Pharmacists
30 female
community
pharmacists over
the age of 30
9 pharmacists
Lau 37
QARI = 2 / 10
Laaksonen 27
QARI = 7 / 10
Kostrzewski 31
QARI = 8 / 10
Kostrzewski 19
QARI = 6 / 10
Gidman 25
QARI = 6 / 10
Swallow 26
QARI = 8 / 10
2004-2005
Page 61
Type of
publication
Year study
conducted
Method of data
collection
Sector(s) of
pharmacy
Study location
Sample size
Power 18
QARI = 5 / 10
Paper published
in indexed
pharmacy
journal
Paper published
in non-indexed
professional
journal
Conference
paper published
online
Circa
2005/2006
Postal
questionnaire
Pharmacists
across the
sectors
Scotland
Spring 2006
Semi-structured
interviews
Pharmacy
technicians
London region
9 (all females)
2006-2007
Semi-structured
interviews and
focus-group
Pharmacists
from a variety
of backgrounds
Nottinghamshire,
England
Briefly reported
in non-indexed
professional
journal
Conference
abstract
published in
journal
supplement
Commissioned
report
published
online
Conference
abstract
published in
journal
supplement
Conference
abstract in
journal
supplement
2007
Survey
Pharmacist
RPSGB branch
members
Sunderland
Branch, England
23 pharmacists
interviewed with 6
attending focus
groups
46 pharmacists
2008
Face-to-face semistructured
interviews
Community
pharmacists
Manchester,
England
18 pharmacists
Circa 2008
Online
questionnaire
RPSGB
registrants
UK
1945 respondents
July 2008
Postal
questionnaire as
part of evaluation
of a CPPE
workshop
Postal
questionnaire
Pharmacy
technicians
England
146 (67.6%
response rate)
Middleton 29
QARI = 1 / 10
Gifford 24
QARI = 8 / 10
Anon. 41
QARI = 0 / 10
Coglan 36
QARI = 5 / 10
PARN 44
QARI = 2 / 10
Schafheutle 40
QARI = 1 /10
Coulman39
QARI = 6 / 10
February
2009
Practising
pharmacists
Wales
Page 62
Explored engagement of
Sunderland branch members with
CPD
Year study
conducted
Study participants
Attewell 28
2001
James 34
2001
Mottram 30
2002
Swainson and
Silcock 32
2002
Miller35
Circa 2003/4
Lau 37
2003
Laaksonen 27
2002 and
2004
Swallow 26
Circa 2005
Gidman 25
2005
The main response to the question about barriers to CPD or CE was lack of time.
Of those undertaking CPD most acknowledged that some of the learning took
place during work time rather than completely in their own time. One
pharmacist thought that protected time was essential to support portfolio
development. Related to time were issues around family commitments, lack of
locally available courses, and difficulty undertaking CE after a full days work.
One of the themes identified as a barrier to undertaking CPD was time to both
undertake and document CPD activities.
231 (79.4%) of the respondents identified lack of time as an obstacle to CPD; 179
(61.5%) identified workload as an obstacle.
Time was cited as a concern about CPD by 33 (75%) of hospital and 25 (55%) of
community pharmacists. A common request was for protected time to complete
CPD and relevant documentation.
All participants at the focus group acknowledged they were poor at documenting
their CPD and resented the extra time they would need to spend doing so.
Feedback from participants about a protected time scheme was very positive and
motivated pharmacists to overcome the initial inertia associated with CPD.
Perceived barriers preventing engagement in CPD included the themes limited
time for CPD. high workload, and frame of mind (not being able to learn
anything after a long days work) as well as family and social commitments
(other commitments more important than CPD) and leisure time.
Whilst participants were willing to invest personal time in CPD they also wanted
a proportion of work time reserved for CPD activity.
The majority reported it difficult to find time to complete CPD, especially those
with dependent children and evening training was unpopular with most. Time
also appeared within the theme remuneration for completing CPD and training
for the new contract with a minority of stating CPD should be completed in
personal time but most demanding set CPD time.
Page 63
Table 2 continued. Pharmacy professionals perception of time as a facilitator or barrier to participation in CPD.
Study
Year study
conducted
Study participants
Power 18
Middleton 29
Circa
2005/2006
Spring 2006
Anon. 41
2007
Coglan 36
2008
PARN 44
Circa 2008
A total of 76% of the respondents agreed with the statement I do not have
sufficient time to achieve my CPD goals
Time was identified in relation to challenges to becoming a registered
professional, particularly for part-time workers with children.
One of the main concerns was time.
Schafheutle 40
July 2008
One of four themes in relation to barriers to CPD was time: lack of time to write
up CPD, especially at work.
A total of 68% of the respondents participated in CPD at work during work hours
(compared to 80% in other professions); 87% in personal time (compared to 68% in
other professions); 49% at an external venue during work hours (compared to
72% in other professions).
From 43 participants who had not created a CPD entry following workshop
learning, a total of 20 identified lack of time as the reason with two specifying
lack of work-time learning.
Page 64
Table 3 Pharmacy professionals perception of financial costs and resource issues as facilitators or barriers to participation in CPD
Study
Year study
conducted
Study participants
Attewell 28
2001
James 34
2001
Mottram 30
2002
Laaksonen 27
2002 and
2004
Miller35
Circa 2003/4
Gidman 25
2005
Swallow 26
Circa 2005
PARN 44
Circa 2008
Available resources were limited and poor and many seemed to be targeted
towards pharmacists permanently based somewhere.
Payment for CPD was unusual and locum pharmacists CPD activities were
thought to be generally unrecognised even if leading to financial gain for
employer.
A minority felt that professionals had a responsibility to complete additional
training in own time but more commonly interviewees felt they should get paid
time to complete training. There was a suggestion that locum and part-time
pharmacists felt they lost out on employer help.
Issues related to infrastructure support from the employer and opportunities to
attend CPD events at work.
A total of 44% of respondents stated their employer pays for their CPD (compared
to 67% in other professions); 72% stated the CPD they did was free (compared to
30% in other professions); 42% paid for their own CPD (compared to 53% in other
professions).
Where CPD was funded fully or partly by the employer, 35% stated the CPD must
meet their employers needs for it to be funded (compared to 56% in other
professions); 20% stated they were permitted to do any CPD according to their
need (compared to 29% in other professions); 25% stated the cost of the CPD was
a determining factor for employer funded CPD (compared to 43% in other
professions).
Page 65
Year study
conducted
Study participants
Attewell 28
2001
James 34
2001
Thompson 38
Circa 2001
Swainson and
Silcock 32
2002
Few pharmacists understood and practised the CPD principles and there was
confusion about the difference between CPD and CE. Few had received any
training in relation to CPD. Pharmacists found it hard to describe how they
assessed own learning needs and many were unsure how to evaluate own
learning.
One of the themes identified as a barrier to undertaking CPD was general
understanding of CPD process with the reflection a particular barrier.
Although not strictly a lack of understanding of CPD, participants identified
learning needs analysis as the component of the CPD process most difficult and
some had problems identifying resources to meet learning needs.
When asked to define CPD responses tended to focus on action rather than other
stages and definitions that involved some aspect of planning were least common.
Mottram 30
2002
Hull 33
2002
Lau 37
2003
Laaksonen 27
2002 and
2004
Miller 35
Circa 2003/4
Gidman 25
2005
Power 18
Circa
2005/2006
178 (61.2%) of the respondents answered they had understood the distinction
between CPD and CE before reading the questionnaire, with a slightly higher
proportion being from hospital vs. community pharmacy.
While 166 (61%) of respondents had a clear understanding of CE and 25 (9%)
none, only 58 (21%) had a clear understanding of CPD with 113 (42%) none.
Others were confused or had partial understanding.
Feedback from participants about a protected time scheme was very positive
with comments indicating understanding of CPD had been improved/gained.
One barrier to engagement in CPD was identified as lack of information about
CPD and what exactly it entails.
One pharmacist was not clear on difference between CPD and CE and none made
reference to the CPD cycle.
The majority found the principles of CPD confusing; some were uncertain about
how much CPD they were required to complete and what constituted CPD. Most
interviewees were uncertain whether they were complying with CPD principles
and meeting legislative requirements. Some were unsure how to record CPD.
Pharmacists felt most comfortable with identification of learning needs and were
also confident in assessing the value of what they had learnt and applying it to
practice.
Page 66
Table 4 continued. Pharmacy professionals understanding of CPD as a facilitator or barrier to participation in CPD
Study
Year study
conducted
Study participants
Gifford 24
2006-2007
Anon. 41
2007
Coglan 36
2008
Schafheutle 40
July 2008
Page 67
Table 5 Pharmacy professionals perception of facilitation and support for CPD as facilitators or barriers to participation in CPD
Study
Year study
conducted
Study participants
Attewell 28
2001
James 34
2001
Thompson 38
Circa 2001
Swainson and
Silcock 32
2002
Lau 37
2003
Swallow 26
Circa 2005
Gidman 25
2005
Power 18
Circa
2005/2006
Middleton 29
Spring 2006
Few pharmacists had received training on CPD. When asked what support was
needed for developing CPD, participants stated opportunity to meet with other
pharmacists, MCQs to help identify learning needs, guidance on how to develop
personal objectives, and easier access to information.
One of the themes identified as a barrier to undertaking CPD was availability of
appropriate facilitation and training and participants emphasised the need for
support and ongoing facilitation.
A CPD development portfolio toolkit was found to be a valuable resource and the
author suggested a key element of facilitation in future would be the availability
of example documentation of CPD activities as a resource.
9% of hospital and 9% of community pharmacists selected support as a concern
about CPD. Both groups agreed managers should facilitate CPD via different
means.
The author reported the opportunity to interact with a facilitator who provided
support and motivation increased pharmacists self- and social awareness to
overcome the inertia.
Issues related to infrastructure included facilitation/nurturing and mentorship, it
was felt appraisal could be timed with CPD planning and achievement with some
needing mentorship or training for CPD. The role of the department head in
introducing continuing professional education was deemed vital.
Pharmacists relied on one another for guidance with CPD but training others
acted to increase the workload of some pharmacists.
A total of 65% of respondents disagreed with the statement I have support in my
workplace to carry out my CPD plans. More support was perceived to be needed
for pharmacists CPD.
The authors identified that pharmacy technicians do not seem to receive training
about how to undertake CPD in formal technician training courses.
Page 68
Table 6 Pharmacy professionals motivation and interest in CPD as facilitators or barriers to participation in CPD
Study
Year study
conducted
Study participants
Attewell 28
2001
James 34
2001
Mottram 30
2002
Swainson and
Silcock 32
2002
Hull 33
2002
Laaksonen 27
2002 and
2004
Kostrzewski 31
2004
A recurring theme among pharmacists was querying the relevance of CPD once
their career had progressed to the desired (or achievable) level believed, when
they were in maintenance mode. One pharmacist thought it the responsibility
of the national and small chains to convince their employees to participate in
CPD. Some participants felt keeping a CPD portfolio helped them remember
their accomplishments, others felt it important for future interviews and one felt
it correlated with receiving a company bonus. Some thought mandatory CPD
would motivate them to complete it.
One of the themes identified as a barrier to undertaking CPD was general
motivation and support.
31 (10.7%) of respondents stated apathy to the subject as a specific obstacle to
CPD.
A range of benefits of CPD were described by hospital and community
pharmacists including personal development (20% v 25%), improved knowledge
(0% v 43%), skills or competence (36% v 27%), public/self-confidence (11% v 27%)
and outcome for patients (43% v 23%). In relation to impact on working life, only
community pharmacists mentioned better job satisfaction.
222 (81.5%) thought CPD would improve their ability to perform their role, 161
(59.4%) and 132 (48.7%) thought CPD would enhance the status of the profession
among professionals or the public, respectively. Only 66 (24.4%) thought CPD
would enhance their career prospects and 29 (10.7%) saw no benefit from CPD
27 of the latter did not undertake any CE/CPD.
A barrier to engagement in CPD was lack of motivation with participants not
being motivated to participate or viewing participation as a waste of time. A
number of motivational factors influencing engagement in CPD included
purpose of CPD, influences of CPD on working life, benefit of CPD for work,
incentives for CPD, feeling of being compelled to engage in CPD.
The personality traits conscientiousness, agreeableness and emotional
stability were associated with keeping a portfolio.
Page 69
Table 6 continued. Pharmacy professionals motivation and interest in CPD as facilitators or barriers to participation in CPD
Study
Year study
conducted
Study participants
Kostrzewski 19
2004-2005
Swallow 26
Circa 2005
Gidman 25
2005
Power 18
Circa
2005/2006
Middleton 29
Spring 2006
Gifford 24
2006-2007
Coglan 36
2008
Page 70
Table 6 continued. Pharmacy professionals motivation and interest in CPD as facilitators or barriers to participation in CPD
Study
Year study
conducted
Study participants
PARN 44
Circa 2008
When asked about overall attitude to CPD 63% were positive, 22% neutral and
11% negative. A number of drivers or motivations for participating in CPD were
rated very important, important, neutral, unimportant or very unimportant.
Responses are presented here by grouping the first and the last two categories to
produce scores relating to important (i), neutral (n) and unimportant (u):
My professional/regulatory body requires me to do it (82% i, 12% n, 7% u)
My employer requires me to do it (49% i, 32% n, 18% u)
It is explicitly included in my regular appraisal process (39% i, 37% n, 23% u)
I feel it is my duty as a professional to do it (89% i, 8% n, 2% u)
I do it to improve performance in my current role (84% i, 10% n, 5% u)
I do it to further my position with my current employer (32% i, 39% n, 27% u)
I do it to further my career in general (52% i, 28% n, 21% u)
I do it because I want to change career (12% i, 35% n, 52% u)
I do it to develop as a person (71% i, 18% n, 11% u)
When asked how important taking part in CPD had been to development of their
career 79% said important, 17% were neutral, 14% said unimportant.
Page 71
Table 7 Pharmacy professionals attitude towards compulsory CPD as facilitator or barrier to participation in CPD
Study
Year study
conducted
Study participants
Attewell 28
2001
Hull 33
2002
Mottram 30
2002
Page 72
Table 7 continued. Pharmacy professionals attitude towards compulsory CPD as facilitator or barrier to participation in CPD.
Study
Year study
conducted
Mottram 30 continued
2002
Swainson and
Silcock 32
2002
Laaksonen 27
2002 and
2004
Anon. 42
2003
Study participants
Page 73
Table 7 continued. Pharmacy professionals attitude towards compulsory CPD as facilitator or barrier to participation in CPD.
Study
Year study
conducted
Study participants
Gidman 25
2005
Swallow 26
Circa 2005
Gifford 24
2006-2007
Coglan 36
2008
PARN 44
Circa 2008
The majority were in agreement with mandatory CPD in principle but a minority
found the process of recording CPD patronising and were insulted by the
intimation that they did not routinely practice CPD principles.
A minority reported they would cease to practice as a consequence of CPD
commonly they were near retirement age. One hospital pharmacist stated they
would cease to practice in community pharmacy on Saturdays.
There was a level of confusion about how information recorded in portfolios
would inform mandatory requirements and an anxiety that in fact dual effort
was likely to be invested in ensuring mandatory requirements were met.
Respondents tended to describe retaining evidence of attendance at CE events
particularly to meet mandatory requirements rather than evidence of
competence.
Some of the focus group participants in particular commented the move towards
a mandatory requirement to undertake and record CPD was acting as a negative
influence on their motivation and decreasing their willingness to undertake
learning activities. The majority though viewed the concept of CPD positively
and felt it was needed in the current healthcare climate, for assessing
competence, maintaining registration, lifelong learning, ensuring public
confidence and providing evidence of ability to work in employment situations.
One of four themes in relation to barriers to CPD was review: unwillingness to
have CPD reviewed (I dont like the idea of being able to be checked up on).
Only 7% of respondents said CPD should be initiated by the individual and not
enforced by the RPSGB.
When asked what single change to CPD recording would encourage members to
keep a CPD record, 2% wrote something in the theme make it mandatory, 10%
wrote replace CPD with regular professional testing, 6% wrote accept all types
of recording.
Page 74
Table 8 Pharmacy professionals perception of system constraints as facilitator or barrier to participation in CPD
Study
Year study
conducted
Study participants
Laaksonen 27
2002 and
2004
Gidman 25
2005
Gifford 24
2006-2007
Anon. 41
2007
PARN 44
Circa 2008
Page 75
Table 9 Pharmacy professionals perception and experiences of technical problems as facilitators or barriers to participation in CPD
Study
Year study
conducted
Study participants
Attewell 28
2001
Gidman 25
2005
Swallow 26
Circa 2005
Gifford 24
Schafheutle 40
2006-2007
Women of all ages indicated their not recording of CPD online related to lack of
IT knowledge. In other cases interviewees did not have internet access at work
or at home. Those with internet access at work did not have time to record CPD
online due to competing demands for access to computer e.g. because
dispensing.
Respondents described a variety of factors influencing access to CPD including IT
resources such as access to a computer at work to keep an ongoing record of
CPD.
Many pharmacies were said not to have internet connections.
July 2008
From 43 participants who had not created a CPD entry following workshop
learning, a total of 3 mentioned IT problems accessing the online record.
Page 76
Year study
conducted
Study participants
Attewell 28
2001
Hull 33
2002
Mottram 30
2002
Swainson and
Silcock 32
2002
When asked about the CE conducted the most common type was reading
professional journals particularly the PJ and Chemist and Druggist. All read PJ
occasionally to weekly, most picking out important articles to read at a later date
due to ease of accessibility. Some also attended workshops by the Centre for
Pharmacy Postgraduate Education (CPPE) and completion of its distance-learning
packs. Activities also included postgraduate diploma courses. Work-shadowing
and talking to an expert were also mentioned.
The following sources were used for CE/CPD activities: The PJ (93%), CPPE
distance learning (76%), CPPE workshops (73%), textbooks (60%), Chemist &
Druggist (53%), RPSGB branch meetings (47%), manufacturers literature and/or
training (45%), educational material from National Pharmaceutical Association
(33%), in-house company information (31%), internet (28%), computer-aided
learning (11%), other professional journals (6%), RPSGB video-loan service (4%).
The mean number of hours for each type of CE was reported as 16.2 for
attending workshops, 9.1 for reading journal articles, 8.2 for distance learning
courses, 0.8 for computer assisted learning. A comparison of the difference in
participating in direct (workshops) vs. indirect activities (reading/distance
learning/computer assisted learning) by sub-group of respondents showed all
except for hospital pharmacist undertook more indirect than direct learning.
Most of the learning by the pharmacists working in large multiples was via
indirect learning.
41.2% stated they regularly undertook training needs identification and this was
more likely for female pharmacists than male and also more likely for hospital
vs. community pharmacists.
When asked about activities considered to be CPD a wide variety of responses
included private study (including internet-based literature searching), external
training, writing papers and meetings. Fewer community pharmacists
mentioned in-house training (e.g. audits and queries) and only hospital
respondents mentioned teaching. More community pharmacists mentioned
external training which included CPPE workshops or work associated with postgraduate diplomas. Few community pharmacists preferred small-group
discussions.
Page 77
Table 10 continued. Pharmacy professionals activities or use of resources for participating in CPD
Study
Year study
conducted
Study participants
Swallow 26
Circa 2005
Power 18
Circa
2005/2006
PARN 44
Circa 2008
The respondents described a wide and varied range of involvement with CE and
CPD activities including attending lectures and study days, also identifying as
CPD under-taking post-graduate diploma courses and masters programmes and
learning achieved through presenting information at in-service sessions which
resulted from reflection and reading.
The uptake of various CPD activities expressed as median % CPD time spent on
activity were reported as 10% for NHS Education for Scotland conferences, 0%
for RPSGB branch meetings, 0% for in-service meetings, 10% for distancelearning courses, 10% directed reading in the workplace, 10% learning from
colleagues (mentoring/shadowing/discussion), 15% personal study/non-directed
reading, 5% teaching or enquiry and 0% on-line courses.
When asked about different modes of CPD delivery in past 12 months 92% had
participated in informal/self-directed reading and research, 68% face-to-face, 76%
work-based, experience on the job, 68% online, 53% text-based distance learning,
28% use of corporate intranet for learning.
Type of CPD undertaken in the last 12 months were reading (96%), attending
conferences/seminars/workshops (82%), internet or library search (83%), informal
discussion with colleagues (80%), university courses/modules (16%),
modules/courses as part of professional qualification (21%).
Page 78
Year study
conducted
Study participants
Attewell 28
2001
Hull 33
2002
Mottram 30
2002
Swainson and
Silcock 32
2002
Kostrzewski 31
2004
Gidman 25
2005
Swallow 26
Circa 2005
The numbers of hours of CPD in past 12 months were reported: 13.3% said 1-9
hours, 17% said 10-19 hours, 15.1% said 20-29 hours, 32.5% said 30 or more hours.
The most likely profile to meet the RPSGB 30+ hours of CE was female employee
pharmacists registered between 11-20 years. Locum and proprietor pharmacists
were most likely not to conduct CE/CPD.
When asked if participants had undertaken any CE within the previous 12
months, 90.4% responded yes. The mean number of hours estimated to have
been undertaken in the past 12 months was 37.8 and the median was 30.
49.6% estimated they had completed the 30 hours or more CE in the previous 12
months. Pharmacist sub-groups undertaking significantly more CE were female
(median 30 hours), full-time workers (median 30 hours), those employed in
hospital (median 40 hours), or if in community working for a large multiple
(median 30 hours).
A total of 28.5% stated they maintained a CPD portfolio there were no patterns
associated with the different sub-groups.
The mean reported CPD hours in the past month for community pharmacists
was 6.9 hours with a median of 5 hours. For hospital pharmacists the mean was
14.5 hours with a median of 12.75 hours. The difference between the sectors was
statistically significant. In the past year, 50% of hospital pharmacists reported
completing more than 50 hours of CPD activity.
61% stated they kept a portfolio.
A significant minority of interviewees were not recording CPD despite reporting
learning activities.
The few respondents who had previously used a portfolio included those who
had qualified within the last few years, those responsible for creating a Trustbased educational infrastructure for pharmacists, those with responsibility for
developing a climate to allow appropriate training and supervision for preregistration pharmacists. Length of time appeared to be an influencing factor in
respondents perception of both CPD and portfolio development the recently
qualified were more comfortable with the concept of reflective practice and had
experience of a portfolio.
Page 79
Year study
conducted
Study participants
Power 18
Circa
2005/2006
Middleton 29
Spring 2006
Gifford 24
2006-2007
Anon. 41
2007
PARN 44
Circa 2008
Schafheutle 40
July 2008
Coulman39
Feb 2009
50% stated they did not have up-to-date records for the preceding 6 months and
255 had not recorded anything in that period
Only one-third reported having up-to-date records for preceding 6 months
Most recorded CPD online (58%), 25% used paper and 14% used both with others
using a desktop system.
Page 80
Page 81
Records
identified
through database
searching British
Education Index
(BEI), Educational
Resources
Information
Centre (ERIC),
and Australian
Education Index
(AUEI).
(n = 355)
Records
identified
through database
searching
Medline
(n = 395)
Screening
Identification
Figure 1 Flow diagram demonstrating identification, screening, eligibility and inclusion steps
Records
identified
through database
searching Zetoc
(n = 213)
Records
identified
through database
searching the
International
Journal of
Pharmacy
Practice
(n = 82)
Eligibility
Included
University of Reading 2010
Records
identified
through database
searching
Cochrane library
(n = 63)
Records screened
(n = 1329)
Records excluded
(n = 1275)
Full-text articles
assessed for
eligibility
(n = 54)
Studies included in
main qualitative
synthesis
(n = 22)
Page 82
Records identified
through database
searching
Cumulative Index to
Nursing and Allied
Health Literature
(CINAHL) and
International
Bibliography of the
Social Sciences
(n = 343)
If CPD is to succeed, peoples beliefs and attitudes must be addressed by recognising and modifying perceived barriers through a combination of regulatory, professional, work-related
and personal channels.
University of Reading 2010
Page 83
Appendix 4
Planned interventions
Procedures
Total no.
per
participant
Average
Description of intervention/procedure
time per
intervention/
procedure
About 15
minutes or
more if
needed.
10 minutes
3 hours
>1 hour
10 minutes
50 minutes
About 15
minutes (more
if needed)
Participants will be recruited from CPD training events. Before participants enrol they will discuss with a
researcher their suitability for the study, and details of the study, as described in the information sheet.
Participants will then sign the consent form before completing a short demographics and contacts
questionnaire. The exchange will take place at each site. Each participant receives a unique study number.
Each participant will be requested to submit CPD records they have already prepared as part of their practice
or further to the CPD workshops. The records will be photocopied and/or printed and anonymised by using
the participants study number plus a code to indicate study stage. Paper records will be returned to the
participants. This work will be carried out either electronically (e-copies) or via the postal service, after
recruitment to the study.
After stratification according to pre-determined criteria, the Contractor will arrange to deliver either the
revalidation standards alone (control group) or training material to include the revalidation standards and
the Outcomes Framework and related training (intervention group). Participants in the intervention group
will receive a workbook that forms the basis of the training as well as a PowerPoint presentation (delivered
via e-mail) which will include an audio pod-cast. .
Participants will complete 2 new CPD records after receiving the revalidation standards (control group) and
completing that tasks within the revalidation standards training material (intervention group). Each entry is
likely to take 1 hour or longer depending on the nature of the activity and the manner in which it is recorded.
One will involve users in rewriting an existing CPD and the other in a new CPD activity altogether.
Each participant will be requested to submit 2 of the new CPD records they have prepared after learning
about the revalidation standards through the distance-learning material. The records will be photocopied
and/or printed and anonymised by using the participants study number plus a code to indicate study stage.
Paper records will be returned to the participants. This work will be carried out either electronically (ecopies) or via the postal service, after receipt of training material.
Willing participants will be interviewed in focus groups comprising 5-7 professionals. The interviews will be
audio-recorded and transcribed for analysis.
Debriefing will takes place when a participant has finished the study. Participants will be allowed to ask
questions of the researchers. This will take place face-to-face for those who attend the focus groups and over
the telephone for others, who will be given the option to attend a face-to-face debriefing if required.
Page 84
Flow of participants
Potential participants assessed for eligibility
and recruited into study
Debriefing
Page 85
Appendix 5
Ethical application
CPD records for revalidation: assessing fitness-to-practise using revalidation standards and an
Outcomes Framework
Dr Parastou Donyai, Dr Angela Alexander, Professor Pam M Denicolo
All statutorily regulated health professionals will need to periodically demonstrate their
continued fitness to practise through revalidation. From April 2010 a new regulatory body,
the General Pharmaceutical Council (GPhC) will be responsible for the statutory regulation of
pharmacists and pharmacy technicians in Great Britain and this role will include the
revalidation of these professionals. It has been proposed that records of CPD form part of the
supporting evidence submitted by practitioners for revalidation and for that to take place
there is a requirement for new revalidation standards to be developed and tested. While
CPD has been a professional requirement of the Code of Ethics for a number of years, recent
new standards issued by the RPSGB require all practising pharmacists and registered
technicians to make a minimum of nine CPD entries per annum from 1 March 2009 in all
normal circumstances. In addition, pharmacists are now required to demonstrate CPD
outcomes in terms of their relevance and effectiveness.
The aim of this research is to investigate pharmacy professionals ability to conduct and
record their CPD in a manner that enables CPD records to be used as part of professional
revalidation. We will critically examine current literature and well as existing CPD records
after which we will use an educational intervention to train pharmacy professional to
construct and conduct their CPD based on the new revalidation standards. We will devise
and use an Outcomes Framework to help participants complete their new CPD records. We
expect that while existing research shows variability in pharmacy professionals in terms of
their participation in and attitudes towards CPD, the records submitted before training will
demonstrate gaps in terms of the information required for the process of revalidation. All
records will be anonymised by removing individual/personal details and replacing all
identifiable data either with the unique participant study number or by removing it through
erasure. Our hypothesis is that after training pharmacists to use the new revalidation
standards, specifically with the aid of an Outcomes Framework, new CPD records will be
constructed and recorded in a manner that will enable these documents to be used as part of
revalidation.
We also hypothesise that participants experience of using the new
revalidation standards will be positive and that they will be supportive of CPD in the future.
Specific objectives include:
Conducting a full literature review to identify research already undertaken that examines
areas and groups of registrants in which implementation of the RPSGB CPD framework is
most and least advanced. Identifying gaps in research.
Collating information on already-identified barriers to the uptake of CPD and examining
the nature of these barriers in relation to the uptake of future CPD for revalidation.
Developing a generic Outcomes Framework for use with the revalidation standards
during the conduct and reporting of pharmacists CPD.
Recruiting volunteer pharmacist and pharmacy technician participants through formal
CPD events
Collating volunteer CPD records to examine against the revalidation standards as well as
the Outcomes Framework devised.
Training volunteer participants to complete CPD records using the revalidation standards
as well as the Outcomes Framework devised through distance-learning material.
Page 86
Collating the new CPD records and examining these against the revalidation standards as
well as the Outcomes Framework devised.
Holding focus group interviews with study participants.
Analysing the data using qualitative interpretive methods as well as quantitative scoring.
Reporting the findings in a timely and considered manner.
Disseminating and publishing the findings via conference presentations and in peerreviewed journals.
Risk
We have considered the risks to which we might be exposing participants in this research.
We do not expect that participants will be exposed to any increased risk, over and above
what they would be expected to encounter in their normal lives. As researchers, however,
we have a responsibility to protect participants from physical and mental harm during the
investigation. There is a potential for participants to feel susceptible about the fact that their
CPD records are being assessed against an Outcomes Framework and Revalidation Standards.
In order to address this issue all CPD records will be anonymised by the Research Assistant on
receipt. This will involve removing individual/personal details and replacing all person
identifiable data either with the unique participant study number or removing it altogether
through erasure. In any case, this is a stand-alone pilot that will not link with actual process
of revalidation of pharmacy professionals, which may or may not use CPD records as part of
the process in due course. On enrolling onto the study, each participant will receive a unique
participant study number, which they will be asked to quote in all future correspondence. A
master copy of the code will be kept by the Research Assistant in hard copy and under locked
storage in a filing cabinet for the duration of the study. After the project this data will be
destroyed by shredding. In addition to the analysis of CPD records, we will be conducting
qualitative focus group interviews with participants. In the event that a distressing situation
arises for a participant during conversations about completion of CPD records, the lead
researcher or a co-investigator will be co-convening all interviews with the Research Assistant
to ensure that due judgement is exercised and that unexpected outcomes are managed
appropriately and sensitively.
Informed consent
We will recruit adult participants only. We will disclose any information that might affect
someones decision to participate or not. As such, we will inform participants as fully as
possible about what the study will involve when recruiting them, so that they can choose
whether or not they wish to participate. We will avoid undue coercion but feel it is
reasonable to propose to reimburse each participant with a 50 book token for their
participant in the study. We also propose to pay for the cost of locum cover for those
attending focus-group interviews at 200/day (which will include the locums travel expenses)
and we will also be providing light refreshments to the value of 3 per head for interview
participants. We will inform all participants of all aspects of the research that might
reasonably be expected to influence willingness to participate. This will include how long the
study will take, what is actually involved, why we are conducting the research, and what
aspect(s) of learning we are investigating.
Right of withdrawal
Right of withdrawal is essentially an extension of informed consent. Participants have the
right to withdraw their consent to participate at any time before, during or after the study.
For example, someone who initially agrees to participate has the right to cancel, to drop out
part way through the study, or to decide afterwards that they wish they hadnt participated
and to withdraw then. If a participant decides after they have completed the study that they
wish to withdraw, we will not use their data unless they give their permission to do so. We
Page 87
will inform our participants of their right of withdrawal when we seek their consent, and
remind them of this right during the briefing. We will also inform them that they do not
have to give a reason for withdrawing.
Debriefing of research participants
Debriefing has been built into the study protocol and will take place when participants have
finished the study, and will allow us to bring the study to a close. We will provide the
participants with any necessary information to complete their understanding of the nature of
the research. Where needed, this might include explaining the nature of the phenomenon
under investigation, the method used or further clarifying the purpose of the study.
Debriefing will also allow the participants to ask questions of us as the researchers. This will
take place face-to-face for those who attend the focus groups and over the telephone for
others, who will be given the option to attend a face-to-face debriefing if required.
Confidentiality and anonymity
Participants have the right to expect that information about them, including data collected
during a study, is kept confidential and/or anonymous as appropriate. Participants certainly
have the right to expect that their identity will not be revealed by name or by any other
description and we will ensure that this is the case. We will take measures to protect
participants data in the conduct, storage of data and dissemination of outcomes of this study
as follows. The data collected as part of the CPD reviews will be in the form of electronic or
paper CPD records. We will print a copy of any electronic record and photocopy paper
records before returning the originals to the participants. At the print/photocopy stage, all
records will be anonymised by the Research Assistant. Each record will be assigned the
participant study number by the Research Assistant (and a code to indicate study stage
because this is a before and after study) on receipt. As this is a before and after study, the
study code is needed to help match up the records submitted pre- and post-intervention. In
relation to the focus group interviews, we will tape record the conversations (with
participants consent) to allow accurate notes to be made afterwards. The recording will be
carried out using a digital audio-recorder and the transcripts will be typed using Microsoft
Word. Although we will not be setting out to collect this type of information, any data that
will enable a subject to be identified (e.g. name, address, work-place, job title, date of birth)
will be removed before the data is typed and stored electronically. Data would not be kept
for longer than necessary so after the outcomes have been adequately disseminated this
material would be disposed of. To make sure of the privacy of any electronic data, it will be
stored by the investigators and the Research Assistant on password protected drives. The
paper copies will be kept in a locked cabinet when not in use. Only the persons concerned
(Drs Donyai and Alexander and Professor Denicolo and the Research Assistant) will be
allowed access to the data. In the reporting of the project, no information will be released
which will enable to reader to identify who the respondent was.
Page 88
Appendix 6
Letter to Director of CPPE
Page 89
Dear Dr Cutts
CPD records for revalidation
Dr Christopher Cutts
Director
Centre for Pharmacy Postgraduate
Education (CPPE)
1st Floor, Stopford Building
University of Manchester
Oxford Road
Manchester
M13 9PT
United Kingdom
14 July 2009
I am writing following the successful award made to the Reading School of Pharmacy by the
Royal Pharmaceutical Society of Great Britain (RPSGB) to investigate the use of Continuing
Professional Development (CPD) records for revalidation of pharmacy professionals.
Our project will involve the recruitment of pharmacists and pharmacy technicians as
volunteer participants in a pilot scheme. We hope to recruit from forthcoming joint RPSGBCPPE interactive CPD workshops and I am writing to seek your formal approval to recruit
from the events. I understand that Dr Angela Alexander brought our bid to your attention at
the application stage in May. I would like to thank you for kindly accepting in principal our
intention to recruit at these events, and agreeing to consider the full detail of our proposal on
attainment of funding. Please find below a description of the recruitment process as relates
to the forthcoming CPD events.
Our aim is to recruit a total of 72 pharmacy professionals during July and September 2009.
With your approval, we intend to recruit from 15 of the forthcoming CPD events in the
South Central region, primarily those being held at the University of Reading. Our plan
would be to write to the local tutors running each session to inform them of our intention to
recruit volunteer pharmacy professionals at the close of each workshop session for
participation in this independent research project examining the appropriateness of CPD
records for revalidation. On the day of the workshops at least one member of our research
team will be present to fully brief potential participants about our study, using information
letters as a basis and collecting participants informed consent prior to enrolment. We
intend to conduct the recruitment away from the main events training rooms and in private
at each training site. The project, in essence, will involve participants submitting a number
of CPD records at future dates for evaluation before and after receiving revalidation-specific
instructions in due course. We are in the latter stages of obtaining ethical approval for this
study from the University of Reading.
Pharmacy is undergoing a period of unprecedented change and I look forward to us working
together to facilitate a project that we believe will provide robust and scientific data in
relation to the role of CPD in pharmacy professionals revalidation. Please do not hesitate to
Page 90
contact me if you need any further information or clarification as relates to the project
recruitment plans or indeed the project itself. I look forward to hearing back from you.
Yours sincerely
Parastou Donyai
Dr Parastou Donyai
Cc. Dr Angela Alexander, Prof. Pam M Denicolo
Page 91
Appendix 7
Recruitment documentation
Information letter
Frequently-asked questions
Consent form
Demographic information
Page 92
University of Reading
The CPDSchool
for Revalidation
in Pharmacy Study
Reading
of Pharmacy
Food Biosciences building
Whiteknights, PO Box 226
Reading RG6 6AP
UK
p.donyai@reading.ac.uk
July/Sept 2009
Dr Angela Alexander
BPharm MSc FRPharmS
MCPP MBE
Page 93
University of Reading
The CPD
for Revalidation in
Pharmacy Study
Please complete this short questionnaire writing in ink and using clear capitals. All sections should be completed.
Postcode:
Home telephone number:
Work telephone number:
Mobile telephone number:
Email address:
Gender:
Age band:
Professional status:
Male
20
31 - 40
51 - 60
21 - 30
41 - 50
61 - 70
Pharmacist
Female
Registered technician
Year qualified as technician:
Community
Hospital
71 or over
Online
Industry
Please describe:
Type 1
Yes
Academia
Type 2
No
Page 94
2.
I have had explained to me the purposes of the project and what will be required of
me, and any questions I have had have been answered to my satisfaction. I agree to
the arrangements described in the FAQ sheet in so far as they relate to my
participation.
3.
I understand that participation is entirely voluntary and that I have the right to
withdraw from the project any time, and that this will be without detriment to any
services I may be receiving or may receive in the future.
4.
This application has been reviewed according to the procedures specified by the
University Research Ethics Committee at the University of Reading, and has been
given a favourable ethical opinion for conduct.
5.
I have received a copy of this Consent Form and of the accompanying letter and FAQ
Sheet.
Name:
Signed:
Date:
Page 95
Page 96
August
September October
Enrolment
Submission of initial CPD record(s)
Receipt of
revalidationspecific
instructions
November
December
Submission of
two new CPD
records one
rewritten and one
conducted afresh
Optional Focus
group interviews
Debriefing about
the study
CPD-RPS timelines: this table illustrates the main aspects of the study as relates to time
Page 97
today, which we will ask you to use in all future correspondence. We will analyse the CPD records by
comparing the records before and after the revalidation-specific instructions and we will look specifically
to see if such records could be used in the future as part of revalidation of pharmacy professionals. We
will analyse the focus-group interviews to identify themes in relation to participants understanding and
experience of participating in the CPD-RPS study. We will eventually use the information to produce a
report to communicate our findings to the RPSGB. It is also likely that we will publish journal articles to
disseminate the findings to the wider pharmacy community. Published reports on the results from the
CPD-RPS study will not mention individuals or include any identifying information.
Q.9 How will your information be kept private?
We will take measures to protect your data throughout the conduct, storage and dissemination of this study
as follows. If you decide to take part in this study, you give us permission to use the CPD records you
submit to us as study data. However, this information will be kept anonymous. This means that your
identity will not be revealed by name or by any other description and we will ensure that this is the case.
The data collected as part of the CPD record reviews will be in the form of electronic or paper CPD
records. We will print a copy of any electronic record and photocopy paper records before returning the
originals to you within two weeks of receipt. At the print/photocopy stage, all records will be anonymised
by a member of the research team. Each record will be assigned the appropriate participant study number
on receipt (and a code to indicate study stage because this is a before and after study). Personal
information (such as name and address) about you will be kept confidential at all times. It will be kept in a
secure file.
In relation to the optional focus group interviews, we will tape-record the conversations (with all
participants consent) to allow accurate notes to be made afterwards. The recording will be carried out
using a digital audio-recorder and the transcripts will be typed using Microsoft Word. Although we will
not be setting out to collect this type of information, any data that will enable a subject to be identified will
be removed before the conversations are typed and stored electronically.
Data would not be kept for longer than necessary so after the outcomes have been adequately disseminated
all the material will be disposed of. To make sure of the privacy of any electronic data, it will be stored by
the investigators and a Research Assistant on password protected drives. The paper copies will be kept in
a locked cabinet when not in use. Only the persons concerned (Drs Donyai and Alexander and Professor
Denicolo and a Research Assistant) will be allowed access to the data. In the reporting of the project, no
information will be released which will enable to reader to identify who the respondent was.
Q.10 What if you decide to withdraw from the study?
You have the right to withdraw your consent to participate at any time before, during or after the study.
For example, you have the right to cancel, to drop out part way through the study, or to decide afterwards
that you wish you hadnt participated and to withdraw then. If you decide after you have completed the
study that you wish to withdraw, we will not use your data unless you give your permission for us to do so.
You do not have to give a reason for withdrawing.
Q.11 Will you receive payment for being part of this study?
We feel it is reasonable to reimburse each participant with a 50 book token for participating in the CPDRPS study to the end. We also propose to pay for the cost of locum cover for those attending focus-group
interviews at 200/day.
Page 98
concerns or you wish to contact someone else regarding the study, please do so using the Reading School
of Pharmacy contact information at the head of this letter.
Q.13 Has there been ethical consideration for the project?
This project has been subject to ethical review, according to the procedures specified by the University
Research Ethics Committee, and has been allowed to proceed.
Yours sincerely
Dr Parastou Donyai
BPharm PGDPRM(Open)
PGCert LTHE MRPharmS
Dr Angela Alexander
BPharm MSc FRPharmS
MCPP MBE
Page 99
Appendix 8
Seeking initial opinions on the face-validity,
clarity/complexity, user-friendliness of the CPD Outcomes
Framework
Page 100
Parastou
19 October 2009
On behalf of the research team:
Dr Parastou Donyai
BPharm
PGDPRM(Open) PGCert
LTHE MRPharmS
Principal Investigator
Dr Angela Alexander
BPharm MSc
FRPharmS MCPP
MBE
Co-investigator
Rebecca Z Herbert
BA MSc
Research Assistant
Page 101
Background
The General Pharmaceutical Council (GPhC) has recently launched a consultation as part of its
Regulatory Standards Development Programme. Annex C contains the Standards of proficiency for
pharmacy professionals, considered the minimum necessary to protect members of the public. In
the future, pharmacy professionals (pharmacy technicians and pharmacists) will need to meet all of
the standards upon first registration and thereafter continue to meet the standards that are relevant to
their scope of practice. More specifically, Section 1 of the standards, Expectations of a pharmacy
professional, apply to all pharmacy professionals irrespective of their field of work at first
registration and thereafter. Section 2 of the standards, The skills of pharmacy practice, apply to
pharmacists (and pharmacy technicians, where indicated by a tick) at first registration, and where
relevant thereafter. Section 3 of the standards, Being a pharmacy professional, provides a global
overview of what it means to be a pharmacist or a pharmacy technician. A copy of Annex C is
enclosed for your information.
We were successful in our bid to the Royal Pharmaceutical Society of Great Britain (RPSGB) for
funding to investigate the use of CPD records for revalidation of pharmacy professionals. Our
research will examine the applicability of the above-described Standards of proficiency for
pharmacy professionals (in short, proficiency standards) to the assessment of CPD records. We
propose to do this via a CPD Outcomes Framework. This is a tool that will verify the relevance of
the CPD, and its tangible impact in relation to the proficiency standards.
In constructing the Outcomes Framework, we have also referred to Annex E1 of the GPhC
Regulatory Standards Development Programme, Continuing Professional Development Standards
and Framework. This document states that the (CPD) framework that is adopted by the Council
must ensure that any CPD that is undertaken by a registrant demonstrates a relevance to:
a) the safe and effective practice of pharmacy; and
b) a learning need for the individual registrant that is relevant to their current scope of
practice including any specialisation of that individual registrant and the environment in
which they practise.
There are 6 CPD Standards, two of particular interest, namely Standard 4 Include in your record
CPD that is relevant to safe and effective practice and the Standards of Conduct, Ethics and
Performance of the profession and Standard 5 Record how your CPD has contributed to the quality or
development of your practice and has benefited patients and the public. A copy of Annex E1 is
enclosed for your information.
Page 102
Page 103
Domains
Negligible
Minor
Moderate
Major
Catastrophic
RIDDOR/agency reportable
incident
Local resolution
Quality/complaints/audit
Peripheral element of
treatment or service
suboptimal
Informal complaint/inquiry
Critical report
Page 104
No or minimal impact or
breech of guidance/
statutory duty
Challenging external
recommendations/ improvement
notice
Prosecution
Complete systems change required
Improvement notices
Zero performance rating
Low performance rating
Severely critical report
Adverse publicity/ reputation
Rumours
Potential for public concern
Critical report
National media coverage with <3
days service well below
reasonable public expectation
Schedule slippage
Schedule slippage
Schedule slippage
Key objectives not met
Finance including claims
Moderate impact on
environment
Page 105
We also believe it will be possible to use Table 2 to score the likelihood of a potential adverse
outcome(s) occurring as a result of failing to complete the CPD activity. Please examine Table 2
below and provide your thoughts on the applicability of this table to CPD for the purpose of
providing evidence for revalidation; please either write in the box below or on the margins of the
Table itself.
Table 2 Likelihood score (L)
Again, please use the example CPDs when considering the applicability of this table. Consider,
what is the likelihood of the consequence (identified above) occurring?
Likelihood score
Descriptor
Rare
Unlikely
Possible
Likely
Almost certain
Frequency
How often might
it/does it happen
Do not expect it to
happen/recur but it is
possible it may do so
Will probably
happen/recur but it is
not a persisting issue
Will undoubtedly
happen/recur,possibly
frequently
Comments on the use of Table 2 likelihood scores in relation to the likelihood of a potential adverse
outcome(s) occurring as a result of failing to complete the CPD activity.
Please see below for information on Table 3 Risk scoring and Instructions for use as provided by the
NPSA.
University of Reading 2010
Page 106
Rare
Unlikely
Possible
Likely
Almost certain
5 Catastrophic
10
15
20
25
4 Major
12
16
20
3 Moderate
12
15
2 Minor
10
1 Negligible
For grading risk, the scores obtained from the risk (relevance) matrix are assigned grades as follows
15-25
9-12
4-8
1-3
Significant relevance
High relevance
Moderate relevance
Low relevance
Comments on the use of Table 3 Relevance scores in relation to the relevance of a CPD activity.
The idea is that a higher score indicates a more relevant CPD.
Page 107
To calculate the quality and benefit score, we are proposing that registrants firstly demonstrate the
proficiency standard(s) to which their submitted CPD activity relates. They then work along the
columns to assess the extent to which their CPD, in relation to the states proficiency standard(s), has
since contributed to the quality or development of their practice and has benefited patients and the
public. The quality and benefit score is then read as the number given at the top of the column.
Table 4 Quality and benefit scores (Qb)
Quality and benefit score
-2
-1
Domain
Negligible
Minor
Moderate
Major
Substantial
No or minimal
impact on quality
of practice
Minor improvement
in quality of
practice.
Moderate
improvement in
quality of practice.
Major improvement
in quality of practice.
Major improvement
in quality of practice.
No or minimal
direct benefit to
patients and the
public
Minor benefit to
patients and the
public
Moderate benefit to
patients and the
public
Major benefit to
patients and the
public
Major benefit to
patients and the
public
We also believe it will be possible to use Table 5 to score the strength of evidence relating to the
quality and benefit score. Please examine Table 5 below and provide your thoughts on the
applicability of this table to CPD for the purpose of providing evidence for revalidation; please
University of Reading 2010
Page 108
either write in the box below or on the margins of the Table itself. Again, please use the example
CPDs when considering the applicability of this table.
Page 109
-2
-1
Evidence of input
Evidence of reaction
Evidence of learning
Evidence of Results
Page 110
Material gathered:
Evaluation of
courses/conferences attended
Profiles drawn from learning
portfolios
Material produced:
Formal assessment and exam scores
Case studies
Course assignments
Information leaflets
Critical literature reviews
Policy or position statements
Discussion documents
Procedural documents
Protocols
Documents relating to national or
local processes (e.g. schemes for
peer review, mentorship or clinical
supervision)
Reports (e.g. on project work,
clinical audit, reviews of activity)
Business plans
Guidance materials (e.g. for service
users, colleagues or students)
Clinical audit tools
Clinical guidelines
Presentations
Articles produced for publication
Questionnaires
Research papers/proposals/funding
applications/ethical approval
applications
Induction materials for new
members of staff
Contributions to work of a
professional body or a special
interest group
Documented and approved claims
for academic credit for prior or
experiential learning
Page 111
Please see below for information on Table 6 Impact scoring devised by the CPD-RPS investigators:
Table 6 Impact scoring = quality and benefit + strength of evidence ( Qb + E )
Quality and benefit score
Strength of evidence
score
3 Evidence of results
2 Evidence of
behavior change
1 Evidence of
learning
-1 Evidence of
reaction
-2 Evidence of input
-2
-1
Negligible
Minor
Moderate
Major
Substantial
-1
-3
-2
-4
-3
-1
For grading impact, the scores obtained from the impact matrix can be assigned grades as follows
4-6
1-3
0
-4 - -1
High impact
Moderate impact
Low impact
Negligible impact
Page 112
Comments on the use of Table 6 Impact scores in relation to the impact of a CPD activity.
Comments on the use of CPD scores in relation to the overall assessment of a CPD activity.
Page 113
10
8
6
4
2
15
12
9
6
3
20
16
12
8
4
25
20
15
10
5
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
-5
-4
-3
-2
-1
-10
-8
-6
-4
-2
-15
-12
-9
-6
-3
-20
-16
-12
-8
-4
-25
-20
-15
-10
-5
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
-15
-12
-9
-6
-3
-30
-24
-18
-12
-6
-45
-36
-27
-18
-9
-60
-48
-36
-24
-12
-75
-60
-45
-30
-15
-20
-16
-12
-8
-4
-40
-32
-24
-16
-8
-60
-48
-36
-24
-12
-80
-64
-48
-32
-16
-100
-80
-60
-40
-20
10
8
6
4
2
20
16
12
8
4
30
24
18
12
6
40
32
24
16
8
50
40
30
20
10
5
4
3
2
1
10
8
6
4
2
15
12
9
6
3
20
16
12
8
4
25
20
15
10
5
0
0
0
0
0
0
0
0
0
0
-10
-8
-6
-4
-2
-20
-16
-12
-8
-4
-30
-24
-18
-12
-6
-40
-32
-24
-16
-8
-50
-40
-30
-20
-10
-15
-12
-9
-6
-3
-30
-24
-18
-12
-6
-45
-36
-27
-18
-9
-60
-48
-36
-24
-12
-75
-60
-45
-30
-15
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
-5
-4
-3
-2
-1
-10
-8
-6
-4
-2
-15
-12
-9
-6
-3
-20
-16
-12
-8
-4
-25
-20
-15
-10
-5
15
12
9
6
3
25
16
12
8
4
30
20
15
10
5
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
5
4
3
2
1
10
8
6
4
2
15
12
9
6
3
20
16
12
8
4
25
20
15
10
5
40
32
24
16
8
60
48
36
24
12
80
64
48
32
16
100
80
60
40
20
15
12
9
6
3
30
24
18
12
6
45
36
27
18
9
60
48
36
24
12
75
60
45
30
15
10
8
6
4
2
20
16
12
8
4
30
24
18
12
6
40
32
24
16
8
50
40
30
20
10
30
24
18
12
6
45
36
27
18
9
60
48
36
24
12
75
60
45
30
15
40
32
24
16
8
60
48
36
24
12
80
64
48
32
16
50
40
30
20
10
75
60
45
30
15
100
80
60
40
20
125
100
75
50
25
20
16
12
8
4
40
32
24
16
8
60
48
36
24
12
80
64
48
32
16
100
80
60
40
20
15
12
9
6
3
5
4
3
2
1
10
8
6
4
2
60
48
36
24
12
90
72
54
36
18
120
96
72
48
24
150
120
90
60
30
25
20
15
10
5
50
40
30
20
10
75
60
45
30
15
100
80
60
40
20
125
100
75
50
25
20
16
12
8
4
100
80
60
40
20
10
8
6
4
2
Page 114
20
16
12
8
4
30
24
18
12
6
40
32
24
16
8
50
40
30
20
10
Thank you very much for taking the time to complete this form. Please feel free to use the space
below for additional comments.
Parastou
19 October 2009
On behalf of the research team:
Dr Parastou Donyai
BPharm
PGDPRM(Open) PGCert
LTHE MRPharmS
Principal Investigator
Dr Angela Alexander
BPharm MSc
FRPharmS MCPP
MBE
Co-investigator
Rebecca Z Herbert
BA MSc
Research Assistant
Additional comments
Page 115
Appendix 9
Seeking to verify the content of the CPD Outcomes
Framework using the Content Validity Index
Page 116
Rationale
The Content Validity Index (CVI) has been advocated as a rigorous approach to evaluating
content validation. A panel of experts is asked to rate each scale item in terms of its
relevance to the underlying construct. Each expert is given an explicit description of each of
the domains and rates the content relevance on a 4-point scale, where 1 indicates totally
irrelevant content and 4 reflects extremely relevant content. Then a CVI is derived for each
item, which is the proportion of judges who rate the item 3 or 4.
A summary
recommendation is that for a scale to be judged as having excellent content validity, it would
be composed of items with CVIs that meet the following criteria:
Individual item CVI = 1.00 with 3 to 5 experts
Individual item CVI = 0.78 with 6 to 10 experts (no more than one should score item <3).
Overall average CVI = 0.90 or higher.52
Participants who attended the focus group interviews were deemed sufficiently expert on
the topic to be invited to rate the content validity of the CPD Outcomes Framework, as
follows:
E-mail sent to participants
I wondered whether you would be able to provide me with some feedback on your views
about the CPD Outcomes Framework by answering the 5 questions below (by return of email). If you would like to help with this, each question should be answered by indicating a
number from 1 to 4 against it as follows: 1 = not relevant, 2 = somewhat relevant, 3 = quite relevant,
4 = highly relevant
1) How would you rate the concept of Consequence (as part of calculating relevance) in
relation to CPD for revalidation?
2) How would you rate the concept of Likelihood (as part of calculating relevance) in
relation to CPD for revalidation?
3) How would you rate the concept of Quality and benefit (as part of calculating impact)
in relation to CPD for revalidation?
4) How would you rate the concept of Strength of evidence (as part of calculating
impact) in relation to CPD for revalidation?
5) How would you rate the CPD Outcomes Framework in general in relation to CPD for
revalidation?
Summary of ratings
Question Rater 1
Rater 2
Rater 3
Rater 4
Rater 5
Rater 6
Rater 7
CVI
Q.1
0.86
Q.2
0.71
Q.3
Q.4
Q.5
0.91
Page 117
Appendix 10
Quality assuring the training material: internal reviewer
feedback form
Page 118
* The regulatory role of the RPSGB will be carried out by the General Pharmaceutical
Council (GPhC) after April 2010. The shadow GPhC has issued draft standards for
consultation.
Page 119
To a great extent
3
Page 120
Reviewer feedback:
Material in plastic folder
Introductory
Do you think this was easy to read and
letter
understand?
Not at all
How to use
this pack and
what to do
next?
Statement of
learning and
agreement to
confidentialit
y
Additional comments:
To a great extent
1
2
3
4
5
Do you think this was easy to read and
understand?
Not at all
To a great extent
1
2
3
4
5
Do you think this was easy to read and
understand?
Not at all
To a great extent
1
2
3
4
5
What was your overall impression of
this section? How do you think this
section could be improved? Please
provide comments and suggestions as
appropriate.
Additional comments:
1
2
3
4
5
Do you feel the level of information
covered was:
Too basic
Too advanced
1
2
3
4
5
What was your overall impression of
this section? How do you think this
section could be improved? Please
provide comments and suggestions as
appropriate.
Page 121
Additional comments:
Too basic
Too advanced
1
2
3
4
5
Do you think the case studies are
effective to help the learner think
about recording relevant and effective
CPD?
Not at all
To a great extent
1
2
3
4
5
What was your overall impression of
this section? How do you think this
section could be improved? Please
provide comments and suggestions as
appropriate.
23 page stapled document
The CPD
Do you think this was easy to read and
Outcomes
understand?
Framework:
suggested
Not at all
To a great extent
case study
answers
1
2
3
4
5
Do you feel the level of information
covered was:
Additional comments:
Too basic
Too advanced
1
2
3
4
5
Do you think the case study answers are
effective to help the learner think about
recording relevant and effective CPD?
Not at all
To a great extent
1
2
3
4
5
What was your overall impression of this
section? How do you think this section
could be improved? Please provide
comments and suggestions as appropriate.
Page 122
The dvd
Video/
Powerpoint
presentation
Additional comments:
To a great extent
1
2
3
4
5
Do you feel the level of information
covered was:
Too basic
Too advanced
1
2
3
4
5
What was your overall impression of
this section? How do you think this
section could be improved? Please
provide comments and suggestions as
appropriate.
Page 123
Appendix 11
Instructions for submission of CPD records
Page 124
Access and work through the online tutorial relating to the CPD Viewer as follows:
a. Go to the CPD website of the RPSGB http://www.uptodate.org.uk/
b. On the Home page, on left hand panel, click on CPD Materials
c. This action opens a new page entitled CPD Materials. On this page under the
heading of Online Tutorials click on Click here to launch the online
tutorials.
d. This action opens a new dialogue box headed Tutorials. Under the subheading
CPD viewers click on Entry properties .
e. This action opens a new page (window) for an animated demonstration showing
how you can authorise someone to view specified parts of your CPD Record.
f. Click on Start Demo at the foot of the page and watch the demonstration by
pressing the green Play button
when you are ready. You may need to make
the screen larger or scroll down to see the Start Demo and Play buttons on each
page. There are 5 steps to watch.
g. Close the Demo page (window) and the Tutorials page when you have finished
watching the 5 steps.
2.
Log in to your CPD Records in the usual way by clicking the button in the top left hand
corner of the main
page:
Log
in to your CPD Record
3.
4.
Choose an entry and make it available for viewing by following the instructions provided in
the online tutorial as per Step 1, above. In summary:
a. In the top right hand corner of your chosen record, click on
Properties
b. In this window, click on Add new viewer . This action open a new dialogue box
headed Add/Edit Viewer.
c. Complete each section, noting down the information you type in:
i. For Name of Viewer: type CPD-RPS
ii. For User Name: type your unique participant number provided on
enrolment (care is needed in typing this number) e.g. xyz 98765
iii. For Password: type CPD-RPS
Page 125
iv. For Allow Viewer Access: Click on either Always or Between Dates
Specified Below. The second option allows you to limit our access to your
chosen CPD record to a specified time period using the start and end dates.
d. Click on OK when you have completed all the sections above. This action
returns you to the Properties page for that particular CPD record.
e. In the section headed Personal Viewers, the Viewer description column should
now include CPD-RPS. Click the small box in the next column headed Viewer
has access. A small will appear to finalise the process.
5.
Choose 2 further entries and make them available by again accessing the Properties tab in
the right hand corner of those records. CPD-RPS should automatically appear as a Viewer
description for each subsequent record. Again click the small box in the next column headed
Viewer has access to make the chosen records available.
6.
Email me at p.donyai@reading.ac.uk to confirm you have made your 3 records available for
viewing and you have typed the information as per 4c, above, into the relevant Viewer fields.
At that time, please also let me know your RPSGB registration number, which I need to
access the records via CPD Viewer.
7.
On receipt of your e-mail, I will access and print the 3 records and make them anonymous. I
will then write back to you to confirm that I have finished viewing the records.
Print..
.
Page 126
Page 127
Appendix 12
The printed material sent to the intervention group
Page 128
Dr Angela Alexander
BPharm MSc
FRPharmS MCPP MBE
Co-investigator
Rebecca Z Herbert
BA MSc
Research Assistant
Page 129
Please feel free to use this as a checklist to ensure you have access to all of the enclosed
documents/files:
Cover letter
List of materials enclosed (this list)
Updated schedule for the project
How to use this pack and what to do next
A folder of printed material containing:
1. The CPD Outcomes Framework: the Tutorial
2. The CPD Outcomes Framework: an Overview
3. Blank templates (x 15) for assessment of CPD cases
4. The CPD Outcomes Framework: suggested case study answers
5. The GPhC Standards of Proficiency for Pharmacy Professionals
6. The GPhC Continuing Professional Development Standards and Framework
A CD-ROM containing:
1. Adobe Acrobat files (of the CPD Outcomes Framework Overview and Tutorial)
2. PowerPoint presentations (of the CPD Outcomes Framework Overview and
Tutorial as well as suggested case study answers)
3. Videos (of the CPD Outcomes Framework Overview and Tutorial as well as
suggested case study answers)
Statement of learning and agreement to confidentiality
A stamped-addressed envelope
Page 130
Date completed
*Please note we were able to accept a maximum of 3 CPD records from each participant, so if you
submitted more than 3 records in phase one of the study, please note that we have accepted only the
first 3 records for inclusion in the study.
5. New CPD Record 2: Record a completely new CPD activity after completing the steps above.
This may involve you in conducting a whole new CPD activity or you may decide to create a
new record based on an activity you have been conducting. Again, this new CPD should be
conducted and recorded using the CPD Outcomes Framework. This will form the second
of the new CPD entries we are asking you to submit by the end of February 2010.
6. Submit the two new CPD records to me by the end of February 2010 using one of the options
previously outlined (postal or electronic as before). If you find it easier, you may wish to print
Page 131
and use the stamped-addressed envelope to send in the records together with your statement of
learning and agreement to confidentiality.
Thank you for your continued support and commitment to the development of CPD for our
profession.
Page 132
to
November December
Enrolment
Submission of initial CPD record(s)
Receipt of
revalidationspecific
instructions
namely, a
detailed training
pack enclosed
with this updated
schedule.
January/February March/April
Working through
the training pack,
and submitting
two new CPD
records one
rewritten and one
conducted afresh.
Returning the
statement of
learning.
Optional focus
group interviews
Debriefing about
the study
including
feedback about
your CPD
records
CPD-RPS timeline: this table illustrates the main aspects of the study as relate to time
Page 133
Thank you. This will help us with our quality assurance processes.
Participant number:
Signed:
Date:
Page 134
PowerPoint presentations (of the CPD Outcomes Framework Overview and Tutorial as well as
suggested case study answers)
1. CPD Outcomes Framework Overview.ppt this is a representation of the printed 4-page
overview as a PowerPoint presentation. Please access before the tutorial, below.
2. CPD Outcomes Framework In Detail.ppt this is a representation of the CPD Outcomes
Framework as a PowerPoint presentation.
3. Case studies 1-11 as 11 separate PowerPoint files the cases and the respective answers
as PowerPoint presentations.
Videos (of the CPD Outcomes Framework Overview and Tutorial as well as suggested case study
answers) you will need to have a newer copy of Windows Media Player to access.
1. Duplicate of the above PowerPoint files containing audio recorded explanations.
Page 135
Page 136
Minor
Moderate
Major
Catastrophic
Likelihood:
The other dimension relating to risk is the predicted chance of occurrence, in this case of the
adverse outcome/consequence that you have identified above. This concept is known as
likelihood. What are the chances that the above consequence would occur if you didnt complete
this particular CPD? Look at the diagram below. How likely is it for the consequence to actually
happen if you did not complete this CPD activity? Would it be rare, almost certain or somewhere
in between? This is the concept for now; we will expand on it in the Tutorial:
How does likelihood contribute to a risk assessment of your CPD?
You should then rate the likelihood (of the consequence identified above) actually happening.
If you didnt conduct a particular CPD how likely is it for the predicted negative outcome to actually happen?
Increasing likelihood:
Rare
Unlikely
Possible
Likely
Almost certain
Linking consequence and likelihood to determine risk and therefore relevance of CPD to safe practice:
The dimensions consequence and likelihood are normally used to calculate risk using a table
similar to the one shown below. We think this table can be used to rate the relevance of the
CPD to your safe practice. The idea is that the more serious and likely the consequence of
failing to complete a particular CPD, the more relevant the CPD is to your safe practice.
How do consequence and likelihood contribute to a risk assessment of your CPD?
The point at which consequence and likelihood meet helps gauge relevance of CPD to safe practice
RELEVANCE
Likelihood (L)
Consequence (C)
Rare
Unlikely
Possible
Likely
Catastrophic
Major
Moderate
Minor
Negligible
University of Reading 2010
Increasing relevance
Almost certain
Increasing relevance
Look at the table below. Where is the point at which the consequence and likelihood grades
meet? Is it an area shaded green or red or somewhere in between? We think that a green square
represents a CPD that is relevant to safe practice, while red represents one that is not. This is the
concept for now; we will expand on it in the Tutorial:
Page 137
Standard 5 states: record how your CPD has contributed to the quality or development of your
practice and has benefited patients and the public.
Impact in relation to Standards of Proficiency
To demonstrate the impact of your CPD you will need to link it to genuine effects on your
practice. In other words, you should show that your CPD has resulted in an actual outcome that
is valuable to your specific scope of practice. In addition to the CPD standards, the GPhC has
also set out new Standards of Proficiency for Pharmacy Professionals. These standards are produced for
the safe and effective practice of pharmacists and pharmacy technicians. They are the minimum
standards necessary to protect members of the public. All pharmacy professionals in the future
must meet all of the Standards of Proficiency when first becoming registered. After that, pharmacy
professionals must continue to meet the Standards of Proficiency that apply to their specific scope
of practice. We believe that CPD records can also be used to demonstrate that the Standards of
Proficiency are being met. This is achievable by completing and recording CPD outcomes (impact)
with reference to the new GPhC Standards of Proficiency.
How can you relate Standards of Proficiency to your CPD?
You can start to rate the impact of a particular CPD by thinking about its effect on your scope of
practice and new Standards of Proficiency.
How would you assess the impact of your CPD on your practice?
There are two factors involved in calculating impact, namely quality and benefit brought to your
practice (and in relation to the Standards of Proficiency) and the strength of evidence you have in
order to confirm such an effect.
Quality and Benefit:
When judging the impact that a CPD has exerted on your practice, we are suggesting first that
you identify a Standard of Proficiency to which your CPD activity relates the most. We would then
ask you to rate the extent to which the CPD has contributed to the quality or development of
your practice and has benefited patients and the public in the context of this Standard of Proficiency
in short, you would be rating the quality and benefit of your CPD against Standard of Proficiency.
This will start to guide you in constructing and submitting CPD records that demonstrate real
impact on practice. Look at the diagram below. What impact has your CPD had on your
practice, in relation to a Standard of Proficiency? Is it negligible, substantial, or somewhere in
between? This is the concept for now; we will expand on it in the Tutorial:
Has your CPD contributed to the quality or development of your practice and benefited patients
and the public?
You can start to rate the impact of your CPD by first evaluating its contribution towards quality and
benefit of your practice, against one of the proficiency standards.
Can you assess the degree to which your CPD has contributed to the quality or development of your
practice and benefited patients and the public, against a Standard of Proficiency?
Increasing impact on quality and benefit:
Negligible
University of Reading 2010
Minor
Moderate
Major
Substantial
Page 138
Strength of evidence:
Standard 5 asserts the importance of demonstrating the quality and benefit of your CPD activity
and, above, we have related this concept to the Standards of Proficiency. For the purpose of
revalidation, we believe it is also important and necessary to provide evidence relating to the
impact of your CPD. Look at the diagram below. The evidence providing the lowest strength
relates to input (e.g. course attendance); the next level relates to evidence of your reaction to the
learning (e.g. your reflection); the next level relates to evidence of enhanced learning (e.g. formal
assessment); the next level relates to evidence of behaviour change on your part (e.g. through an
appraisal system); the final level relates to evidence of results (e.g. objectively measured
outcomes such as increased patient satisfaction). What is the extent to which you can
substantiate the impact of your CPD through evidence? Would it be evidence of input, or results
or somewhere in between? This is the concept for now; we will expand on it in the Tutorial:
What is the Strength of Evidence in relation to the impact of your CPD on your practice?
Grade the strength of evidence as the extent to which you can substantiate the quality and benefit
of your CPD through different types of evidence.
What is the extent to which you can substantiate the impact of your CPD through evidence?
Increasing Strength of Evidence:
Evidence of input
Evidence of
reaction
Evidence of
learning
Evidence of
behaviour change
Evidence of
results
Linking quality and benefit and strength of evidence to determine impact of CPD on your practice:
Look at the table below. Where is the point at which the Quality and Benefit and Strength of
Evidence grades meet? Is it an area shaded green or red or somewhere in between? We think
that a green square represents a CPD that is shown to have impacted on safe practice, while red
represents one that is not. This is the concept for now; we will expand on it in the Tutorial:
Strength of
evidence (E)
Results
Minor
Moderate
Major
Substantial
Behavior change
Learning
Reaction
Input
Increasing impact
IMPACT
Increasing impact
3. Using CPD Relevance and CPD Impact for ultimate grading of a CPD record
The aim of this CPD Outcomes Framework is to help you to create CPD records that demonstrate
relevance and positive impact on your practice. The final part of this CPD Outcomes Framework
involves the considering both the relevance and the impact of your CPD to derive an overall CPD
rating. This is the concept for now; we will expand on it in the Tutorial:
Page 139
Donyai,CPD
et al. 2010
The
for Revalidation in
Pharmacy Study
Page 140
Page 141
Page 142
Page 143
Page 144
Page 145
Page 146
Page 147
Page 148
Page 149
Page 150
Page 151
Standard 4 states: include in your record CPD that is relevant to safe and effective practice and
the Standards of Conduct, Ethics and Performance of the profession.
Determining the Relevance of the CPD to the pharmacy professionals safe practice
In relation to the concept of safe practice, we think it is possible for us to plan and conduct CPD that
is relevant to our safe practice of pharmacy. We believe this can be achieved by thinking about CPD in
a completely new way. Our idea is that the concept of risk can be used to work out the relevance of
a CPD to safe practice. Here we have to think about our practice in the absence of this CPD. What
would be the possible risk to our practice if we did not (or had not) conduct(ed) a particular CPD? This
question will start to guide us in constructing and submitting CPD records that demonstrate relevance
to our safe practice.
Minor
Moderate
Major
Catastrophic
Page 152
Rare
Unlikely
Possible
Likely
Almost certain
Frequency
This will
probably never
happen/recur
Do not expect it to
happen/recur but it is
possible it may do so
Might happen or
recur occasionally
Will probably
happen/recur but it is
not a persisting issue
Will undoubtedly
happen/recur, and
possibly frequently
RELEVANCE
Likelihood (L)
Consequence (C)
Rare
Unlikely
Possible
Likely
Catastrophic
Major
Moderate
Minor
Negligible
Almost certain
Increasing relevance
Look at the table below. Where is the point at which the consequence and likelihood grades meet? Is
it an area shaded green or red or somewhere in between? We think that a green square represents
a CPD that is significantly relevant to safe practice, while red represents one that is of low relevance.
Increasing relevance
Page 153
For grading risk, the colours obtained from the risk (relevance) matrix are assigned grades as follows:
Significant relevance
High relevance
Moderate relevance
Low relevance
Impact in relation to CPD and the practice of pharmacy
In addition to relevance to safe practice (dealt with above), standard 4 of the GPhCs CPD Standards and
Framework addresses the relevance of CPD to effective practice; and standard 5 addresses the actual
impact of a pharmacy professionals CPD on their practice. These concepts relate the CPD to tangible
positive effects on the pharmacy professionals practice.
Standard 4 states: include in your record CPD that is relevant to safe and effective practice
and the Standards of Conduct, Ethics and Performance of the profession.
Standard 5 states: record how your CPD has contributed to the quality or development of
your practice and has benefited patients and the public.
Impact in relation to Standards of Proficiency
To demonstrate the impact of your CPD you will need to link it to genuine effects on your practice. In
other words, you should show that your CPD has resulted in an actual outcome that is valuable to your
specific scope of practice. In addition to the CPD standards, the GPhC has also set out new Standards
of Proficiency for Pharmacy Professionals. These standards are produced for the safe and effective practice
of pharmacists and pharmacy technicians. They are the minimum standards necessary to protect
members of the public. All pharmacy professionals in the future must meet all of the Standards of
Proficiency when first becoming registered. After that, pharmacy professionals must continue to meet
the Standards of Proficiency that apply to their specific scope of practice. We believe that CPD records
can also be used to demonstrate that the Standards of Proficiency are being met. This is achievable by
completing and recording CPD outcomes (impact) with reference to the new GPhC Standards of
Proficiency.
Page 154
Has your CPD contributed to the quality or development of your practice and benefited
patients and the public?
You can start to rate the impact of your CPD by first evaluating its contribution of towards
quality and benefit of your practice, against one of the Standard of Proficiency.
Can you assess the degree to which the pharmacy professionals CPD has contributed to the quality or
development of their practice and benefited patients and the public, against a Standard of Proficiency?
Increasing impact on quality and benefit:
Negligible
Minor
Moderate
Major
Substantial
Examine the chart below and read the explanations provided under each grade heading. This will
help you decide on the level of impact this CPD has had on the pharmacy professionals practice. You
must do this in relation to a Standard of Proficiency:
Domain
Negligible
Minor
Moderate
Major
Substantial
No or minimal
impact on quality
of practice
Minor improvement
in quality of practice.
Moderate
improvement in
quality of practice.
Major improvement in
quality of practice.
Substantial
improvement in
quality of practice.
No or minimal
direct benefit to
patients and the
public
Minor benefit to
patients and the
public
Positive impact has
been on a minimal
number of patients
Moderate benefit to
patients and the
public
Positive impact has
been on a minor
number of patients
Major benefit to
patients and the
public
Substantial benefit to
patients and the
public
What is the extent to which you can substantiate the impact of your CPD through evidence?
Increasing Strength of Evidence:
Evidence of input
Evidence of
reaction
Evidence of
learning
Evidence of
behaviour change
Evidence of results
Access the more detailed table explaining these levels of evidence (pages 26 27).
STEP 6: Interact the quality and benefit and strength of evidence to determine the impact of the CPD on
practice
Look at the table on the next page. Where is the point at which the Quality and Benefit and
Strength of Evidence grades meet? Is it an area shaded green or red or somewhere in between?
We think that a green square represents a CPD that is shown to have impacted on safe practice, while
red represents one that is not.
Page 155
Strength of
evidence (E)
Results
Negligible
Minor
Moderate
Major
Substantial
Increasing impact
IMPACT
Behavior change
Learning
Reaction
Input
Increasing impact
For evaluating impact, the grades obtained from the impact matrix are indicated as follows:
High impact
Moderate impact
Low impact
Negligible impact
STEP 7: Use CPD Relevance and CPD Impact to grade the CPD record
The aim of this CPD Outcomes Framework is to help us create CPD records that demonstrate relevance to
and positive impact on our practice for the purpose of revalidation. The final part of this CPD Outcomes
Framework involves the considering both the relevance and the impact of a CPD to derive an overall CPD
rating.
Page 156
Domain 1
Negligible
Minor
Moderate
Major
Catastrophic
Minimal
injury
requiring
no/minimal
intervention
or treatment.
No time off
work
Minor
injury or
illness,
requiring
minor
intervention
Requiring
time off
work for <3
days
Increase in
length of
hospital stay
by 1-3 days
Moderate
injury requiring
professional
intervention
Requiring time
off work for 4-14
days
Increase in
length of
hospital stay by
4-15 days
RIDDOR/agency
reportable
incident
An event
which impacts
on a small
number of
patients
Major injury
leading to longterm
incapacity/disability
Requiring time
off work for >14
days
Increase in length
of hospital stay by
>15 days
Mismanagement
of patient care with
long-term effects
Incident leading
to death
Multiple
permanent
injuries or
irreversible
health effects
An event which
impacts on a
large number of
patients
Page 157
Domain 2
Negligible
Minor
Moderate
Major
Catastrophic
Quality/complaints/audit
Peripheral
element of
treatment or
service
suboptimal
Informal
complaint/inquiry
Overall
treatment or
service
suboptimal
Formal
complaint
(stage 1)
Local
resolution
Single
failure to
meet internal
standards
Minor
implications
for patient
safety if
unresolved
Reduced
performance
rating if
unresolved
Treatment or
service has
significantly
reduced
effectiveness
Formal
complaint
(stage 2)
Local
resolution
(with potential
to go to
independent
review)
Repeated
failure to meet
internal
standards
Moderate
patient safety
implications if
findings are
not acted on
Noncompliance
with national
standards with
significant risk
to patients if
unresolved
Multiple
complaints/
independent
review
Low
performance
rating
Critical
report
Totally
unacceptable level
or quality of
treatment/service
Gross failure of
patient safety if
findings not acted
on
Inquest/ombuds
man inquiry
Gross failure to
meet national
standards
Page 158
Domain 3
Negligible
Minor
Moderate
Major
Catastrophic
Human resources/
organisational
development/staffing/
competence
Short-term
low staffing
level that
temporarily
reduces
service
quality (< 1
day)
Low staffing
level that
reduces the
service quality
Late delivery
of key objective/
service due to
lack of staff
Unsafe staffing
level or
competence (>1
day)
Low staff
morale
Poor staff
attendance for
mandatory/key
training
Uncertain
delivery of key
objective/service
due to lack of
staff
Unsafe staffing
level or
competence (>5
days)
Loss of key
staff
Very low staff
morale
No staff
attending
mandatory/ key
training
Non-delivery of key
objective/service due
to lack of staff
Ongoing unsafe
staffing levels or
competence
Loss of several key
staff
No staff attending
mandatory training
/key training on an
ongoing basis
Page 159
Domain 4
Negligible
Minor
Moderate
Major
Catastrophic
Statutory duty/
inspections
No or
minimal
impact or
breach of
guidance/
statutory
duty
Breach of
statutory
legislation
Reduced
performance
rating if
unresolved
Single breach in
statutory duty
Challenging
external
recommendations/
improvement
notice
Enforcement
action
Many
breaches in
statutory duty
Improvement
notices
Low
performance
rating
Critical report
Multiple breaches
in statutory duty
Prosecution
Complete systems
change required
Zero performance
rating
Severely critical
report
Page 160
Domain 5
Negligible
Minor
Moderate
Major
Catastrophic
Adverse publicity/
reputation
Rumours
Potential for
public
concern
Local media
coverage
short-term
reduction in
public
confidence
Elements of
public
expectation not
being met
Local media
coverage
long-term
reduction in
public
confidence
National
media coverage
with <3 days
service well
below
reasonable
public
expectation
National media
coverage with >3
days service well
below reasonable
public expectation.
MP concerned
(questions in the
House)
Total loss of public
confidence
Page 161
Domain 6
Negligible
Minor
Moderate
Major
Catastrophic
Business objectives/
projects
Insignificant cost
increase/ schedule
slippage
510 per
cent over
project budget
Moderate
schedule
slippage
Noncompliance
with national
1025 per cent
over project
budget
Major
schedule
slippage
A number of
key objectives
not met
Incident leading
>25 per cent over
project budget
Schedule slippage
Many key
objectives not met
Page 162
Negligible
Minor
Moderate
Major
Catastrophic
Finance including
claims
Small loss /
Risk of claim
remote
Loss of 0.1
0.25 per cent of
budget
Claim(s) less
than 10,000
Loss of 0.25
0.5 per cent of
budget
Claim(s)
between
10,000 and
100,000
Uncertain
delivery of key
objective/Loss of
0.51.0 per cent
of budget
Claim(s)
between
100,000 and 1
million
Purchasers
failing to pay on
time
Non-delivery of key
objective/ Loss of
>1.0 per cent of
budget
Failure to meet
specification/
slippage
Loss of contract /
payment by results
Claim(s) >1
million
Page 163
Negligible
Minor
Moderate
Major
Catastrophic
Service/business
interruption
&Environmental
impact
Loss/interruption
of <8 hours
Minimal or no
impact on the
environment
Loss/interruption
of 8 hours 1 day
Minor impact
on environment
Loss/interruption
of 1 day 1 week
Moderate impact
on environment
Loss/interruption
of >1 week
Major impact on
environment
Permanent
loss of service
or facility
Catastrophic
impact on
environment
Page 164
Descriptors
Evidence of input
Evidence of reaction
Evidence of learning
Evidence of
behaviour change
Evidence of results
Evidence of learning
Evidence of
behaviour change
Evidence of results
Evaluation of
Formal assessment and exam scores
courses/conferences attended
Case studies
Wednesday 15 December 2010 Page 165
Documentation arising
from appraisal
Objective statistical
benchmarking
Page 166
Documentation arising
from clinical supervision
Job evaluation
Compliance with locallyimplemented competence
frameworks.
Testimonies
Letters from users, carers,
students or colleagues
Patient assessment
Peer assessment
Objective measurement of a
variety of effect and outcomes
RELEVANCE
Likelihood (L)
Consequence (C)
Rare
Unlikely
Possible
Likely
Almost certain
Catastrophic
Major
Moderate
Minor
Negligible
Increasing relevance
Linking consequence and likelihood to determine risk and therefore relevance of CPD to safe
practice:
Increasing relevance
Linking quality and benefit and strength of evidence to determine impact of CPD on practice:
Strength of
evidence (E)
Results
Minor
Moderate
Major
Substantial
Behavior change
Learning
Reaction
Input
Increasing impact
Page 167
Increasing impact
IMPACT
Date completed
Page 168
The
CPD
for Revalidation in
Donyai,
et al. 2010
Pharmacy Study
Page 169
Minor
Moderate
Major
Catastrophic
Rare
Unlikely
Possible
Likely
Almost certain
Frequency
Do not expect it to
happen/recur but it
is possible it may
do so
Might happen or
recur occasionally
Will probably
happen/recur but it
is not a persisting
issue
Will undoubtedly
happen/recur, and
possibly frequently
RELEVANCE
Likelihood (L)
Consequence (C)
Rare
Unlikely
Possible
Likely
Catastrophic
Major
Moderate
Minor
Negligible
Almost certain
Increasing relevance
STEP 3: Linking consequence and likelihood to determine risk thus relevance of CPD to safe practice:
Where is the point at which the consequence and likelihood grades meet? Is it an area shaded green
or red or somewhere in between? We think that a green square represents a CPD that is
significantly relevant to safe practice, while red represents one that is of low relevance.
Increasing relevance
University of Reading 2010
Page 170
Minor
Moderate
Major
Substantial
Evidence of
reaction
Evidence of
learning
Evidence of
behaviour change
Evidence of results
STEP 6: Interact the quality and benefit and strength of evidence to determine the impact of the CPD on
practice
Where is the point at which the Quality and Benefit and Strength of Evidence grades meet? Is it an
area shaded green or red or somewhere in between? We think that a green square represents a
CPD that is shown to have impacted on safe practice, while red represents one that is not.
Strength of
evidence (E)
Results
Minor
Moderate
Major
Substantial
Increasing impact
IMPACT
Behavior change
Learning
Reaction
Input
Increasing impact
STEP 7: Use CPD Relevance and CPD Impact to grade the CPD record
Consider both the relevance and the impact of a CPD to derive an overall CPD rating. The final rating of
a CPD record is determined by both the relevance and impact grades. In this instance, there is an
orange grading for relevance and a red grading for impact. We recommend Simon attempts to
improve his CPDs rating in each of these domains to such an extent that at least one green or
yellow cell is achieved for each of relevance and impact scores and that no red rating is achieved. If
this is not achievable, we would advise Simon considers whether this particular CPD record is good
enough for inclusion in his revalidation portfolio.
Page 171
Minor
Moderate
Major
Catastrophic
Rare
Unlikely
Possible
Likely
Almost certain
Frequency
Do not expect it to
happen/recur but it is
possible it may do so
Might happen or
recur occasionally
Will probably
happen/recur but it is
not a persisting issue
Will undoubtedly
happen/recur, and
possibly frequently
RELEVANCE
Likelihood (L)
Consequence (C)
Rare
Unlikely
Possible
Likely
Catastrophic
Major
Moderate
Minor
Negligible
University of Reading 2010
Increasing relevance
Almost certain
Increasing relevance
STEP 3: Linking consequence and likelihood to determine risk thus relevance of CPD to safe practice:
Where is the point at which the consequence and likelihood grades meet? Is it an area shaded green
or red or somewhere in between? We think that a green square represents a CPD that is
significantly relevant to safe practice, while red represents one that is of low relevance.
Page 172
1.15.4 Learns from and reviews their working practices in the light of feedback, complaints or criticism.
2.5.1 Plans and implements personal development strategies to improve current and future performance
2.5.4 Creates, maintains and enhances working relationships with others in relation to the science of medicines
and their use, the practice of pharmacy and the provision of health care
STEP 4: Grade quality and benefit of the CPD record.
To what extent has the CPD contributed to the quality or development of Shelleys practice and has
benefited patients and the public in the context of one of the Standards of Proficiency above? We think
that in the current situation, the learning has had a moderate level of impact on improving the
quality and benefit of Shelleys practice. She has after all noted an improvement to her practice
through increased confidence.
Increasing impact on quality and benefit:
Negligible
Minor
Moderate
Major
Substantial
Evidence of
reaction
Evidence of
learning
Evidence of
behaviour change
Evidence of results
STEP 6: Interact the quality and benefit and strength of evidence to determine the impact of the CPD on
practice
Where is the point at which the Quality and Benefit and Strength of Evidence grades meet? Is it an
area shaded green or red or somewhere in between? We think that a green square represents a
CPD that is shown to have impacted on safe practice, while red represents one that is not.
Strength of
evidence (E)
Results
Behaviour change
Learning
Minor
Moderate
Major
Substantial
Increasing impact
IMPACT
Reaction
Input
Increasing impact
STEP 7: Use CPD Relevance and CPD Impact to grade the CPD record
Consider both the relevance and the impact of a CPD to derive an overall CPD rating. The final rating of
a CPD record is determined by both the relevance and impact grades. In this instance, there is a
yellow grading for relevance and a yellow grading for impact. We consider Shelleys CPD rating is
likely to be good enough for the purpose of revalidation and would recommend that she includes this
record as part of her revalidation portfolio.
Page 173
Minor
Moderate
Major
Catastrophic
Rare
Unlikely
Possible
Likely
Almost certain
Frequency
Do not expect it to
happen/recur but it
is possible it may
do so
Might happen or
recur occasionally
Will probably
happen/recur but it
is not a persisting
issue
Will undoubtedly
happen/recur, and
possibly frequently
RELEVANCE
Likelihood (L)
Consequence (C)
Catastrophic
Rare
Unlikely
Possible
Likely
Major
Moderate
Minor
Negligible
Almost certain
Increasing relevance
STEP 3: Linking consequence and likelihood to determine risk thus relevance of CPD to safe practice:
Where is the point at which the consequence and likelihood grades meet? Is it an area shaded green
or red or somewhere in between? We think that a green square represents a CPD that is
significantly relevant to safe practice, while red represents one that is of low relevance.
Increasing relevance
Page 174
Minor
Moderate
Major
Substantial
Evidence of
reaction
Evidence of
learning
Evidence of
behaviour change
Evidence of results
STEP 6: Interact the quality and benefit and strength of evidence to determine the impact of the CPD on
practice
Where is the point at which the Quality and Benefit and Strength of Evidence grades meet? Is it an
area shaded green or red or somewhere in between? We think that a green square represents a
CPD that is shown to have impacted on safe practice, while red represents one that is not.
Strength of
evidence (E)
Results
Minor
Moderate
Major
Substantial
Increasing impact
IMPACT
Behaviour change
Learning
Reaction
Input
Increasing impact
STEP 7: Use CPD Relevance and CPD Impact to grade the CPD record
Consider both the relevance and the impact of a CPD to derive an overall CPD rating. The final rating of
a CPD record is determined by both the relevance and impact grades. In this instance, there is a
yellow grading for relevance and a yellow grading for impact. We consider Monicas CPD rating is
good enough for the purpose of revalidation and would recommend that she includes this record as
part of her revalidation portfolio.
Page 175
Minor
Moderate
Major
Catastrophic
Rare
Unlikely
Possible
Likely
Almost certain
Frequency
Do not expect it to
happen/recur but it
is possible it may
do so
Might happen or
recur occasionally
Will probably
happen/recur but it
is not a persisting
issue
Will undoubtedly
happen/recur, and
possibly frequently
RELEVANCE
Likelihood (L)
Consequence (C)
Rare
Unlikely
Possible
Likely
Catastrophic
Major
Moderate
Minor
Negligible
University of Reading 2010
Increasing relevance
Almost certain
Increasing relevance
STEP 3: Linking consequence and likelihood to determine risk thus relevance of CPD to safe practice:
Where is the point at which the consequence and likelihood grades meet? Is it an area shaded green
or red or somewhere in between? We think that a green square represents a CPD that is
significantly relevant to safe practice, while red represents one that is of low relevance.
Page 176
Minor
Moderate
Major
Substantial
Evidence of
reaction
Evidence of
learning
Evidence of
behaviour change
Evidence of results
STEP 6: Interact the quality and benefit and strength of evidence to determine the impact of the CPD on
practice
Where is the point at which the Quality and Benefit and Strength of Evidence grades meet? Is it an
area shaded green or red or somewhere in between? We think that a green square represents a
CPD that is shown to have impacted on safe practice, while red represents one that is not.
Strength of
evidence (E)
Results
Minor
Moderate
Major
Substantial
Increasing impact
IMPACT
Behaviour change
Learning
Reaction
Input
Increasing impact
STEP 7: Use CPD Relevance and CPD Impact to grade the CPD record
Consider both the relevance and the impact of a CPD to derive an overall CPD rating. The final rating of
a CPD record is determined by both the relevance and impact grades. In this instance, there is a
yellow grading for relevance and a yellow grading for impact. We consider Johns CPD rating is
good enough for the purpose of revalidation and would recommend that he includes this record as
part of his revalidation portfolio.
Page 177
Minor
Moderate
Major
Catastrophic
Rare
Unlikely
Possible
Likely
Almost certain
Frequency
Do not expect it to
happen/recur but it is
possible it may do so
Will undoubtedly
happen/recur, and
possibly frequently
RELEVANCE
Likelihood (L)
Consequence (C)
Catastrophic
Rare
Unlikely
Possible
Likely
Major
Moderate
Minor
Negligible
University of Reading 2010
Increasing relevance
Almost certain
Increasing relevance
STEP 3: Linking consequence and likelihood to determine risk thus relevance of CPD to safe practice:
Where is the point at which the consequence and likelihood grades meet? Is it an area shaded green
or red or somewhere in between? We think that a green square represents a CPD that is
significantly relevant to safe practice, while red represents one that is of low relevance.
Page 178
1.8.2 Shares their skills, knowledge and experience; contributes to the development and training of others.
2.5.2 Understands the need to play an active role in the pharmacy-based and multi-disciplinary systematic
monitoring and review of the quality of service provision and the implementation of service improvement
measures.
2.5.3 Engages with the education, training and mentoring of students, colleagues and healthcare professionals.
STEP 4: Grade quality and benefit of the CPD record.
To what extent has the CPD contributed to the quality or development of Khalids practice and has
benefited patients and the public in the context of one of the Standards of Proficiency above? We think
that in the current situation, the learning has had a major level of impact on improving the quality
and benefit of Khalids practice. He has produced a useful audit report that was well received by his
colleagues.
Increasing impact on quality and benefit:
Negligible
Minor
Moderate
Major
Substantial
Evidence of
reaction
Evidence of
learning
Evidence of
behaviour change
Evidence of results
STEP 6: Interact the quality and benefit and strength of evidence to determine the impact of the CPD on
practice
Where is the point at which the Quality and Benefit and Strength of Evidence grades meet? Is it an
area shaded green or red or somewhere in between? We think that a green square represents a
CPD that is shown to have impacted on safe practice, while red represents one that is not.
Strength of
evidence (E)
Results
Minor
Moderate
Major
Substantial
Behaviour change
Learning
Reaction
Input
Increasing impact
IMPACT
Increasing impact
STEP 7: Use CPD Relevance and CPD Impact to grade the CPD record
Consider both the relevance and the impact of a CPD to derive an overall CPD rating. The final rating of
a CPD record is determined by both the relevance and impact grades. In this instance, there is a
green grading for relevance and a green grading for impact. We consider Khalids CPD rating is
definitely good enough for the purpose of revalidation and would recommend that he includes this
record as part of his revalidation portfolio.
Page 179
Minor
Moderate
Major
Catastrophic
Rare
Unlikely
Possible
Likely
Almost certain
Frequency
Do not expect it to
happen/recur but it is
possible it may do so
Will undoubtedly
happen/recur, and
possibly frequently
RELEVANCE
Likelihood (L)
Consequence (C)
Catastrophic
Rare
Unlikely
Possible
Likely
Major
Moderate
Minor
Negligible
Almost certain
Increasing relevance
STEP 3: Linking consequence and likelihood to determine risk thus relevance of CPD to safe practice:
Where is the point at which the consequence and likelihood grades meet? Is it an area shaded green
or red or somewhere in between? We think that a green square represents a CPD that is
significantly relevant to safe practice, while red represents one that is of low relevance.
Increasing relevance
University of Reading 2010
Page 180
Minor
Moderate
Major
Substantial
Evidence of
reaction
Evidence of
learning
Evidence of
behaviour change
Evidence of results
STEP 6: Interact the quality and benefit and strength of evidence to determine the impact of the CPD on
practice
Where is the point at which the Quality and Benefit and Strength of Evidence grades meet? Is it an
area shaded green or red or somewhere in between? We think that a green square represents a
CPD that is shown to have impacted on safe practice, while red represents one that is not.
Strength of
evidence (E)
Results
Behaviour change
Learning
Minor
Moderate
Major
Substantial
Reaction
Input
Increasing impact
IMPACT
Increasing impact
STEP 7: Use CPD Relevance and CPD Impact to grade the CPD record
Consider both the relevance and the impact of a CPD to derive an overall CPD rating. The final rating of
a CPD record is determined by both the relevance and impact grades. In this instance, there is a
green grading for relevance but orange for impact. We consider Farzanas CPD rating is not yet good
enough for the purpose of revalidation and would recommend that she waits longer before including
this CPD record for revalidation.
Page 181
Minor
Moderate
Major
Catastrophic
Rare
Unlikely
Possible
Likely
Almost certain
Frequency
Do not expect it to
happen/recur but it is
possible it may do so
Will undoubtedly
happen/recur, and
possibly frequently
RELEVANCE
Likelihood (L)
Consequence (C)
Rare
Unlikely
Possible
Likely
Catastrophic
Major
Moderate
Minor
Negligible
Almost certain
Increasing relevance
STEP 3: Linking consequence and likelihood to determine risk thus relevance of CPD to safe practice:
Where is the point at which the consequence and likelihood grades meet? Is it an area shaded green
or red or somewhere in between? We think that a green square represents a CPD that is
significantly relevant to safe practice, while red represents one that is of low relevance.
Increasing relevance
Page 182
Minor
Moderate
Major
Substantial
Evidence of
reaction
Evidence of
learning
Evidence of
behaviour change
Evidence of results
STEP 6: Interact the quality and benefit and strength of evidence to determine the impact of the CPD on
practice
Where is the point at which the Quality and Benefit and Strength of Evidence grades meet? Is it an
area shaded green or red or somewhere in between? We think that a green square represents a
CPD that is shown to have impacted on safe practice, while red represents one that is not.
Strength of
evidence (E)
Results
Minor
Moderate
Major
Substantial
Behaviour change
Learning
Reaction
Input
Increasing impact
IMPACT
Increasing impact
STEP 7: Use CPD Relevance and CPD Impact to grade the CPD record
Consider both the relevance and the impact of a CPD to derive an overall CPD rating. The final rating of
a CPD record is determined by both the relevance and impact grades. In this instance, there is an
orange grading for relevance and a red grading for impact. We consider Costass CPD rating is not
yet good enough for the purpose of revalidation and recommend that he waits longer before including
this CPD record for revalidation.
University of Reading 2010
Page 183
Minor
Moderate
Major
Catastrophic
Rare
Unlikely
Possible
Likely
Almost certain
Frequency
Do not expect it to
happen/recur but it is
possible it may do so
Will undoubtedly
happen/recur, and
possibly frequently
RELEVANCE
Likelihood (L)
Consequence (C)
Catastrophic
Rare
Unlikely
Possible
Likely
Major
Moderate
Minor
Negligible
University of Reading 2010
Increasing relevance
Almost certain
Increasing relevance
STEP 3: Linking consequence and likelihood to determine risk thus relevance of CPD to safe practice:
Where is the point at which the consequence and likelihood grades meet? Is it an area shaded green
or red or somewhere in between? We think that a green square represents a CPD that is
significantly relevant to safe practice, while red represents one that is of low relevance.
Page 184
Minor
Moderate
Major
Substantial
Evidence of
reaction
Evidence of
learning
Evidence of
behaviour change
Evidence of results
STEP 6: Interact the quality and benefit and strength of evidence to determine the impact of the CPD on
practice
Where is the point at which the Quality and Benefit and Strength of Evidence grades meet? Is it an
area shaded green or red or somewhere in between? We think that a green square represents a
CPD that is shown to have impacted on safe practice, while red represents one that is not.
Strength of
evidence (E)
Results
Behaviour change
Learning
Minor
Moderate
Major
Substantial
Reaction
Input
Increasing impact
IMPACT
Increasing impact
STEP 7: Use CPD Relevance and CPD Impact to grade the CPD record
Consider both the relevance and the impact of a CPD to derive an overall CPD rating. The final rating of
a CPD record is determined by both the relevance and impact grades. In this instance, there is a
yellow grading for relevance and a yellow grading for impact. We consider Tailens CPD rating is
good enough for the purpose of revalidation and would recommend that she includes this record as
part of her revalidation portfolio.
Page 185
Minor
Moderate
Major
Catastrophic
Rare
Unlikely
Possible
Likely
Almost certain
Frequency
Do not expect it to
happen/recur but it is
possible it may do so
Will undoubtedly
happen/recur, and
possibly frequently
RELEVANCE
Likelihood (L)
Consequence (C)
Catastrophic
Rare
Unlikely
Possible
Likely
Major
Moderate
Minor
Negligible
Almost certain
Increasing relevance
STEP 3: Linking consequence and likelihood to determine risk thus relevance of CPD to safe practice:
Where is the point at which the consequence and likelihood grades meet? Is it an area shaded green
or red or somewhere in between? We think that a green square represents a CPD that is
significantly relevant to safe practice, while red represents one that is of low relevance.
Increasing relevance
Page 186
Minor
Moderate
Major
Substantial
Evidence of
reaction
Evidence of
learning
Evidence of
behaviour change
Evidence of results
STEP 6: Interact the quality and benefit and strength of evidence to determine the impact of the CPD on
practice
Where is the point at which the Quality and Benefit and Strength of Evidence grades meet? Is it an
area shaded green or red or somewhere in between? We think that a green square represents a
CPD that is shown to have impacted on safe practice, while red represents one that is not.
Strength of
evidence (E)
Results
Minor
Moderate
Major
Substantial
Behaviour change
Learning
Reaction
Input
Increasing impact
IMPACT
Increasing impact
STEP 7: Use CPD Relevance and CPD Impact to grade the CPD record
Consider both the relevance and the impact of a CPD to derive an overall CPD rating. The final rating of
a CPD record is determined by both the relevance and impact grades. In this instance, there is a
green grading for relevance but a red grading for impact. We consider Janes CPD is not yet ready
for the purpose of revalidation and would recommend that she collects evidence of impact for
revalidation purposes.
University of Reading 2010
Page 187
Minor
Moderate
Major
Catastrophic
Rare
Unlikely
Possible
Likely
Almost certain
Frequency
Do not expect it to
happen/recur but it is
possible it may do so
Will undoubtedly
happen/recur, and
possibly frequently
RELEVANCE
Likelihood (L)
Consequence (C)
Rare
Unlikely
Possible
Likely
Catastrophic
Major
Moderate
Minor
Negligible
University of Reading 2010
Increasing relevance
Almost certain
Increasing relevance
STEP 3: Linking consequence and likelihood to determine risk thus relevance of CPD to safe practice:
Where is the point at which the consequence and likelihood grades meet? Is it an area shaded green
or red or somewhere in between? We think that a green square represents a CPD that is
significantly relevant to safe practice, while red represents one that is of low relevance.
Page 188
Minor
Moderate
Major
Substantial
Evidence of
reaction
Evidence of
learning
Evidence of
behaviour change
Evidence of results
STEP 6: Interact the quality and benefit and strength of evidence to determine the impact of the CPD on
practice
Where is the point at which the Quality and Benefit and Strength of Evidence grades meet? Is it an
area shaded green or red or somewhere in between? We think that a green square represents a
CPD that is shown to have impacted on safe practice, while red represents one that is not.
Strength of
evidence (E)
Results
Behaviour change
Learning
Minor
Moderate
Major
Substantial
Reaction
Input
Increasing impact
IMPACT
Increasing impact
STEP 7: Use CPD Relevance and CPD Impact to grade the CPD record
Consider both the relevance and the impact of a CPD to derive an overall CPD rating. The final rating of
a CPD record is determined by both the relevance and impact grades. In this instance, there is a green
grading for relevance and a yellow grading for impact. We consider Margarets CPD rating is
definitely good enough for the purpose of revalidation and would recommend that she includes this
record as part of her revalidation portfolio when she returns to the UK.
Page 189
Minor
Moderate
Major
Catastrophic
Rare
Unlikely
Possible
Likely
Almost certain
Frequency
Do not expect it to
happen/recur but it
is possible it may do
so
Might happen or
recur occasionally
Will probably
happen/recur but it is not
a persisting issue
Will undoubtedly
happen/recur, and possibly
frequently
RELEVANCE
Likelihood (L)
Consequence (C)
Rare
Unlikely
Possible
Likely
Catastrophic
Major
Moderate
Minor
Negligible
Almost certain
Increasing relevance
STEP 3: Linking consequence and likelihood to determine risk thus relevance of CPD to safe practice:
Where is the point at which the consequence and likelihood grades meet? Is it an area shaded green
or red or somewhere in between? We think that a green square represents a CPD that is
significantly relevant to safe practice, while red represents one that is of low relevance.
Increasing relevance
Page 190
Minor
Moderate
Major
Substantial
Evidence of
reaction
Evidence of
learning
Evidence of
behaviour change
Evidence of results
STEP 6: Interact the quality and benefit and strength of evidence to determine the impact of the CPD on
practice
Where is the point at which the Quality and Benefit and Strength of Evidence grades meet? Is it an
area shaded green or red or somewhere in between? We think that a green square represents a
CPD that is shown to have impacted on safe practice, while red represents one that is not.
Strength of
evidence (E)
Results
Behaviour change
Learning
Minor
Moderate
Major
Substantial
Reaction
Input
Increasing impact
IMPACT
Increasing impact
STEP 7: Use CPD Relevance and CPD Impact to grade the CPD record
Consider both the relevance and the impact of a CPD to derive an overall CPD rating. The final rating of
a CPD record is determined by both the relevance and impact grades. In this instance, there is a
yellow grading for relevance and an orange grading for impact. We consider Bens CPD rating is
unlikely to be sufficient for the purpose of revalidation at this stage and would recommend he waits a
little longer or expands on his learning before include this record as part of his revalidation portfolio.
Page 191
Appendix 13
The printed material sent to the control group
Page 192
p.donyai@reading.ac.uk
Dr Parastou Donyai
On behalf of the research team:
Dr Parastou Donyai
BPharm PGDPRM(Open)
PGCert LTHE MRPharmS
Principal Investigator
Dr Angela Alexander
BPharm MSc
FRPharmS MCPP MBE
Co-investigator
Rebecca Z Herbert
BA MSc
Research Assistant
Page 193
Donyai,for
et al.Revalidation
2010
The CPD
in
Pharmacy Study
Please feel free to use this as a checklist to ensure you have accessed all the enclosed documents.
Cover letter
List of materials enclosed (this list)
Updated schedule for the project
What to do next
The GPhC Standards of Proficiency for Pharmacy Professionals
The GPhC Continuing Professional Development Standards and Framework
Statement of learning (and stamped-addressed envelope)
Page 194
Donyai,for
et al.Revalidation
2010
The CPD
in
Pharmacy Study
What to do next?
This is the second phase of the study. We are asking you to kindly:
1. Read the GPhC Standards of Proficiency for Pharmacy Professionals and the GPhC Continuing
Professional Development Standards and Framework enclosed.
2. Sign and return the statement of learning to indicate that you have read and understood the GPhC
standards (this will help us with our Quality Assurance processes).
3. Assess your already-submitted CPD record(s) in light of the two GPhC standards. Ask yourself
what changes you could make to your record(s) having read the new standards.
4. New CPD Record 1: Select one your already-submitted CPD records and write it again so that you
match the record to the two GPhC standards. You could create a new entry for this purpose. You
are in effect being asked to interpret the GPhC standards and see if you can rewrite one of
your CPD records previously submitted to this project, in a way that might better match the
expectations in the new standards. This activity will produce the first of the new CPD entries
we are asking you to submit by the end of February 2010. You can select to rewrite any one of the
following CPD records you have already submitted:
Title of the CPD record you have already submitted*
Date completed
*Please note we were able to accept a maximum of 3 CPD records from each participant, so if you
submitted more than 3 records in phase one of the study, please note that we have accepted only the first 3
records for inclusion in the study.
5. New CPD Record 2: Record a completely new CPD record after completing the steps above. This
may involve you in conducting a whole new CPD activity or you may decide to create a new
record based on an activity you have been conducting. Again, this new CPD record should be
matched as much as possible to the new standards. This will form the second of the new CPD
entries we are asking you to submit by the end of February 2010.
6. Submit the two new CPD records to me by the end of February 2010 using one of the options
previously outlined (postal or electronic as before). If you find it easier, you may wish to print and
use the stamped-addressed envelope to send in the records together with your statement of
learning.
Thank you for your continued support and commitment to the development of CPD for our
profession.
Page 195
Donyai,
et al.
2010
The CPD
for
Revalidation
in
Pharmacy Study
to
November December
Enrolment
Submission of initial CPD record(s)
Receipt of
revalidationspecific
instructions
namely, two new
General
Pharmaceutical
Council
standards
January/February March/April
Reading the GPhC
standards, and
submitting two
new CPD records
one rewritten
and one
conducted afresh.
Returning the
statement of
learning.
Optional focus
group interviews
Debriefing about
the study
including
feedback about
your CPD
records
CPD-RPS timeline: this table illustrates the main aspects of the study as relate to time
Page 196
Statement of learning
The two new General Pharmaceutical Council standards were sent to you in order that you read and
understand these before writing your two new CPD records (1 rewritten record and 1 completely new CPD
record).
With this statement, we are asking you to confirm that you have read and understood these GPhC standards
before submitting your two new CPD records.
I have read and understood GPhC Standards of Proficiency for Pharmacy Professionals
and the GPhC Continuing Professional
Development Standards and Framework.
If you have done the above, please sign this statement of learning and post it back to us in the stampedaddressed envelope provided in the pack.
Thank you. This will help us with our quality assurance processes.
Participant number:
Signed:
Date:
Page 197
Appendix 14
Template used for scoring the CPD entries
Page 198
RELEVANCE
Likelihood (L)
Consequence (C)
Rare
(1)
Unlikely
(2)
Possible
(3)
Likely
(4)
Almost certain
(5)
Catastrophic (5)
Major (4)
Moderate (3)
Minor (2)
Negligible (1)
Increasing relevance
Linking consequence and likelihood to determine risk and therefore relevance of CPD to safe
practice:
Increasing relevance
Linking quality and benefit and strength of evidence to determine impact of CPD on practice:
Strength of
evidence (E)
Results
Minor
Moderate
Major
Substantial
Behavior change
Learning
Reaction
Input
Increasing impact
Page 199
Increasing impact
IMPACT
Appendix 15
Scoring by two pharmacist raters
All CPD records were anonymised, pooled and assessed independently by two of the
pharmacist investigators (PD and AMA) blinded to the study stage and intervention type (i.e.
no obvious information to relate entries to each other or to stage of study remained on the
copies assessed). The raters independently scored the entries against the CPD Outcomes
Framework (see Appendix 14 for a copy of the assessment template used in order to grade
the entries).
Initially, the two raters (labelled Pharmacist1 and Pharmacist 2 for the sake of the analyses)
independently scored a total of 56 CPD entries using the CPD Outcomes Framework to
generate values for each of the variables consequence (C) and likelihood (L), resulting in
the relevance (R) score (R = C x L), and quality and benefit (Qb) and strength of evidence
(E), resulting in the impact (I) score (I = Qb + E), for each entry. The product of R and I
scores resulted in the CPD score (CPD-S = R x I). The entries included a range of before and
after data from both control and intervention groups, although as explained, at the time of
scoring both raters were blind to this information.
Data were entered onto the software package SPSS and explored for a number of
relationships detailed below. From these analyses it was possible to demonstrate that in fact
consensus agreement was equal to averaging the score assigned by each pharmacist rater.
The final Pharmacist1 CPD scores and the Pharmacist2 CPD scores correlated with each other
(r = 0.563) and this correlation was found to be statistically significant (p<0.005). The exact
nature of the relationship between the Pharmacist1 CPD scores and the Pharmacist2 CPD
scores was demonstrated in the regression equation: Pharmacist1 CPD score = 12.219 +
(Pharmacist2 CPD scores x 0.765).
Although they correlated with each other, there was a statistically significant difference in
Pharmacist1 CPD scores vs. Pharmacist2 CPD scores. Using a paired samples t-test, it was
possible to test for the amount of variation between the Pharmacist1 CPD score and
Pharmacist2 CPD score (i.e. the difference between the means for each condition) compared
with the amount of variation within each condition (i.e. the standard deviation for each
condition). The effect size (d) was calculated using d = (Mean P1 - Mean P2) / Mean SD,
where Mean SD = (SD P1 + SD P2) / 2. This analysis revealed the difference between the
samples to be statistically significant (t(55) = 5.11, p<0.005, d = 0.664). Taken together with
an examination of the descriptive statistics, this analysis showed that Pharmacist1 CPD scores
were generally higher than CPD scores awarded by Pharmacist2.
Prior to the above analyses, the investigators (PD and AMA) met face-to-face to examine each
others ratings for each of the 56 CPD records. Because of apparent differences between the
first and the second pharmacists CPD scores, for the purpose of this study, a set of mutuallyagreed scores were generated in that meeting by a process of negotiation. Therefore, during
that face-to-face meeting each CPD entry and each of its individual ratings were considered
and discussed in detail before consensus was reached between the two pharmacist raters on
the value to be assigned to each of the variables of consequence, likelihood, quality and
benefit and strength of evidence for that entry. The final agreed CPD score was calculated
from the individually-agreed values. All cases were considered and agreement was reached
on all the cases without the need to resort to a third opinion.
From these data it was possible to demonstrate that in fact consensus agreement was equal to
averaging the score assigned by each pharmacist rater, as follows.
Page 200
Multiple linear regression was carried out using the Pharmacist1 CPD scores and the
Pharmacist2 CPD scores as independent predictors of the agreed CPD score:
= 0.499;
p<0.005 and
= 0.517; p<0.005; i.e. the correlation of Pharmacist1 CPD scores and
Pharmacist2 CPD scores with the agreed CPD score was also statistically significant to
p<0.005. The regression yielded a correlation coefficient r = 0.899; p<0.005 higher than
either of the Pharmacist scores alone. The regression equation for the agreed CPD scores was
calculated as agreed CPD score = 1.477 + (Pharmacist1 CPD score x 0.469) + (Pharmacist2
CPD score x 0.661).
Then a fourth set of data predicted agreed CPD score was generated using the above
equation. And finally a fifth dataset was generated by simply averaging the final Pharmacist1
and Pharmacist2 CPD scores. A correlation matrix for all the variables was produced.
The simple average score (fifth dataset) correlated highly both with the predicted agreed CPD
score (generated using the equation) (r = 0.996; p<0.005) and the actual agreed CPD score (r =
0.895; p<0.005). In fact, using simple linear regression again to predict the agreed CPD score
using the average CPD score, it was possible to calculate a regression equation as: agreed
CPD score = 0.297 + (1.093 x average score). With a slope of nearly one and an intercept near
to zero, meaning that for any given CPD the average score and the agreed CPD score would
be very similar.
Using a paired samples t-test, it was then possible to test for the amount of variation between
the two conditions average CPD score and the agreed CPD score. This analysis revealed the
difference between the samples to not be statistically significant (t(55) = 0.397, p=0.693, d =
0.026). Thus there was not a significant difference in average CPD scores vs. the agreed CPD
scores. Taken together with an examination of the descriptive statistics generated at the
time and the regression equation above, this analysis showed that the average CPD scores
were generally very similar to the CPD scores awarded by mutual agreement.
Page 201
Appendix 16
Information relating to the focus group interviews
Page 202
Page 203
p.donyai@reading.ac.uk
Dear colleague
As promised I am writing to confirm arrangements for the focus-group interview taking place on Saturday
27th March 2010 at the University of Reading, to which you have been invited. The meeting will start at
10am and will come to a close by 1pm. It will be attended by around 6 other study participants, myself
and my colleague Rebecca working on the study. We will be providing participants with refreshments and
a light sandwich snack. Please do let me know of any dietary requirements in advance.
The purpose of the meeting is to seek your views about the study, learn more about your experiences of
CPD in general and to discuss the purpose of the study with you in more detail. As part of this work, we
are also hoping to work through a small number of hypothetical CPD cases to gain your views and ratings
of these entries. We will analyse the focus-group interviews to identify themes in relation to participants
understanding and experiences of participating in the CPD-RPS project. We also hope to be able to use
your ratings of the entries to help validate the CPD Outcomes Framework. In addition, we will strive to
provide you with feedback, in confidence, about your own CPD entries as submitted for the purpose of the
study, against the framework devised.
We are providing participants with a 200 fee to cover the cost of locum expenses, etc to facilitate
attendance. We are also able to fund reasonable travel costs to the University of Reading. Both claims can
be made on a claim form that I will supply on the day. However, please note that with the introduction of
new regulations, we are not permitted to process the completed claim forms without making photocopies
of original documents that verify claimants right to work in the UK. The University has a blanket
requirement to fulfil certain duties in respect of monitoring, reporting and record keeping. This means that
in order for me to pass the completed claim forms for processing I must be presented with certain
documents, check them, take copies, sign, date and retain until the claim is processed. I have enclosed the
full guidance with the e-mail accompanying this letter, but in summary the University asks to keep a copy
of claimants passport and NI number from original documents. I apologise for the inconvenience this will
present but am grateful for your understanding.
The meeting will take place in the Pharmacy Practice Laboratory, University of Reading, Whiteknights
Campus, Reading, RG6 6UR. The following URL provides a link to maps and travel directions:
http://www.reading.ac.uk/about/find/about-findmap.aspx
You can enter the Whiteknights Campus by either the Pepper Lane gate or the Shinfield Road gate. Please
do not use the Earley gate entrance. Once on campus you will need to find your way to the Food
Bioscience Building (number 47 on the map). A parking permit will not be required on a Saturday. The
nearest car park is P10. The entrance to the Food Bioscience building (adjacent to the Chemistry &
Pharmacy Building) is down a small flight of steps. Because the meeting is being held at a weekend the
main external door may be locked; if that is the case please wait as we will be periodically allowing access.
Once in the Food Bioscience building, you will then have to walk up a flight of steps - the Pharmacy
Page 204
Practice Laboratory is through a set of double doors and on the right. I will make sure I place adequate
signs on various locations in the building on the day to act as a guide.
Yours sincerely
Dr Parastou Donyai, on behalf of the research team:
Dr Parastou Donyai
BPharm PGDPRM(Open)
PGCert LTHE MRPharmS
Principal Investigator
Dr Angela Alexander
BPharm MSc
FRPharmS MCPP MBE
Co-investigator
Rebecca Z Herbert
BA MSc
Research Assistant
Page 205
Page 206
To what extent does CPD feed back into practice before you
write it up as an entry?
Do you wait until you have applied your learning in practice,
before completing a CPD entry or can learning alone be
written as a CPD entry? (i.e. is it valid to assume future
impact?)
Why?
Can you explain your understanding some more?
Who should benefit from your CPD?
Why?
Can you explain your understanding some more?
Do you think it is possible to demonstrate your Continuing
Professional Development by completing a standard CPD
entry?
Why?
Can you explain your understanding some more?
Page 207
Appendix 17
Information relating to the telephone interviews
Page 208
Page 209
Page 210
Relevance
Impact
Overall
Before entry
Relevance
Impact
Overall
Relevance
Impact
Overall
Rewritten entry
Relevance
Impact
Overall
New entry
Relevance
Impact
Overall
Page 211
Appendix 18
Exploring the data using quantitative analyses
Page 212
Zskewness
Zkurtosis
Control
0.693 / 0.224 =
3.09
0.694 / 0.231 =
3.004
0.732 / 0.312 =
2.35
0.654 / 0.246 =
2.66
-0.007 / 0.444 =
0.016
0.235 / 0.459 =
0.51
0.391/ 0.422 =
0.93
0.631 / 0.488 =
1.29
Intervention
Before
After
KolmogorovSmirnov
D(117) = 0.172,
p < 0.0001.
D(109) = 0.162,
p < 0.0001.
D(130) = 0.153,
p < 0.0001.
D(96) = 0.136,
p < 0.0001.
Shapiro-Wilk
W(117) = 0.952,
p < 0.0001.
W(109) = 0.958,
p < 0.005.
W(130) = 0.945,
p < 0.0001.
W(96) = 0.970,
p < 0.05.
Mean Rank
Sum of Ranks
AfterControl -
Negative Ranks
10(a)
9.40
94.00
BeforeControl
Positive Ranks
13(b)
14.00
182.00
Ties
2(c)
Total
25
AfterIntervention -
Negative Ranks
2(d)
2.00
4.00
BeforeIntervention
Positive Ranks
20(e)
12.45
249.00
Ties
1(f)
Total
23
a AfterControl < BeforeControl; b AfterControl > BeforeControl; c AfterControl = BeforeControl; d AfterIntervention <
BeforeIntervention; e AfterIntervention > BeforeIntervention; f AfterIntervention = BeforeIntervention
University of Reading 2010
Page 213
The table below shows the test statistic based on the negative ranks; for the Control group
the z-score is -1.339 (p=0.181) and for the Intervention group the z-score is -3.979 (p<0.0001).
It can be concluded that with the Intervention group there was a statistically significant
increase in CPD scores from Before to After (z = -3.979, p<0.0001) but that the increase in
the Control group was not statistically significant.
Test Statistics(b,c)
AfterInterventi
on AfterControl -
BeforeInterve
BeforeControl
ntion
Z
Asymp. Sig. (2-tailed)
Monte Carlo Sig. (2-
Sig.
tailed)
99% Confidence
Lower Bound
Interval
Upper Bound
-1.339(a)
-3.979(a)
.181
.000
.194
.000
.184
.000
.205
.000
.098
.000
Sig.
tailed)
99% Confidence
Lower Bound
.090
.000
Interval
Upper Bound
.106
.000
25 = -0.27
rintervention = -3.979 /
23 = -0.83
This represents a large change in CPD scores with the Intervention group (as it is above 0.5, a
benchmark set by Cohen). The effect size with the Control group was not statistically
significant and was small (below 0.3, a benchmark set by Cohen).
A further exploratory analysis was carried out on all of the CPD entries (226) submitted by
the 48 study participants both before and after the intervention. The dependent variable was
the final CPD score (an average of Pharmacist1 and Pharmacist2 CPD scores). The
independent factors were educational intervention (control vs. intervention) and stage of
study (before vs. after). The Kruskal-Wallis test was applied and the following table was
produced to illustrate the ranks:
Ranks
Grouped according to
Intervention and Stage
FinalCPDScore
Mean Rank
ControlBefore
67
114.29
ControlAfter
50
128.94
InterventionBefore
63
84.71
InterventionAfter
46
135.00
Total
226
Page 214
The table for the test statistic is shown below. The test statistic, H, for the Krustal-Wallis test
(shown as chi-square) together with its significance are shown. It shows that there is a
statistically significant difference in the groups (but does not show where the difference is).
Test Statistics(b,c)
FinalCPDScore
Chi-Square
20.029
df
Asymp. Sig.
.000
Monte Carlo
Sig.
Sig.
99% Confidence
Lower Bound
.000(a)
.000
Interval
Upper Bound
.000
It was then also possible to conduct post-hoc tests to check for differences in the groups. Here
a Bonferroni correction is made post-hoc so that instead of using 0.05 as the critical value for
significance for each test, the critical value of 0.05 divided by the total number of tests is
used instead. In this instance the Mann-Whitney test was used to test for two differences as
follows:
Test 1: Control/before compared to control/after
Test 2: Intervention/before compared to intervention/after
Hence, the critical value was equal to 0.05/2 = 0.025.
For the Control group, the Mann-Whitney test returns the following ranks and statistics:
Ranks
Control
CPDScoreControl
Mean Rank
Sum of Ranks
Before
67
55.32
3706.50
After
50
63.93
3196.50
Total
117
Test Statistics(a)
CPDScoreControl
Mann-Whitney U
1428.500
Wilcoxon W
3706.500
-1.361
.173
Mean
117
-.1111
Std. Deviation
15.46856
Minimum
-28.00
Maximum
42.00
For the Control group, the Kolmogorov-Smirnov test returns the following ranks and
statistics.
University of Reading 2010
Page 215
Frequencies
Control
CPDScoreControl
Before
67
After
50
Total
117
Test Statistics(a)
CPDScoreControl
Most Extreme
Absolute
.196
Differences
Positive
.196
Negative
-.060
Kolmogorov-Smirnov Z
1.049
.221
Using the Mann-Whitney U test, the effect size can be calculated as follows: r = -1.361 / 117
= -0.126. The effect size with the Control group was not statistically significant (p=0.173) and
was small (below 0.3, a benchmark set by Cohen). It can be concluded that CPD scores after
the Control educational intervention (Mdn = 0) did not differ significantly from CPD scores
before the control as intervention (Mdn = -4.5) , U = 1428.5, z = -1.361, p = 0.173, r = -0.126.
For the Intervention group, the Mann-Whitney test returns the following ranks and statistics:
Ranks
Intervention
CPDScoreIntervention
Mean Rank
Sum of Ranks
Before
63
45.64
2875.50
After
46
67.82
3119.50
Total
109
Test Statistics(a)
CPDScoreIntervention
Mann-Whitney U
859.500
Wilcoxon W
2875.500
-3.619
.000
Mean
109
-2.4404
Std. Deviation
21.40004
Minimum
-45.50
Maximum
62.00
For the Intervention group, the Kolmogorov-Smirnov test returns the following ranks and
statistics.
Page 216
Frequencies
Intervention
CPDScoreIntervention
Before
N
63
After
46
Total
109
Test Statistics(a)
CPDScoreIntervention
Most Extreme
Absolute
Differences
Positive
Negative
Kolmogorov-Smirnov Z
Asymp. Sig. (2-tailed)
.398
.398
.000
2.053
.000
Using the Mann-Whitney U test, the effect size can be calculated as follows: r = -3.619 / 109
= -0.347. The effect size with the Intervention group was statistically significant (p<0.0001)
and was medium (between 0.3-0.5, a benchmark set by Cohen). It can be concluded that CPD
scores after the Intervention as educational intervention (Mdn = 0) did differ significantly
from CPD scores before the educational intervention (Mdn = -12), U = 859.5, z = -3.619, p
<0.0001, r = -0.347.
Page 217
Appendix 19
Quantitative analyses: confirming the experimental effect
Page 218
Adjusted mean
-0.460
16.818
'Treatment' group
Community
24
Hospital
14
1.00
Control
21
2.00
Intervention
17
df
Mean Square
Sig.
1504.461
5.416
.004
3930.084
3930.084
14.147
.001
246.458
246.458
.887
.353
Before
1525.248
1525.248
5.490
.025
Intervention
2528.002
2528.002
9.100
.005
Error
9445.362
34
277.805
Total
15570.750
38
Corrected Total
13958.743
37
Corrected Model
Intercept
WorkSetting
4513.382
Page 219
Parameter Estimates
Dependent Variable:After
Parameter
Std. Error
Sig.
Lower Bound
Upper Bound
Intercept
22.996
5.296
4.342
.0001
12.234
33.758
[WorkSetting=1]
-5.751
6.105
-.942
.3529
-18.158
6.657
[WorkSetting=2]
.423
.180
2.343
.0251
.056
.789
[Intervention=1.00]
-17.278
5.728
-3.017
.0048
-28.918
-5.638
[Intervention=2.00]
Before
Control
-.460
dimensi on1
Intervention
Std. Error
Lower Bound
Upper Bound
3.912
-8.409
7.490
4.124
8.436
25.200
16.818
a. Covariates appearing in the model are evaluated at the following values: Before = 7.8158.
Pairwise Comparisons
Dependent Variable:After
(I) 'Treatment' group (J) 'Treatment' group
Mean
Difference (I-
Difference
J)
Control
dimensi on2
Intervention
Intervention
dimensi on2
Control
Lower Bound
Upper Bound
5.728
.005
-28.918
-5.638
5.728
.005
5.638
28.918
-17.278
dimensi on1
Sig.a
Std. Error
17.278
Univariate Tests
Dependent Variable:After
Sum of Squares
df
Mean Square
Contrast
2528.002
2528.002
Error
9445.362
34
277.805
Sig.
9.100
.005
Page 220
Univariate Tests
Dependent Variable:After
Sum of Squares
df
Mean Square
Contrast
2528.002
2528.002
Error
9445.362
34
277.805
Sig.
9.100
.005
The F tests the effect of 'Treatment' group. This test is based on the linearly independent
pairwise comparisons among the estimated marginal means.
Boxplot
Case Processing Summary
'Treatment' group
Cases
Valid
N
Before
Missing
Percent
Total
Percent
Percent
Control
21
100.0%
.0%
21
100.0%
Intervention
17
100.0%
.0%
17
100.0%
dimensi on1
Page 221
Adjusted mean
2.231
12.095
'Treatment' group
Community
24
Hospital
14
1.00
Control
21
2.00
Intervention
17
df
Mean Square
Sig.
711.844
4.054
.009
2310.035
2310.035
13.156
.001
WorkSetting
107.312
107.312
.611
.440
Before
690.772
690.772
3.934
.056
WorkSetting * Before
706.972
706.972
4.026
.053
Intervention
792.561
792.561
4.514
.041
Error
5794.392
33
175.588
Total
9311.250
38
Corrected Total
8641.770
37
Corrected Model
Intercept
2847.378
Page 222
Parameter Estimates
Dependent Variable:After
Parameter
Std. Error
Sig.
Lower Bound
Upper Bound
Intercept
15.785
4.231
3.731
.001
7.177
24.393
[WorkSetting=1]
-3.853
4.929
-.782
.440
-13.881
6.175
[WorkSetting=2]
Before
.006
.278
.020
.984
-.561
.572
[WorkSetting=1] * Before
.727
.362
2.007
.053
-.010
1.465
[WorkSetting=2] * Before
[Intervention=1.00]
-9.864
4.643
-2.125
.041
-19.310
-.418
[Intervention=2.00]
Estimates
Dependent Variable:After
'Treatment' group
Control
2.231
dimensi on1
Intervention
Std. Error
Lower Bound
Upper Bound
3.145
-4.168
8.630
3.521
4.931
19.260
12.095
a. Covariates appearing in the model are evaluated at the following values: Before = 4.7763.
Pairwise Comparisons
Dependent Variable:After
(I) 'Treatment' group (J) 'Treatment' group
Mean
Difference (I-
Difference
J)
Control
dimensi on2
Intervention
dimensi on1
Intervention
dimensi on2
Control
Std. Error
Sig.
Lower Bound
Upper Bound
4.643
.041
-19.310
-.418
4.643
.041
.418
19.310
-9.864
9.864
Page 223
Univariate Tests
Dependent Variable:After
Sum of Squares
Contrast
Error
df
Mean Square
792.561
792.561
5794.392
33
175.588
Sig.
4.514
.041
The F tests the effect of 'Treatment' group. This test is based on the linearly independent
pairwise comparisons among the estimated marginal means.
Case Processing Summary
'Treatment' group
Cases
Valid
N
Before
Missing
Percent
Total
Percent
Percent
Control
21
100.0%
.0%
21
100.0%
Intervention
17
100.0%
.0%
17
100.0%
dimensi on1
Boxplot
Page 224
Appendix 20
Qualitative analyses: generating a new model of CPD
behaviour
Page 225
numbers
Appraisal
Audit
Competences
Critical incidents
Feedback from colleagues
Feedback from users of products/ services
Personal interest
Reading journals
Talking to colleagues
Meeting
Training
Requirement of work
13
9
28
23
22
24
62
38
46
1
2
2
Page 226
When looking at who has driven the conduct of CPD, 34 CPD records did not contain any
information in this section (33 CPD records starting with action and one starting with
evaluation). In the remaining 128 copies, 86 left this section blank while only one third of
the entries containing information in this section (42 of 128). Nearly 60% of the participants
(25 of 42) who completed this section ticked only one option for the party driving their CPD
conduct whereas the other 17 participants ticked more than one option (40%). In terms of
who is driving CPD, nearly half of the participants who completed this section stated their
CPD was driven by themselves together with the NHS or other employing or contracting
organization. On the other hand, not many CPD entries showed users of services/ products
and peers as the driving force for the CPD.
Similarly, participants categorisation of the impact of their CPD seemed more focused on
effect on the self, than on users of services and peers as illustrated in the graph below.
Identifying impact of CPD
The entries were also analysed in terms of the period of time apparently taken to complete
each CPD for a total of 116 entries that contained this information. Many CPD entries were
completed between 1 week 1 month (39 of 116; 33.6%) and 2 months (22 of 116, 19%) from
the start point. On one hand there are not many cases when participants completed the CPD
within a week (8 of 116; 6.9%). A total of 18 entries (15.5%) indicated longer than 3 months
had been spent and 7 (6%) between 2 to 3 months. Interestingly, 16 (13.8%) of the entries
appeared to have been completed and finished on the day the entry was made. For 6 entries
(5 reflection entries and 1 planning entry) the entry was made after the actions had taken
place.
In terms of activities undertaken, a table was constructed to displays the type of activities
conducted to complete CPD. The most popular activities were CE type activities. Computer
aided learning, short courses and workshops seemed to have been favoured. Communication
with peers, especially speaking to colleagues, was also embraced by some participants. Only
a small number of CPDs seemed to relate to teaching type activities.
Page 227
Instructing (7)
Activities
Brainstorming
Colleagues
Meeting
Projects
Work shadowing
Computer aided learning
Distance learning
Information services
Workshops
Postgraduate certificate
/diploma/degree
Presentation
Short courses
Structured reading
Mentoring
Teaching
Tutoring
3
27
9
1
1
25
9
14
21
12
4
27
69
4
2
1
Open coding
As mentioned in descriptive analysis above, most records started with reflection. These
records were the first batch to be analysed in the hope that we would discover current
practices in terms of undertaking and recording CPD under close scrutiny. Starting with
open coding of 50 CPD records, rapidly some categories emerged in terms of why a specific
CPD is undertaken. After several rounds of regrouping, the final categories in relation to
what was driving CPD became as follows: new role, new regulations/requirement,
new/existing problem in practice, critical incident/mistakes at work, new product launching,
requalification/assessment/audit, and pure personal interest. It is worth noting that the
multiple choice options on Plan & Record selected by the participants to indicate the
methods used in order to identify the learning objectives does not necessarily explain the
real motivation or trigger for a CPD. Only reading the descriptive explanation in the entry
reveals the real reason behind a CPD.
After coding the entries in terms of the motivation or trigger for each CPD, the remainder of
each entry was also read in detail. With the development of the motivation categories,
another family of categories gradually emerged indicating how the entries demonstrated the
Page 228
relationship of CPD to practice, learning needs, type of action and the evidence of the impact
of CPD. For instance, when the reason for undertaking a CPD is a new role, the participants
tended to be able to put what has been learned into everyday practice, therefore it would be
easy for them to present the impact of CPD, in particular on their practice. Using another
example, when participants conducted a CPD due to new regulations/requirements, they
were more likely to attempt to ensure their learning by merely reading relevant information.
Therefore there was little evidence to collect to effectively evaluate and further justify their
CPD.
Axial coding
Axial coding developed the categories further by specifying the relationships between the
subcategories. In the main, for the first category of trigger (which we have called CPD),
encompassing namely new roles, existing or new problems and critical incidents, as well as
the CPD being highly related to practice, participants in the main conducted the learning
through a practical problem-solving exercise and while CE may have been a part of the
learning, engagement with others also featured as an activity. This category of CPD would
enable demonstration of impact through some form of documentation or feedback, as well as
resulting in an improve self-confidence and self-realisation.
For the second category of trigger, (which we have called CE) encompassing namely new
requirements/regulations, product promotions and new product launches or some form of
assessment of personal knowledge, the CPD had a low level of association and application to
practice and the learning was conducted mainly to fill potential knowledge gaps and to
answer closed questions such as what is or how to.. This category of CPD would be
facilitated mainly by partaking in a CE activity of some sort and would invariably lead on to
some level of enhanced confidence but very little evidence of impact instead focussing on
presumed benefits in the future. The final category related to unsuitable material for CPD.
Category
CPD
CE
Inapt
Trigger of CPD
New role
Existing/new
problem
Critical incident
New
requirement/reg
ulations
Product
promotion/new
product
launching
Requalification/a
ssessment/audit
Anecdotal family,
friends
Relation of
CPD to
practice
Learning needs
CPD action
categories
Highly
associated to
practice
Along with
knowledge gap
and
competences,
there is a priority
on solving
problem in
practice.
Low application
to practice
Mainly
knowledge gap to
answer questions
expecting closeended answer,
such as: what
is, how to do
Continuing
education is still
vital part, but
other activities
are engaged with,
such as
discussing with
colleagues/line
manager,
contacting other
departments/GPs,
work shadowing,
peer consensus
exercise, etc.
Mainly
continuing
education such as
short course,
presentations,
workshop,
constructed
reading, etc.
Impact on practice
(Evidence)
Confidence/compet
ences
Putting what has
been learned into
practice-immediate
positive feedback
from
patients/colleagues
Documentation
(paper, worksheet,
format, etc.)
Confidence/compet
ences
Presumed benefits
Positive feedback
from
patients/colleagues
No impact on practice
Page 229
Selective coding
Selective coding enabled integration of the categories and formulation of the grounded
theory from the analysis exercise. In order to capture the theory from descriptions of
concepts and themes and their interrelationships, a simple model was developed. There will
inevitably be variations when applying CPD entries to this model but this model we believe
captures the essence of CPD behaviour in pharmacy.
We have named this the Purpose-Action-Results as a behavioural model, which abbreviates
to PARable it tells the story of continuing professional development in pharmacy as follows.
Page 230
The second type of behaviour is captured in the upper part of the model and represents a
genuine connection with Kolbs model of experiential learning. Here, although an
immediate and necessary external condition will appear to be driving the CPD, for example,
a problem at work or a new role, it is the persons internal developmental motivations that
will drive the CPD. So while the need may exist externally, the individuals involvement in
the CPD will be driven internally, via an existing understanding of what it means to practise
continuing professional development. Although the activity may involve this type of pharmacy
professional in some element of learning, it is the integration of the learning with the work
setting that is at the crux of this behaviour. The impact is demonstrated through use of
language such as I have done. or I have been able to. This type of CPD is also accompanied
by some level of documentation that would demonstrate its application or at least reference
to feedback from patients and colleagues. This type of CPD invariably impacts the greatest
on practice and that in turn can be related back to the individuals own development, as
indicated by the top arrow in the diagram above.
Thematic analysis of the focus group and interview transcripts
Once the model above had been developed, we sought to conduct focus group interviews
with the participants as a first step towards verifying the model and its application to
participants own expressed understanding of their CPD. The interview guide for use during
the focus group discussions is presented in Appendix 16 and was based on the emerging
themes that informed the model, as highlighted in the left-hand column of the interview
schedules entitled theory. We categorised the transcripts according to the themes identified
in the model and looked for additional themes. In fact, while a number of interesting and
additional features were obtained, the model itself remained unchanged and it was possible
to categorise participants approach to CPD using either the CE or CPD pathways. The
additional supporting themes are described below.
Time spent on CPD and the Plan & Record CPD template
The CE approach was associated with what the participants described as quick and easy CPD.
These participants also saw the concept of longer more complex activities imposing on what
they could reasonably conduct and express as CPD. This was linked with the CPD template
of Plan & Record, which seemed to facilitate the construction of quick entries for this
group. Those favouring the CE approach then seemed to associate CPD with the recording
process itself, which necessitated setting clear specific objectives that could be met with ease
through specific planned activities. This group in particular had difficulty conceptualising an
ongoing relationship with their CPD entry, for example to continue to collect evidence of
impact, instead preferring to adhere to a systems-based approach that relied on form
completion and the filing away of entries as complete at the first opportunity. Starting at
action was deemed perfectly acceptable if not preferable to this group yet the purpose was
not to apply the learning in any in-depth manner but to acquire it instead even with entries
that began at action there was a sense that the learning could be filed for application at a
later date. Or that CPD could be constructed from a pool of actions to fit the CPD template.
In fact, there was evidence that the template led to the selection of activities that would
enable completion of the form in an efficient manner to indicate learning completed even
though participants openly admitted some of the categories on Plan & Record were being
completed for the sake of completion. In addition, the completion of the form itself was
viewed as an activity that detracts from available time. On this basis, the group had no
objection to completing 9 entries per annum. But the group was keen for some form of
protected CPD time and also seemed to favour the association of CPE with specified
minimum hours. The participants in this group also appeared more concerned with CPD as
an activity that had to be completed for mandatory revalidation purposes rather than for
development per se.
Page 231
The views expressed by those following the CPD pathway were associated with an
understanding that CPD would invariably involve a deeper relationship with practice and
that the outcomes would take longer to achieve. The participants in this group demonstrated
a desire to conduct CPD in a less ad hoc way and appeared more willing to compromise in
terms of the time (their own) they would give up for CPD. Their CPD was focussed on
meeting work objectives in clear manner and this group appreciated the need for relevance
and impact on others as well as on self. They recognised the transition from CE to CPD. In
particular, this group had a focus on improving their behavioural and communication skills
through practising CPD, again linking their learning with actual application and interaction
with significant others. These participants appreciated that the depth of learning was key
and could perhaps not be achieved sufficiently for 9 entries per annum. They also
appreciated that completion of the CPD template was simply a process of recording and not
the CPD itself.
It was interesting to note that quite a number of participants in the intervention group chose
to submit CPD entries they had been thinking about over a period longer than the assigned 2
months in January and February 2010.
Page 232
Appendix 21
Qualitative analyses: Feedback about the CPD Outcomes
Framework and participants experience with the study
Page 233
Page 234
Page 235
Peoples learning styles lean towards didactic teaching and people dont know what
they need to know
A need for a curriculum to address CE needs
The General-Level Framework would be useful to CPD
Link CPD to job descriptions
CPD assessment caused a level of gloom
Specifying a curriculum could be dangerous too because that might limit activity
CPPE courses not relevant to specialist pharmacists
Could consider asking people to write their CPD as case scenarios with specified
headings to convey a story rather than rigid form-filling
Feedback more important than a mere certificate.
A lot of technicians find CPD a chore and need more guidance on type of CPD to do
9 CPDs is a lot to do in a year
Study took longer than first thought participant wanted book token earlier
Plan & Record not compatible with what CPD Outcomes Framework is trying to
achieve.
People should be permitted to submit some entries on a trial basis to get feedback
MCQ self-assessment would help identify learning needs
Would not have enough of the high-scoring entries to submit 9 per annum
Prefer objective criteria to follow
A feeling that currently CPD entries are being passed easily in the absence of
tangible assessment criteria
Difficult to convey competence through text rather than observation
More CPD facilitation courses would be helpful and a chance to interact with others
and compare notes
Some particularly positive comments about the study and specifically the Outcomes
Framework :
Yes I havent written any up for a while but am already thinking I need to do one and whats
relevant! Ive got what I want out of it and I can feed it back to staff. I quite enjoyed doing it
actually because its just as I say it made me think about me CPD it had gotten to be a chore
rather not pleasure but this makes you think about how youre going to do it and plan it
better.
I thought it was very good and its made me think differently when I write up my own CPDs now
about risks involved and also is it really, is it a valid CPD to start off with. Its made me think
more of the content of my CPD. When I first started doing CPDs it was just a matter of ok Ive got
a certificate to say Ive done this CPD or Ive attended a workshop but now its more what Im
actually getting out of writing. Since Ive done this correspondence with you its more like what
Im getting out of the CPD and I can pass on to others as well.
Page 236
I do feel it has been of benefit and just like I said, it makes me think more about, its all very well
doing something and saying you've done it. You have to decide as to why you have done it and
what the benefits or indeed was it worth doing it. So it has made me think more about what I am
doing in terms of writing, how I present what I have learned or courses of Ive been on or
information I've researched. And, certainly I have found that using this framework, or reading
about the framework, or trying to use it, then you think more about what I was writing and trying
to get across to the facilitators as to why I was doing something, and what I was getting out of
it.
But you understand what they are actually looking for now. Going on the course that was run
by CPPE was useful, but I have felt that reading this information is more useful in terms of
thinking about why I am actually doing something and how it can, like you said the impact on my
day to day work.
Yeah, it made me focus what I was doing CPD for. Um, yeah, I remember looking at some of my
CPD entries and thinking well, that wasnt really good really. But I think a lot of people just
thought of CPD as recording any old learning and wasnt putting um, any sort of impact of what
it was gonna have on their practice.
Yeah. I quite liked this idea! Yes. Once, Id got my head around it. It was quite difficult to, to
grasp, you know I did need to read it a couple of times. I just think its put me on the right trail
now. Nobody shared their CPD entries so you dont know if youre doing it right or not!
Oh thank you! Oh, Im pleased Im really really pleased. Im delighted because you know at the
back of my mind I panic like everyone else and they are going to ask me for nine entries
tomorrow you know what I mean. And I was delighted to take part in it.
Fair enough. Well I think its been very good. I hope, I hope that it does get published and I
hope that the new body does accept it and put it into place. I hope it becomes a reality and that
we can start teaching our students this as well.
I mean I must admit that when I did open CPD entry in terms of my involvement in the study,
and when we are thinking about advantages and disadvantages, one disadvantage is that I this is
a study, and we dont know what the general pharmaceutical council are going to take part, or
whether the draft standards and information will stay as they are, so I kind of recognised that
limitation, but nevertheless I still think its really really use preparation and Im sure its the
direction of travel and Im sure they will be convinced by your research in this study - and so from
my personal and very selfish perspective, its been a very beneficial thing to have done.
It has been very useful to do it. Thank you. I enjoyed it immensely.
Page 237
Appendix 22
Interpretation and explanation of quality scoring of CPD
entries
Page 238
Page 239
Page 240
Appendix 23
Interpretation and experience of Revalidation Standards in
CPD
Page 241
Page 242
lysis of
elation
rds of
cy
Page 243
Standards in their re-written or new CPD entries (p = 0.005) submitted at the after stage of
the study.
Crosstab
ProficiencyStandard
No
Intervention Control
Count
47
% of Total
34.4%
Count
13
83.3%
46
13.5% 47.9%
80
% of Total
50
3.1% 52.1%
33
% of Total
Total
3
49.0%
Intervention Count
Total
Yes
16
96
16.7% 100.0%
Chi-Square Tests
Value
Pearson Chi-Square
Continuity Correction
df
Likelihood Ratio
sided)
sided)
sided)
.003
7.021
.008
9.034
.003
8.548
b
.005
8.459
.003
.004
96
a. 0 cells (.0%) have expected count less than 5. The minimum expected count is 7.67.
b. Computed only for a 2x2 table
Page 244
Page 245