Académique Documents
Professionnel Documents
Culture Documents
There are no easy solutions to the problem of improving tions we want to ask about the quality of care or
the quality of care. Research has shown how difficult it services may not be amenable to quantitative
measurement. Qualitative research has come to
can be, but has failed to provide reliable and effective the fore in health and social research by providing
ways to change services and professional performance ways of answering these sorts of questions,2 3 both
for the better. Much depends on the perspectives of in the form of “stand alone” or independent
research projects and as a complement to quanti-
users and the attitudes and behaviours of professionals tative studies.
in the context of their organisations and healthcare The use of qualitative methods in qualitative
teams. Qualitative research offers a variety of methods research involves the systematic collection, organ-
isation, and analysis of textual material derived
for identifying what really matters to patients and carers, from talk or observation. It is rooted in the inter-
detecting obstacles to changing performance, and pretive perspectives found in the humanities and
explaining why improvement does or does not occur. social sciences that emphasise the importance of
understanding, from the viewpoint of the people
The use of such methods in future studies could lead to a involved, how individuals and groups interpret,
better understanding of how to improve quality. experience, and make sense of social phenomena.
.......................................................................... It is not possible here to elaborate on the origins
and theoretical underpinnings of this distinctive
approach to research, but it is important to be
“I went to see Roy Griffiths (architect of the 1984 NHS aware that qualitative research is informed by a
reforms and supermarket chief executive) in his office at quite different paradigm to that which governs
Sainsbury’s and while I was talking to him his secretary quantitative clinical and biomedical research. The
handed him a piece of paper. He looked at it and said: emphasis in qualitative research on understand-
‘OK’. I asked him: ‘What do you mean OK?’ and he said: ing meanings and experiences makes it particu-
‘My organisation is OK today’. It turned out he had just larly useful for quality assessment and for
six measures on that piece of paper and from those he unpacking some of the complex issues inherent to
could tell what the state of Sainsbury’s health had been
quality improvement. This paper explores some of
the day before; things like the amount of money taken
the qualitative methods that can help to gather
yesterday, the freshness quotient—the amount of stuff on
the shelves—the proportion of staff on duty and so on.” information about the delivery of good quality
NHS regional manager quoted in Strong and health care and explain variations in health care
Robinson.1 provision.
www.qualityhealthcare.com
Qualitative methods in research on healthcare quality 149
additional benefit of uncovering issues or concerns that had Box 1 Focus group study to obtain information
not been anticipated or considered by the researchers. In order
directly from adolescent young women on their
to ensure that really detailed information is gathered,
knowledge and expectations concerning
interview methods require experienced researchers with the
contraceptive use and their attitude to healthcare
necessary sensitivity and ability to establish rapport with
respondents, to use topic guides flexibly and follow up
questions and responses. To obtain a range of views, a purposive direct sampling
Focus groups are similar in structure to face to face strategy was followed to organise the focus groups. Four
interviews but they use the interaction of a group of, typically, secondary schools with different educational levels were
6–8 people to generate data. This allows group members to selected because of the correlation with sexual behaviour
talk to one another, argue and ask questions, and is especially of adolescents. In each school all 17 year old young
useful for finding out about shared experiences. Focus groups women of one small 5th grade class were asked to partici-
have been successfully used with users and staff. One adapta- pate. Each group comprised six or seven participants, with
tion of this method is the “exploration group” in which differ- a total of 26. Differences in sexual experiences and social
ent healthcare providers who have direct contact with a classes fostered lively interaction within the groups. The
particular health problem review and discuss some material discussions were tape recorded, transcribed, and ana-
such as audio or video taped cases or interviews in order to lysed by content analysis. Knowledge of the daily use and
develop an interpretative explanation.4 side effects of contraceptives was insufficient. The general
Another variant is the “quality circle”. This convenes a small practitioner was the most frequently consulted healthcare
group of healthcare providers and patients who meet at regu- provider for the first pill prescription, but for a
lar times for a determined period to formulate hypotheses or gynaecological examination they thought they had to visit
action points to improve quality in health care.5 a gynaecologist. Mothers and the peer group were impor-
tant in teenagers’ decision making and should be consid-
Observation based methods ered when communicating with adolescent young women.
The systematic observation of organisational settings, team
behaviour, and interactions is especially useful in studying
quality issues as it allows researchers to uncover everyday
behaviour rather than only relying on interview accounts. Box 2 Investigation of barriers to implementing
These methods are increasingly used in the study of organis- guidelines for the management of depression in
ation and delivery of care6 and can be especially useful in general practice10
uncovering what really happens in particular healthcare
settings—for example, in the study of everyday work in labour Information about how general practitioners (34 in the
wards7—and for formative evaluation of new services. intervention group) managed patients with depression
were obtained from review of records and assessment of
Narrative based medicine outcome with a standard patient completed questionnaire.
Narrative based medicine is one of several patient centred The guidelines were issued to the general practitioners and
approaches that can give the physician access to the lived they were then interviewed individually to identify their
experience of their patients. This is the context in which the personal barriers to acting on the recommendations. The
physician interprets symptoms and signs and in which interviews were semi-structured and were recorded and
personal healthcare decisions are made. It can therefore be an transcribed. Psychological theories of behaviour change
approach to understanding how healthcare decisions are were used as the framework for analysing the interviews.
made. The transcripts were repeatedly studied independently by
several researchers. An example of the barriers identified
SAMPLING through use of a theoretical framework relates to the theory
Qualitative methods are designed to yield detailed and holis- of self-efficacy. Some general practitioners did not feel
tic views of the phenomena under study. The aim of qualitative able to ask about suicide risk because they lacked
research is not therefore to identify a statistically representa- confidence in their ability to use an appropriate form of
tive set of respondents or to produce numerical predictions. words. After the general practitioners had been given sug-
Qualitative research questions tend to be exploratory and not gestions for phrases to use, the proportion of patients
tied to formal hypothesis testing, so the sampling strategies whose suicide risk had been assessed increased.
used in qualitative research are purposive or theoretical rather
than representative or probability based.8 This means that
respondents are sampled based on specific predetermined cri- beginning or part way through the analysis as a way of
teria in order to cover a range of constituencies—for example, approaching the data.
different age, social class, and cultural backgrounds (see box There are various software packages designed to assist with
1).9 To locate hard to reach individuals or groups, researchers the organisation and retrieval of qualitative data. Among
can use “convenience” venues, informants, or social networks. those most commonly used are QSR NUD*IST11 and Atlas Ti.12
The sample sizes for interview studies tend to be much Some of these packages enable sophisticated analysis,
smaller than those used in survey or more quantitative allowing the researcher to make theoretical links within the
research; they may include 30–50 respondents, although this data set; others identify co-occurring codes and provide
can vary with the research question asked. Similarly, observa- opportunities to annotate codes or portions of text. All of these
tional studies may be based on a single case study, perhaps processes are integral to qualitative data analysis, but whether
focusing on one organisational setting such as a clinic or ward. software is used or not, the key point about the analysis is that
it relies on systematic and rigorous searching of text for
ANALYSIS categories and themes. These categories and themes are
Qualitative analyses attempt to preserve the textual form of collected together, compared, and re-analysed to develop
the data gathered and to generate analytical categories and hypotheses or theoretical explanations. When conducting this
explanations. This may be done inductively—that is, obtained coding analysis the researcher gives consideration to the
gradually from the data—or deductively—that is, with a theo- actual words used, the context, the internal consistency, the
retical framework as background (box 2),10 either at the specificity of responses that is more based on own experiences
www.qualityhealthcare.com
150 Pope, van Royen, Baker
www.qualityhealthcare.com
Qualitative methods in research on healthcare quality 151
www.qualityhealthcare.com
152 Pope, van Royen, Baker
chasm. A new health system for the 21st century. Washington DC: 24 Van Wersch A, Eccles M. Involvement of consumers in development of
National Academy Press, 2001: 309–22. evidence based clinical guidelines: practical experiences from the North
22 Abu J, Baker R, Habiba M, et al. Qualitative and quantitative assessment of England evidence-based guideline development programme. Qual
of women’s views of a one-stop menstrual clinic compared to traditional Health Care 2001;10:10–16.
gynaecology clinics. Br J Obstet Gynaecol 2001;108:993–9. 25 Katbamna S, Baker R, Ahmad W, et al. Development of guidelines to
23 Preston C, Cheater F, Baker R, et al. Left in limbo: patients’ views on
facilitate improved support of South Asian carers by primary health care
care across the primary/secondary interface. Qual Health Care
teams. Qual Health Care 2001;10:166–72.
1999;8:16–21.
SEMANTICS......................................................................................................
“Quality improvement”: noun or verb?
C
an a collection of activities be categorized as “quality in the continual improvement of the care they offer (www.jcaho.org).
improvement”? Is it research? Practice? Do we need to obtain For many, these expectations of professional action are not new, just
informed consent from patients if we are soliciting their restated in what seems like a more complex world. As we increasingly
feedback to change our practices? It started me puzzling on the evolu- calibrate our efforts by measured outcomes, we realize the broad array
tion of our use of language in the field. of actions that may be necessary to improve the quality of health care
The words we attach to ideas and experiences shape our thinking in complex systems. So, how should we think of the words “quality
about them.1 The terms “quality improvement”, “quality improve- improvement”?
ment project”, “QI tools”, “QI methods”, a “quality improvement When we use language to help give meaning and to make sense of
activity” and many other examples of using the words “quality” and situations, the words themselves take on new nuances to meet our
“improvement” in a noun or adjectival form have helped people to needs. By creating a vocabulary for the field of “quality improvement”,
name and understand what was new about some new activities and we need to avoid creating a world abstract and unrelated to the prac-
energies to change and improve health care. I wonder if the way we tical work of improving quality. We spend valuable energy debating
use these words is changing? whether or not some activity can or cannot be considered under the
The words “quality” and “improvement” are not new. From the noun heading “quality improvement”. More importantly, I suspect, is
early 14th century Latin “quālis” and the later French “qualitie”, our joining forces to take necessary action to improve the delivery of
modern word “quality” began its modern life as a word that referred health services. Let us think about “quality improvement” as a verb, as
to “of what sort?” and, since before 1400, “grade of excellence”. More action that we take to bring about better outcomes (ultimately) for
recently in the 17th century the root “enprowment” of our word patients. Let us judge our efforts as we evaluate other verbs—by their
“improvement” began by referring to “good or profitable use”. In 1647 effects on our patients and our systems.
the meaning of “betterment” is recorded and relates to a specialized P Batalden
meaning of improving land for better uses.2 Center for the Evaluative Clinical Sciences, Dartmouth Medical School,
As we used the words “quality improvement” initially in health care, Hanover, USA
they were associated with some constructs new to health care such as
“organization-wide quality efforts” which implied new roles for References
leaders.3–6 For some there were new ways of understanding health care 1 Pinker S. The language instinct. 1st ed. New York: Harper Perennial,
giving as a process and system,7 8 and for others there were new 1995.
“tools” such as flow charts or control charts.9 10 Initially it seemed 2 Barnhart RK, Steinmetz S. Chambers dictionary of etymology.
appropriate to me to use the words “quality improvement” to name or Edinburgh: Chambers, 1999.
define—as nouns do—a new category of ideas, methods, activities, 3 Deming WE. Out of the crisis. Cambridge, Mass: Massachusetts Institute
and other phenomena. of Technology Center for Advanced Engineering Study, 1986.
Today we are improving quality by taking actions. “Quality improve-
4 Juran JM. Managerial breakthrough; a new concept of the manager’s
ment” is no longer an abstract collection of ideas. We have some
job. New York: McGraw-Hill, 1964.
experience of translating these ideas into the real practice of health
care. We act to learn about and integrate the preferences of patients in 5 Mizuno S. Company-wide total quality control. Tokyo: Asian Productivity
Organization, 1988.
shared decisions about daily care. We act to understand and try tests
of change in the care systems where patients and caregivers meet. We 6 Feigenbaum AV. Total quality control. 3rd ed. New York: McGraw-Hill,
act to measure and learn from the study of variation in process and 1991.
outcome. We act to integrate caregivers from across disciplines and 7 Deming WE. The new economics for industry, government, education.
with information and information technology. Some wish to classify 2nd ed. Cambridge, Mass: Massachusetts Institute of Technology Center
or label these actions as “QI” for other purposes such as for external for Advanced Engineering Study, 1994.
review or for the purpose of getting informed consent. 8 Batalden P, Mohr J. Building knowledge of health care as a system.
This imperative—relentlessly to study and improve quality—has Qual Manage Health Care 1997;5:1–12.
been part of what it means to be a “health professional” from anti- 9 Plsek PE. Quality improvement project models. Qual Manage Health
quity to recent times.11 12 The Accreditation Council of Graduate Medi- Care 1992;1:69–81.
cal Education (ACGME) and the American Board of Medical Special- 10 Batalden PB, Stoltz PK. Performance improvement in health care
ties (ABMS) in the US have restated this recently in accrediting and organizations–a framework for the continual improvement of health care:
certifying procedures. For example, in the US it is expected that building and applying professional improvement knowledge to test
healthcare professionals be competent in “practice-based learning changes in daily work. J Qual Improve 1993;19:424–52.
and improvement” and “systems-based practice” as part of their 11 Hippocrates and Adams F. The genuine works of Hippocrates. London:
graduate medical education and certification (www.acgme.org and Sydenham Society, 1849.
www.abms.org). Organizations in the US that seek certification and 12 Nightingale F. Notes on nursing: what it is, and what it is not. London:
accreditation as healthcare organizations are expected to be engaged Harrison, 1860.
www.qualityhealthcare.com