Académique Documents
Professionnel Documents
Culture Documents
Access to this document was granted through an Emerald subscription provided by emerald-srm:543713 []
For Authors
If you would like to write for this, or any other Emerald publication, then please use our Emerald for
Authors service information about how to choose which publication to write for and submission guidelines
are available for all. Please visit www.emeraldinsight.com/authors for more information.
About Emerald www.emeraldinsight.com
Emerald is a global publisher linking research and practice to the benefit of society. The company
manages a portfolio of more than 290 journals and over 2,350 books and book series volumes, as well as
providing an extensive range of online products and additional customer resources and services.
Emerald is both COUNTER 4 and TRANSFER compliant. The organization is a partner of the Committee
on Publication Ethics (COPE) and also works with Portico and the LOCKSS initiative for digital archive
preservation.
Abstract
Purpose – The purpose of this article is to discuss Portuguese academics’ views on quality assessment
and the elements that are important for a better understanding of what ascribes meaning to “quality
cultures” in Portuguese higher education.
Design/methodology/approach – The discussion was based on the results of a survey run in 2010
among Portuguese academics on quality assessment objectives and purposes. Descriptive statistics
was used to investigate academics’ support to what quality assessment was supposed to guarantee (its
purposes) and which should be its objectives. Furthermore, a factorial analysis using Promax rotation
(oblique) was performed to investigate if the different purposes could be grouped according to the
different areas they address in terms of quality assessment, helping to uncover a rationale that could
explain the answers obtained. Theoretically, the results have been analysed in the light of the “quality
culture” concept.
Findings – Perceptions of Portuguese academics that support internal processes of quality assurance
correspond either to the responsive quality culture or the regenerative quality culture. The viable form
of ideal cultures is analytically limited, and the perceptions gathered encourage “quality cultures”
biased by stronger group control.
Originality/value – The paper offers new insights into academics’ perceptions on quality
assessment, a theme that so far has been relatively absent from higher education quality assurance
studies. Furthermore, the results obtained could be useful to policymakers and quality assurance
agencies when setting up evaluation and accreditation systems capable of balancing improvement
associated with the group dimension and accountability coupled with the grid dimension.
Keywords Quality culture, Quality management, Quality assurance, Quality systems, Quality
assessment, Perception of Portuguese academics, Portuguese academia
Paper type Research paper
Quality Assurance in Education
Vol. 22 No. 3, 2014
The research was supported by a grant from the Fundação para a Ciência e Tecnologia under the pp. 255-272
© Emerald Group Publishing Limited
framework of the project Perceptions of Higher Education Institutions and Academics to 0968-4883
Assessment and Accreditation (PTDC/ESC/68884/2006). DOI 10.1108/QAE-05-2013-0020
QAE Introduction
Although quality assessment and accreditation systems have been in operation for a
22,3 number of years, there are no extensive studies either on their effects on teaching quality
or on the different reactions linked to academic tradition or to the norms and values of
disciplines, schools or higher education institutions (HEIs). This might be explained
Downloaded by BAHRIA INSTITUTE OF MANAGEMENT & COMPUTER SCIENCE At 00:11 30 September 2015 (PT)
because isolating the effects of assessment from those of other processes impinging on
256 higher education is rather difficult (Harvey and Newton, 2004; Stensaker, 2003).
At the European level, the Bologna process and the initiatives undertaken under its
quality framework resulted in the progressive development of European accreditation
systems. Portugal was no exception, and a new accreditation system was implemented,
replacing the old system owned by HEIs (Rosa and Sarrico, 2012). The new system is
characterised by the implementation of assessment and accreditation of both study
programmes and institutions, coordinated by a new independent body – the Higher
Education Assessment and Accreditation Agency (A3ES). Accreditation assumed a
preponderant role as a way to assure that study programmes and institutions
accomplish minimum requirements granting their official recognition. Hence, this
implementation might challenge academics, as decisions may have more concrete
consequences than in the previous system. Furthermore, this period entailed other
significant changes to the national legal framework, including a new law on the
governance of HEIs, which strengthened organisational rationales increasing the power
of managerial bodies, to the detriment of collegial bodies, the centralisation of
decision-making processes and the presence of external stakeholders at central- and
middle-management levels (Amaral et al., 2013). Therefore, the governance reform has
resulted in the decline of institutional policies and strategies aiming at reinforcing social
capital, including collegial decision-making processes with possible impacts on the
involvement of Portuguese academics in the implementation of the new quality
assessment system.
The transition from the old quality assessment system dismantled in 2005 to the new
accreditation system created in 2008 and beginning operation in 2009/2010 offered an
opportunity to analyse how Portuguese academics perceived quality assessment.
Previous research focusing on the impact of the Portuguese quality assessment system
showed the low influence of the organisational environment on academics’ perceptions
about quality assessment, probably due to the influence of disciplinary cultures (Veiga
et al., 2011). Nevertheless, as the transition phase is bringing changes to institutional
processes and structures, it is expected that quality culture and quality assurance will be
debated.
The concept of quality culture in an institution
[…] reflects not only an orientation towards the needs of its stakeholders, but also an
internality that supports its staff in the fulfilment of their duties (whether these are internally
– or externally – directed) (Yorke, 2000, p. 21).
The internal dynamics within HEIs emerge at the crossroads of stimulating internal
quality assurance processes and responding to the requirements of external quality
assurance systems requirements.
The results from a European survey conducted by the Examining Quality Culture
project showed that only 14.4 per cent of the surveyed universities recognised that the
concept of an institutional quality assurance system was introduced as the result of
various consultations with the academic staff (Loukkola and Zhang, 2010). Previous Quality cultures
research with regard to the Portuguese context (Veiga et al., 2013) indicated that the lack
of academics’ involvement generated disagreement about the existence of internal
in the Portuguese
processes of quality assurance. This brings to the fore the question of which are the context
quality culture or cultures supported by academics to further understand the way the
inner dynamics evolve to implement internal quality assurance systems.
Downloaded by BAHRIA INSTITUTE OF MANAGEMENT & COMPUTER SCIENCE At 00:11 30 September 2015 (PT)
This article starts by establishing the link between quality culture and quality 257
assurance resorting to cultural theory to describe the existence of four organisational
biases that support the “quality cultures” (Harvey and Stensaker, 2008) to be found in
HEIs. In the second part, starting from the assumption that academics’ perceptions
contribute to understanding their interpretation of quality assessment systems’
objectives and purposes, research findings will be analysed to explore the extent to
which these perceptions are ascribing meaning to “quality cultures”.
This study could be considered as a follow-up to earlier studies on the impacts of the
Portuguese quality assessment system (Rosa et al., 2006; Veiga et al., 2011; Veiga et al.,
2013) exploring a new dataset.
autonomous are viewed as irrelevant, as they reject the social environment (Thompson,
258 et al., 1990).
Altman and Baruch (1998) contended that the cultural theory could be used in a
large diversity of situations, ranging from theatre to geology (Douglas, 1982), from
ecology (Douglas and Wildavsky, 1983) to industrial safety (Gross and Rayner,
1985) and risk behaviour (Douglas, 1992). The cultural theory has also been used in
education. For instance, Maassen (1996) compared specific values and beliefs of
German and Dutch academics; Frølich (2005) analysed the implementation of New
Public Management in Norwegian universities; Jackson and George (2005) studied
organisational culture; and Veiga and Amaral (2008) analysed how the Bologna
process coped with the national traditions of HEIs. In the field of higher education
quality assurance, Harvey and Stensaker (2008) got a step ahead by developing the
concept of “quality cultures” anchored in the cultural theory.
Within the assumptions of the cultural theory, there is the idea that to be meaningful,
grid and group dimensions should be stable and continuous. Another postulate
highlights that individuals should support their culture. Only when the conditions
related to grid and group dimensions change will individuals adapt their preferences.
Furthermore, the cultural theory assumes that the four cultural biases coexist
(Thompson, et al., 1990) and that viable forms of social solidarity “will be found, in
varying strengths and patterns of interaction, in any social system” (Thompson et al.,
1999, p. 2) The analytical added value of this approach is the limited number of “quality
cultures” that are to be found in HEIs, reducing the intricacy of the concept.
According to Harvey and Stensaker (2008), four “quality cultures” are to be found in
HEIs (see Table I). The fatalist organisational bias promotes a reactive quality culture
establishing informal quality assurance processes and superficial quality commitment.
This ideal-type reacts to external demands and is driven by compliance. The quality
culture promotes little or no sense of ownership. The hierarchical bias induces a
responsive quality culture by promoting centrally managed quality assurance processes,
inducing high-quality commitment driven by external demands. This ideal type has an
improvement agenda for quality assurance aware of both accountability issues and
compliance requirements to deal with an issue created externally. The responsive quality
culture appears to succeed in the adoption of good practices. The individualist bias
develops a reproductive quality culture, promoting quality assurance processes that
encourage individual action and overlook quality commitment. This quality culture
grounds in a sense of a job well done that is used to perpetuate the status quo and reflects
the expertise and individual ambition of members. The egalitarian bias endorses a
regenerative quality culture based on internal developments and high-quality
commitment based on membership and aligned with the aspirations of all the members.
This ideal type takes the improvement agenda as a re-conceptualisation process to
frame future direction, and improvement is seen as taken for granted, generating
autonomy for reflective review.
Grid ⫹/group ⫺ Grid⫹/group ⫹
Quality cultures
in the Portuguese
Fatalist Hierarchical
Isolate, informal, superficial connection Controlled and centrally managed, tasks are context
previously defined
Reactive quality culture Responsive quality culture
Downloaded by BAHRIA INSTITUTE OF MANAGEMENT & COMPUTER SCIENCE At 00:11 30 September 2015 (PT)
Reacts, rather than engages with external Led by external demands the institution has the
demands opportunity (or is forced) to review practices
259
Grid⫺/group⫺ Grid⫺/group ⫹
Individualist Egalitarian
Open, the system emerges spontaneously Enclave, closed, built based on fellowship, respect
from individual action for all members
Reproductive quality culture Regenerative quality culture Table I.
Focus on reproducing the status quo and Focus on internal developments, albeit fully aware Combination of
minimising impacts of the external context and expectations grid/group, ways of life
and ideal types of “quality
Source: Adapted from Thompson et al. (1990) and Harvey and Stensaker (2008) culture”
To understand which “quality cultures” are held by Portuguese academics, this paper
analyses their views on the objectives and purposes of quality assessment. Both
objectives and purposes underline different dimensions of quality assurance and of
“quality cultures”, addressing the responsiveness to the society’s needs and the internal
dynamics of HEIs. Objectives are the aims that could be accomplished through the
implementation of a quality assessment system and purposes assemble a set of
intentions that might support the development of such a system.
For the purpose of this paper, only the first two groups of questions were taken into
consideration. The questions included in them (5 for the objectives – see Table I, and 29
QAE for the purposes – see Table AI in Appendix 1) were chosen to address the research
question related to this paper.
22,3 A census was the chosen strategy to collect data. All Portuguese HEIs (more
precisely their rectors and presidents) were approached and asked to distribute
information on the research project, including a link to the online questionnaire, among
their academics. A total of 1,782 answers were obtained, corresponding to a response
Downloaded by BAHRIA INSTITUTE OF MANAGEMENT & COMPUTER SCIENCE At 00:11 30 September 2015 (PT)
260 rate of around 5 per cent. In terms of sample distribution (excluding missing data), the
four higher education sub-systems were represented, although with an
overrepresentation of the public system (90.4 per cent), especially public polytechnics
(45.4 per cent), in relation to the population distribution. Furthermore, the sample
comprised both female (44 per cent) and male (56 per cent) academics, from different age
groups (the most significant being the 40-49 – 36 per cent – followed by the 30-39 – 28 per
cent), with different academic degrees (academics holding a doctoral degree are the most
strongly represented: 46.9 per cent), levels of involvement in quality management
activities within their institutions (only 25.5 per cent had been engaged) and belonging
to different scientific areas (although mostly from Engineering and Technology – 26 per
cent – and Social Sciences – 28 per cent).
According to the available data (GPEARI/MCTES, 2010) for the Portuguese
population of academics (36,215), we can say that the sample characteristics reproduced
the population for gender and age groups (56 per cent of Portuguese academics are male,
while 44 per cent are female, whereas the highest percentage was found for the age
group 40-49 years old – 34 per cent – followed by the group 30-39 – 29 per cent). However,
the academics’ distribution by the four sub-systems presented a clear
over-representation of the public sector in the sample (in the population, 41 per cent of
the academics belong to public universities, 28 per cent to public polytechnics, 19 per
cent to private universities and 12 per cent to private polytechnics). For the remaining
characteristics, there was no data available for the population.
Although the response rate is low and the sample is not representative of the
Portuguese academic population, which poses some limitations regarding the
generalisation of results to the overall academics’ population, the size of the sample and
the detail of the data gathered provide a rich source to explore the way Portuguese
academics perceive higher education quality assessment.
Descriptive statistics were used to investigate academics’ support for what quality
assessment was supposed to guarantee (its purposes) and which should be its
objectives. Furthermore, a factorial analysis using Promax rotation (oblique) was
performed to investigate if the different purposes could be grouped according to the
different areas they addressed in terms of quality assessment, helping to uncover a
rationale that could explain the answers obtained. The reason to opt for an oblique
rotation lay in the fact that the factors extracted were correlated.
Empirical analysis
Higher education quality assessment objectives
All the objectives for higher education quality assessment suggested in the
questionnaire were supported to a certain extent by the academics (all means were
approximately 2.9 or higher) (see Table II). The perceptions gathered revealed that
academics tended to totally agree with quality assessment as a way to ensure the
continuous development of higher education quality (mean of 4.2 and median of 5.0).
Conversely, the establishment of a system of penalties and rewards based on quality Quality cultures
assessment results was the objective displaying lower agreement (mean of 2.9 and
median of 3.0).
in the Portuguese
Agreement with propositions related to continuous improvement and innovations context
generated within HEIs brought to the fore the implementation within institutions of
more or less formalised internal quality assurance processes and systems. In a number
Downloaded by BAHRIA INSTITUTE OF MANAGEMENT & COMPUTER SCIENCE At 00:11 30 September 2015 (PT)
of European countries, including Portugal, an effort has been made by the national 261
assessment and accreditation agencies to prepare and adopt guidelines for institutions
to set up such systems (most of them in consultation with the institutions and other
interested parties). This was especially the case where institutional audits of internal
quality assurance systems were in place. Additionally, the European Standards and
Guidelines for quality assurance, with an associated set of guidelines for each one of the
seven standards for internal quality assurance, also provided indications for the
institutions to set up their own systems.
In the Portuguese case, institutional audits of internal quality assurance systems
were set in the law on quality passed in 2007, although they had not yet been
implemented when the questionnaire was run. These systems will be certified by the
A3ES, and most HEIs were already developing (or intended to do so in the near future)
their own internal quality assurance systems, trying to comply with the national
legislation. Therefore, it will be interesting to analyse this aspect as the answers of
Portuguese academics, which, although showing agreement with the statement that the
adequacy of the higher education system to European rules is an objective of quality
assessment, did not emphasise its importance (responses with a mean of 3.4 and a
median of 3).
assurance systems as well as the development of teaching staff skills also attracted high
262 agreement (means of 4.2 and medians of 4).
Providing students with information on the teaching quality to allow them to make
choices, providing the management and governance bodies with information on
institutions’ quality so they could take decisions, improving links between teaching and
research and promoting the improvement of student support systems, also mustered a
strong agreement among academics (means of 4.1 and medians of 4). Finally, increasing
academics’ involvement in teaching and learning issues and facilitating the adoption of
new methodologies for teaching and learning, were also purposes receiving significant
acceptance (means of 4.0 and medians of 4).
The topics gathering less agreement were mainly focused on aspects that reinforced
regulation instruments enacted either by the Government or by the institutions’
management and governance bodies (all with medians of 3). This was the case, for
example, of quality assessment allowing the Government to allocate resources to each
institution based on the assessment results (mean of 3.4), promoting the cooperation
between academic and non-academic staff, allowing governance bodies to define
sanctioning policies for inadequate practices, having effects on the HEIs’ criteria for
student selection (all three with means of 3.3) or providing the State with instruments
to control the higher education network and having effect on HEIs’ criteria for
non-academic staff recruitment and promotion, both presenting the lower mean
scores (3.2).
Trying to uncover links between the different purposes, we have used factor analysis
to identify which factors could explain most of the variance observed in the academics’
answers. The factor analysis conducted on the data collected revealed five factors with
eigenvalues ⬎ 1 (corresponding to 60.8 per cent of total variance explained). Factor
analysis resulted, then, in a purposes scale, consisting of 29 items (the sentences
designed to materialize the different purposes of quality assessment) and five subscales,
each one corresponding to one of the five extracted factors (see Table III and Table AI in
Appendix 1). The items for each subscale were selected based on their loadings on each
one of the extracted factors. All loadings ⬎ 0.3 were considered to be significant
(according to Hair et al., 1998, this is the threshold value when sample sizes are ⬎ 350).
Whenever an item presented loadings ⬎ 0.3 in more than one factor, the decision was to
allocate it to the factor where the loading was higher. Nevertheless, the analysis of each
reproducing the status quo, while penalties minimise the impact of external factors. In
264 the perception of our respondents, the reproductive quality culture was less supported.
Apparently, they did not credit this “quality culture” as a result of a system generating
consequences. Looking at the purposes, the same conclusion can be drawn because the
quality monitoring and control subscale was the one less supported. This subscale
encompasses a significant number of purposes aligned with the reproductive quality
culture: quality assessment should:
• allow governance bodies to define sanctioning or rewarding policies for inadequate
practices;
• have effects on the HEI’s criteria for academic recruitment and promotion; and
• promote the existence of control mechanisms of the performance of academics.
In this vein, the academics surveyed would not support a “quality culture” aiming at
perpetuating the current state of affairs.
The reactive quality culture develops ad hoc quality assurance processes
grounded on unplanned relationships envisaging quality commitment. The
objectives of quality systems promoted by a reactive quality culture are related to the
adequacy of externally driven norms and rules. Portuguese academics did not
strongly agree that higher education system’s adequacy to European rules is an
objective of higher education quality assessment. Hence, the quality culture
supported by the academics surveyed would avoid being driven just by compliance.
Interestingly, the set of intentions behind the development of quality assessment
systems taken in the trustworthiness subscale overlaps elements of reactive and
responsive quality cultures. Other subscales also embrace elements of different
“quality cultures” as will be argued later. The idea that quality assessments systems
should allow for the closure of study programmes that have no quality based on its
accreditation and allow the government to allocate resources to institutions based on
the assessment results facilitates ascribing meaning to this “quality culture”. At the
same time, the perceptions gathered revealed less agreement with regard to these
purposes behind quality assessment, reflecting disagreement about a quality
culture that simply reacts to external demands.
The responsive quality culture might evolve as:
[…] something created to deal with the evaluation problem, a solution to an issue created by
others. This is likely to be exacerbated internally by a lack of buy-in to a quality culture as a
way of life and lack of feeling of ownership, or of any real control (Harvey and Stensaker, 2008,
p. 436).
Developments led by external demands and the implementation of an improvement
agenda for quality assurance were elements of this quality culture. With regard to
the objectives of higher education quality systems, ingredients of the responsive
quality culture were supported. The objectives of continuous development of higher
education quality associated with an improvement agenda and of accountability to Quality cultures
society on higher education quality reflecting developments driven by external
requirements were the most favoured. The purposes that may be behind the quality
in the Portuguese
assessment systems are included in the quality assurance processes subscale. The context
ones reflecting that quality assessment systems should allow the academic
community to know and reflect on the institution’s quality so strategies to improve
Downloaded by BAHRIA INSTITUTE OF MANAGEMENT & COMPUTER SCIENCE At 00:11 30 September 2015 (PT)
can be defined and allow HEI governance bodies to promote continuous quality 265
improvement processes for teaching/learning contributed to ascribe meaning to the
responsive quality culture. The regenerative quality culture “tends to be widespread,
with clear overall goals, in a state of flux as activities and events evolve” (Harvey
and Stensaker, 2008, p. 437). The objective of quality assessment systems fitting the
development of innovations generated within HEIs is oriented towards continual
improvement processes engaged with the re-conceptualisation of what is known,
thus endorsing this quality culture. The perceptions gathered underlined the
importance of quality commitment of institutional actors as the purposes subscale
contributing more to ascribe meaning to this quality culture. Internal developments
are coordinated towards internal regeneration and focusing on the renewal of
quality assessment processes. Hence, the intentions behind quality assessment
systems addressing the improvement of the links between teaching and research and
the reward of academics’ innovative practices promote the regenerative quality
culture.
The perceptions gathered also revealed that the purposes of quality assessment
systems subscales are made of ingredients associated with different “quality cultures”.
Actually, it was not possible to identify purposes subscales featured by elements of a
single quality culture.
The quality assurance processes subscale includes elements of the responsive, the
regenerative and reproductive quality cultures. The engagement with external
demands (e.g. provide information about the institution to an external entity for
accreditation purposes), the internal regeneration behind the purpose of contributing
to the collective and shared identification of the institution’s strengths and
weaknesses and the reproduction of status quo allowing governance bodies to allocate
resources, based on quality assessment results, ascribe meaning to these “quality
cultures”, respectively.
The Quality Improvement of Teaching and Learning subscale also took in
elements of the reproductive, the regenerative and the responsive quality cultures.
The purpose behind the quality assessment system favouring the development of
academics’ individual skills promoting what the institution does best, the promotion
of institutional policies for the development of new technologies and learning
practices emphasising the re-conceptualisation and the improvement of student
support systems under the framework of an enhancement agenda, contributes to
understand how the Quality Improvement of Teaching and Learning triggers
elements of the three quality cultures.
The subscales quality monitoring and control and quality commitment of
institutional actors, although they include elements of different “quality cultures”,
are dominated by elements of a single quality culture. While the quality monitoring
and control subscale is mostly dominated by elements of the reproductive quality
culture, the quality commitment of institutional actors is characterised by more
QAE elements of the regenerative quality culture. The quality monitoring and control
subscale appears to be associated with the reproduction of the status quo (e.g.
22,3 promote the existence of control mechanisms of the performance of the academics)
and the quality commitment of institutional actors is driven by internal
developments and the introduction of new practices (e.g. promote the cooperation
between academic and non-academic staff).
Downloaded by BAHRIA INSTITUTE OF MANAGEMENT & COMPUTER SCIENCE At 00:11 30 September 2015 (PT)
266
Conclusions
Perceptions of Portuguese academics that support quality assessment systems are to be
found in two “quality cultures”: the responsive quality culture – e.g. the continuous
development of higher education quality objective and purposes such as to allow the
academic community to know and reflect on the institution’s quality so strategies to
improve can be defined – and the regenerative quality culture – e.g. the development of
innovations generated within HEIs objective and the purpose of contributing to the
collective and shared identification of the institution’s strengths and weaknesses. The
forms of ideal cultures are analytically limited, and the perceptions gathered encouraged
“quality cultures” biased by stronger group control. The reproductive and the reactive
quality cultures stem from weak group control and were less supported by Portuguese
academics.
Research findings contributed to understanding which dynamics were currently
feeding the quality culture concept in the Portuguese context. Interestingly, we could not
find evidence of elements promoting a single “quality culture” within the purposes
subscales. Rather, different components of the four ideal types of “quality cultures” were
valued by Portuguese academics within the same purposes subscale. It is possible that,
as the survey included questions related to the four ideal types of “quality culture”, it has
induced a fragmented view on academics’ perceptions across the five purposes
subscales.
From a theoretical point of view, “quality cultures” stemming from the cultural
theory framework brought in the potential for a plurality of solutions and not the
adoption of a single pattern within HEIs. Similar to public management systems
“more likely to keep “hunting around” among the various types, as surprises and
disappointment over the capacity of one approach to deliver satisfactory results
leads to increasing support for one of the other options” (Hood, 1995, p. 111), in
quality assessment the development of a “quality culture” was expected to promote
a plurality of elements featuring it. This observation is particularly relevant for the
ongoing set up of the assessment and accreditation system by the Portuguese
agency that is foreseeing the possibility of implementing a “light touch” system
together with the promotion of internal quality assurance systems (Amaral et al.,
2013a). Nevertheless, the quality commitment of institutional actors subscale that
contributed to ascribe meaning to the regenerative quality culture did not gather
much agreement compared with other purposes. This finding challenges the
development of internal dynamics within HEIs to reinforce group control
mechanisms, while reducing the intensity of external rules.
From a different angle, unintended effects of “quality cultures” can be expected if a
specific quality culture is taken to the limits. The responsive quality culture could be seen
as a way to respond to an issue created by others (e.g. accreditation, implementation of
internal quality assurance systems) and “likely to be exacerbated internally by a lack of
buy-in to a quality culture as a way of life and lack of feeling of ownership or of any real Quality cultures
control” (Harvey and Stensaker, 2008, p. 437). However, the regenerative quality culture
has an intrinsic subversive potential “if regeneration stalls or is interfered with
in the Portuguese
externally, be it by a higher layer of management or by an external force” (Harvey and context
Stensaker, 2008, p. 437). Hence, the promotion of strong group-control mechanisms,
Downloaded by BAHRIA INSTITUTE OF MANAGEMENT & COMPUTER SCIENCE At 00:11 30 September 2015 (PT)
References
Altman, Y. and Baruch, Y. (1998), “Cultural theory and organizations: analytical method and
cases”, Organization Studies, Vol. 19 No. 5, pp. 769-785.
Amaral, A., Rosa, M.J. and Fonseca, M. (2013), “The Portuguese case. Can institutions move to
quality enhancement?”, in Land, R. and Gordon, G. (Eds), Enhancing Quality in Higher
Education. International Perspectives, Routledge, London.
Amaral, A., Tavares, O. and Santos, C. (2013a), “Higher education reform in portugal: a historical
and comparative perspective of the new legal framework for public universities”, Higher
Education Policy, Vol. 26 No. 1, pp. 5-24.
Douglas, M. (1970), Natural Symbols: Explorations in Cosmology, Pantheon Books, New York, NY.
Douglas, M. (1982), Essays in the Sociology of Perception, Routledge and Kegan Paul, London.
Douglas, M. (1992), Risk and Blame: Essays in Cultural Theory, Routledge, London.
Douglas, M. and Wildavsky, A. (1983), Risk and Culture: An Essay on the Selection of
Technological and Environmental Dangers, University of California Press, London.
Frølich, N. (2005), “Implementation of new public management in Norwegian universities”,
European Journal of Education, Vol. 40 No. 2, pp. 223-234.
Gross, J.L. and Rayner, S. (1985), Measuring Culture, Columbia University Press, New York, NY.
Hair, J.F. Jr., Anderson, R.E., Tatham, R.L. and Black, W.C. (1998), Multivariate Data Analysis, 5th
ed, Prentice-Hall, New Jersey.
Harvey, L. (2004-13). “Analytic quality glossary”, Quality Research International, available at:
www.qualityresearchinternational.com/glossary/.
Harvey, L. and Newton, J. (2004), “Transforming quality evaluation”, Quality in Higher Education,
Vol. 10 No. 2, pp. 149-165.
Harvey, L. and Stensaker, B. (2008), “Quality culture: understandings, boundaries and linkages”,
European Journal of Education, Vol. 43 No. 4, pp. 427-442.
Hood, C. (1995), “Contemporary public management: a new global paradigm?”, Public Policy and
Administration, Vol. 10 No. 2, pp. 104-117.
QAE Jackson, S. and George, P. (2005), “Organizational culture and the management of technological
change: a theoretical perspective”, ECIS 2005 Proceedings, Paper No. 149, availble at: http://
22,3 aisel.aisnet.org/ecis2005/149.
Kogan, M. (1999), “The culture of academe”, Minerva, Vol. 37 No. 1, pp. 63-74.
Loukkola, T. and Zhang, T. (2010), Examining Quality Culture: Part 1 – Quality Assurance
Downloaded by BAHRIA INSTITUTE OF MANAGEMENT & COMPUTER SCIENCE At 00:11 30 September 2015 (PT)
teaching/learning 1,720 4.0 4.2 1.0 0.645 0.066 0.469 ⫺0.242 ⫺0.017
Provide students with information
on the quality of teaching and
269
learning so that they can make
choices 1,698 4.0 4.1 1.0 0.395 ⫺0.014 0.085 0.111 0.366
Allow the governance bodies to have
information on the HEI’s quality so
they can take decisions 1,689 4.0 4.1 1.0 0.662 0.118 0.090 ⫺0.192 0.239
Allow the academic community to
know and reflect on the institution’s
quality so strategies to improve it
can be defined 1,700 5.0 4.3 0.9 0.720 ⫺0.125 0.237 ⫺0.071 0.052
Provide information about the
institution to an external entity, for
accreditation purposes 1,662 4.0 3.8 1.1 0.476 0.291 ⫺0.232 0.099 0.115
Contribute to the collective and
shared identification of the
institution’s strengths and
weaknesses 1,699 4.0 4.2 0.9 0.764 ⫺0.097 0.078 0.050 0.022
Contribute to the definition of new
routines and procedures 1,673 4.0 4.0 1.0 0.675 ⫺0.031 0.018 0.262 ⫺0.164
Promote the creation of quality
assurance internal systems 1,692 4.0 4.2 0.9 0.807 ⫺0.069 0.009 0.116 ⫺0.065
Contribute to the convergence of
teaching, research and management
processes and practices 1,676 4.0 3.9 1.1 0.469 ⫺0.064 0.059 0.455 ⫺0.097
Allow the governance bodies to
allocate resources, based on quality
assessment results 1,659 4.0 3.6 1.2 0.364 0.315 ⫺0.208 0.191 0.130
Subscale 5. Trustworthiness
Allow for the closure of study
programmes that have no
quality, based on its
non-accreditation 1,690 4.0 3.8 1.2 0.019 ⫺0.045 ⫺0.108 ⫺0.019 0.812
Publicly assure the
accountability of a higher
education system 1,714 4.0 4.0 1.0 0.059 0.028 0.163 ⫺0.027 0.694
Allow the government to
allocate resources to institutions
based on the assessment results 1,695 3.0 3.4 1.2 ⫺0.059 0.410 ⫺0.042 ⫺0.110 0.522
Notes: The most significant loadings for each item are signalled in bold; in italics we have signalled for each item the
remaining significant loadings. All loadings ⬎ 0.3 were considered to be statistically significant because our sample is ⬎ 350
Table AI. Source: Hair et al., 1998
Quality cultures
in the Portuguese
context
Quality Quality Quality improvement Quality commitment
Downloaded by BAHRIA INSTITUTE OF MANAGEMENT & COMPUTER SCIENCE At 00:11 30 September 2015 (PT)
Quality assurance
processes – 36.2 (0.000) ⫺0.4 (0.703) 24.6 (0.000) 15.6 (0.000) Table AIII.
Quality monitoring Paired sample t-tests for
and control – ⫺29.8 (0.000) ⫺12.0 (0.000) ⫺16.1 (0.000) statistical significant
Quality improvement
differences among the five
of teaching and
learning – 25.1 (0.000) 13.3 (0.017) subscales emerging from
Quality commitment the factorial analysis (t-
of institutional actors – ⫺3.1 (0.002) value and p-value for each
Trustworthiness – one of the 10 pairs)
currently the President of the Executive Board of A3ES. His main research interests lie in the areas
272 of governance, funding and quality assurance of higher education systems and their institutions.
He is member of the board of Institutional Management in Higher Education programme of the
Organisation for Economic Cooperation and Development (IMHE/OECD), former chair of CHER,
former Vice President of the steering committee of the IEP-EUA audit programme and life
member of International Association of University Presidents. He is author and co-editor of a
number of books, including: Reform and Change in Higher education: Analysing Policy
Implementation, 2005; From Governance to Identity, 2008; Essays on Supportive Peer Review, 2008;
European Integration and Governance of Higher Education and Research 2009; Higher Education
in Portugal 1974-2009. A Nation, a Generation, 2011.