Académique Documents
Professionnel Documents
Culture Documents
Santi Cots
santi.cots@udg.edu
Universitat de Girona
Servei Informtic
Mart Casadess
Professor
Universitat de Girona
Departament d'Organitzaci, Gesti Empresarial i Desenvolupament de Producte
Frederic Marimon
Associate Professor
Universitat International de Catalunya
Faculty of Economics and Social Sciences
Abstract
Purpose - This paper explores the benefits perceived by organisations with certified ISO 20000 service
management systems. It intends to propose a classification of benefits and test the relationship between
that classification and general satisfaction of the standard.
Design/methodology/approach - The study is based on 105 responses to a survey on ISO-20000certified organisations in Spain. After a descriptive analysis of the sample, a structural equation model is
presented to test the hypothesis presented.
FindingsAccording to the model, ISO 20000 benefits can be divided between internal and external
benefits. The variables that best define each type of benefit are identified. Moreover, those factors are
proven to be related to general satisfaction with ISO 20000 certification and the existing correlation
between internal and external benefits.
Originality/valueIn light of the fact that there are few quantitative studies in the field of IT service
management, this paper contributes to a better understanding of the benefits related to its application.
Conversely, this paper shows how to apply the classification of internal and external benefits in the case of
ISO 20000 and proposes a model of causality between those benefits and satisfaction.
Keywords: ISO 20000; ITIL; Management standards; SEM.
Article Classification: Research paper
Introduction
Most of the benefits obtained from information technology (IT) result not only from the technology itself
but also from the services that can be built using it. In recent years, the perception of IT organisations as
technology providers has evolved to a perception of IT organisations as service-centred providers (Bitner,
2001; Cherbakov et al., 2005). Furthermore, several factors, such as an IT services ubiquity, pervasivity,
dependency and the investments involved (Ong and Chen, 2013), create a need to industrialise IT
services.
Proceedings of the 1 International Conference on Quality Engineering and Management, 2014
st
manage service level, reporting, continuity and availability, budgeting and accounting, capacity,
information security, business relationship, suppliers, incidents and service requests, problems, changes,
configuration and finally, release and deployment (Cots and Casadess, 2013).
Methodology
The research presented here is based on data gathered from a survey administered between May and
July of 2013 to all of the known and contactable ISO-20000-certified companies in Spain.
To design the survey questionnaire, in addition to information describing each organisation assessed,
we compiled from the literature a list of concepts related to motivations, key success factors, benefits and
integration. The actual questions, specifically those related to benefits, were adapted from previous works
on other management standards, specifically those of Buttle (1997), Corbett et al. (2003) and Disterer
(2012). Each question was formed using a common introductory sentence plus a specific question about
how ISO-20000 certification contributed to obtain various defined benefits. To verify the tool, a pilot test
was conducted with 9 experts (3 academics and 6 practitioners) and then revised based on their
contributions.
Another issue involved building a list of participants. The uncertainty in the number of organisations to
survey was due to the lack of an official register of certificates. Unfortunately, no register of certificate was
available either in Spain or globally. For this study, a list of ISO-20000-certification registers was
Proceedings of the 1 International Conference on Quality Engineering and Management, 2014
st
constructed and (to a large extent) verified by starting with an unofficial list, then conducting an exhaustive
Internet search (including search engines and social networks) and finally soliciting help from several
consulting firms and support from the Spanish chapter of the itSMF (IT Service Management Forum). This
process provided us with confidence that the number of certified organisations in Spain was close to 186
at the time of the survey. We attempted to contact the organisations through every means possible, but
generally by attempting to obtain an email address, which we did for 149 organisations, and that was the
number of surveys that ultimately were sent.
One hundred and five valid responses were collected, each from a qualified individual in one of the
selected organisations. A descriptive analysis of the data gathered is presented in the results section,
specifically focusing on the benefits archived. However, a complete descriptive analysis of the study is
available in our final research report (Cots, 2014).
The methodology used to assess the aforementioned hypotheses is based on structural equation
modelling (SEM). SEM analysis is a multivariate statistical technique that is broadly used in the literature,
which aims to explain causality based on covariance analysis. The analysis is split into two steps. The first
aim is to validate a scale to assess the benefits of implementing the standard. Once that is established,
the second step analyses the extent to which the benefits are antecedents of satisfaction in using the
standard.
Once the first step was concluded and the dimensions of the benefits were established, hypotheses
H1 and H2 were analysed. The final three hypotheses were tested in the second step, in which a model in
which the benefits dimensions are antecedents of satisfaction was analysed, again using an SEM
technique. The main limitations of this study, which are very common in this type of research, were the
specificities of the Spanish certification market, the size of the sample and the overlap in benefits arising
out of the standard versus benefits arising out of the certification itself.
With respect to the first limitation, we note that the Spanish ISO-20000-certification market was
encouraged through public funding. Avanza and Avanza2, two now-complete public programs,
provided qualified companies with an opportunity to become certified at no cost. Although the funding
source should have only a small impact on the benefits obtained, it is clear that public funding may have
affected the composition of the certified population because it is likely that some organisations would not
have sought certification if they had been required to assume its cost. Moreover, the existence of public
funding provided consulting firms with a powerful argument to sell certification projects.
The size of the studys sample is a consequence of its scope. Although Spain is a country with a high
concentration of certified organisations (Cots and Casadess, 2014) and the response rate was high, the
total number of certificates in Spain is obviously limited. Anyway, according to Iacobucci (2010), when
cites to Anderson and Gerbing (1984) three or more indicators per factor, a sample size of 100 will
usually be sufficient for convergence, going even further when noting: It is of some comfort that SEM
models can perform well, even with small samples (e.g., 50 to 100). The vague, folklore rule of thumb
considering requisite sample size, e.g., n>200 can be conservative, and is surely simplistic. (Iacobucci,
2010). Taking that into consideration, and being obvious that bigger sample sizes are always better when
it comes to SEM analysis, a sample of 105 should be enough to perform the analysis and to take the
results into consideration.
Another obvious limitation is that all of the participating organisations were certified; thus, there was
no way to distinguish between the benefits obtained from the standard and those obtained from the
certification itself. Whether a particular benefit can be obtained without certification depends on the nature
of that benefit. Obviously, it is not necessary to obtain a certification to derive the benefits of the use of the
standard; however, use of the standard provided the study with certainty. We chose to accept this tradeoff.
Findings
The above-mentioned survey provided us with the ability to study the benefits of certification and its
relationship with motivations and general satisfaction. Thus, first there is a description of the
characteristics of the participating organisations. Second, an exploratory factor analysis was conducted
and a confirmatory model of benefits was created to determine latent factors. Finally, a more complete
model was created to test the relation between those factors and general satisfaction with the
implementation of ISO 20000.
Sector
IT
Science and technology
Education/universities
Transportation
Energy
Industry/manufacturing
Financial services/ insurance
Distributions
Number of employees
<10
10-40
50-250
>250
Employees in IT department
<10%
10%-49%
50%-95%
>95%
Offering consultancy or training on ISO 20000
Yes
No
Ownership
Public
Private
Users of services under certification scope
External clients
Other organisations
Internal users
Used public grant to certify
Yes
No
Implementation project cost
<501
501-3,000
3,001-6,000
6,001-18,000
18,001-60,000
>60,000
84.8%
7.6%
2.9%
1%
1%
1%
1%
1%
21%
44%
18%
17%
21%
21%
40%
18%
32%
68%
7%
93%
67%
47%
57%
60%
40%
9%
12%
7%
28%
29%
16%
The average duration of an implementation project is 8.29 months, with projects ranging from 2 to 24
months and the most common duration lasting 6 months. In any case, relatively few projects last longer
than one year.
Analysing the cost of implementation projects and also the recurring or maintenance cost, it is
noteworthy that the response rate for these questions was by far the lowest in the study, with only 69 valid
responses. It is interesting to see that 54% of organisations report having dedicated less than 500 to the
purchase of tools, most likely either because these tools were already owned at the time of project
implementation or because the organisations used tools that were free or practically so. 25% used tools
that cost more than 500 but less than 3,000, which, together with the previous cases, shows that in
79% of cases that can be considered, the cost of tools was reduced. Conversely, the number of
companies that invested in costly tools is not negligible.
With respect to the total cost of implementation, grouping the companies that declare a project cost,
including tools, of lower than 3,000 (21%) seems to prove that it is possible to implement ISO 20000
and obtain certification at a cost lower than previous standards (Karapetrovic et al., 2010). Conversely,
45% of companies declare more than 18,000 as the cost of implementation. Finally, with respect to
maintenance costs, the pattern is repeated: 45% of companies spend more than 6,000 per year on the
management system (including tools), whereas another 45% invest virtually nothing (less than 500).
Finally, the lack of similar data and studies in the ITSM field makes it very difficult to determine the
representativeness of the sample at a global level, even when it includes a majority of Spanish
organisations. The mere existence of public grants could make a difference in the Spanish market
compared with others.
10
Based on the variables that explain each factor, it is feasible to identify those variables as internal and
external benefits coherent with the literatures existing classification for benefits provided by other
standards (Tsiotras and Gotzamani, 1996; Casadess et al., 2001). Mapping the first factor to internal
benefits and the second to external benefits, and having evaluated consistency, H1 and H2 are accepted:
It is clear that ISO-20000 implementation produces internal and external benefits, just like the
implementation of other management standards.
Causal Model
Once the latent variables have been determined, the model proposed, as presented in Figure 1, includes
the directly measured global satisfaction variable, allowing testing of H3, H4 and H5. The results are
presented in Table 3. The indices of goodness of fit vouch for the conclusions drawn from it: the SatorraBentler scaled chi-square is 60.60 on 52 degrees of freedom and its associated probability value is 0.194;
the comparative fit index (CFI) is 0.981; and the root mean-square error of approximation (RMSEA) is
0.041. Together, these results allow us to relay the analysis and accept H3, H4 and H5. Consequently,
this analysis shows that the internal and external benefits of ISO 20000 have a positive impact on
satisfaction while making it possible to detect a clear, positive relation between internal and external
benefits.
B.CONTI
B.STD
B.PLAN
B.MRKT
B.EXIG
EXTERNAL
INTERNAL
BENEFITS
BENEFITS
B.CULT
B.REC
B.COMP
B.INC
H
B.KNOL
SATISFACTION
B.PROF
Coefficient t-value
0.37
3.56
0.39
3.87
0.43
3.31
Conclusions
In addition to the characteristics of the sample of Spanish organisations that have certified their servicemanagement systems according ISO 20000 in Spain, which can be more or less similar to those in other
countries, this research is the first to arrive at certain conclusions in a brand new field: the benefits of
implementing ISO 20000.
Proceedings of the 1 International Conference on Quality Engineering and Management, 2014
st
11
First, the order of agreement in the list of benefits itself provides evidence of the benefits that are
clearly perceived, enabling those interested to advance the positive results of certification. It is relevant to
underline that the majority of the analysed concepts are perceived as benefits of the implementation of
the standard. The results are clearly positive.
Second, it is feasible to classify the benefits of ISO 20000 into internal and external categories and to
identify variables that best describe those benefits. Namely, external benefits can be defined, considering
their importance order as marketing benefits, responding to customers and their exigencies, and obtaining
a competitive advantage. In parallel, internal benefits can be defined from more to less important, as
improving services, supporting service standardisation, increasing the ability to plan and control,
establishing a quality culture, improving the capacity to recover from an accident, reducing incidents and
enabling the retention of an organisations knowledge.
Finally, this research shows that internal and external benefits make an important contribution to
satisfaction, facilitating the interpretation of more relevant benefits and showing which of those benefits
have a greater impact on satisfaction. The expected correlation between internal and external benefits
verifies that frequently, benefits are not isolated and organisations that perceive one type of benefit
frequently also perceive others; consequently, such organisations obtain satisfaction from ISO 20000
implementation and certification.
Conversely, even in light of this studys limitations and exercising necessary caution, our results on the
benefits of ISO 20000 could be, to some extent, considered as generic benefits of ITSM techniques (for
example, as with ITIL), and thus, more investigation of this field should be conducted.
References
Agrasala, V. (2013), ISO/IEC 20000 for Generic (IT & Non-IT) Service Management? | Vinod
Agrasalas ITSM / ITIL Blog. Available from: http://vagrasala.wordpress.com/2013/02/28/isoiec-20000for-generic-it-non-it-service-management/.
Anderson, J. C., & Gerbing, D. W. (1984). The effect of sampling error on convergence, improper
solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika,
49(2), 155173.
Bitner, M.J. (2001), Service and technology: opportunities and paradoxes Managing Service Quality
Vol. 11, No 6, pp. 375 379.
Buttle, F. (1997), ISO 9000: marketing motivations and benefits International Journal of Quality &
International Journal of Quality & Reliability Management Vol. 22, No 2, pp. 120136.
Casadess, M., Gimnez, G., and Heras, I. (2001), Benefits of ISO 9000 implementation in Spanish
industry European Business Review Vol. 13, No 6, pp. 327336.
Cater-Steel, A. (2009), Information technology governance and service management: frameworks and
adaptations, Information Science Reference,.
Cherbakov, L., Galambos, G., Harishankar, R., Kalyana, S., and Rackham, G. (2005), Impact of
service orientation at the business level IBM Systems Journal Vol. 44, No 4, pp. 653668.
Corbett, C.J., Luca, A.M., and Pan, J.-N. (2003), Global perspectives on global standards ISO
Acadmico Internacional en Gobierno y Gestin del Servicio de TI, itSMF Espaa Madrid,.
Cots, S. (2014), Impacto de ISO 20000. Un estudio emprico, Documenta Universitaria, Girona.
12
Cots, S., and Casadess, M. (2013), Implementing ISO 20000: proposals from learned lessons
13
Piskar, F., and Dolinsek, S. (2006), Implementation of the ISO 9001: from QMS to business model
14