Académique Documents
Professionnel Documents
Culture Documents
Lukasz Radlinski
Institute of Information Technology in Management
University of Szczecin
Szczecin, Poland
lukasz@radlinski.edu.pl
Abstract The main goal of this work is to build an expertdriven Bayesian network model for simulating and predicting
software quality. In contrast with earlier models, this model
represents software quality as a hierarchy of features and their
sub-features where the features are interrelated with other. It
contains a range of project and process factors that influence
particular quality features. It has been pre-calibrated using
results from the questionnaire survey performed among
software engineers and managers in various software
organizations. Managers in software projects can use such
model to simulate and predict various aspects of software
quality, typically at the early stage of project lifecycle.
Proposed may become a central part of the future decision
support system aimed to analyze, understand, manage and
optimize a software development process.
Keywords- Bayesian network, modeling, software quality,
expert knowledge, simulation, prediction
I.
INTRODUCTION
ISBN: 978-1-61208-254-7
26
eKNOW 2013 : The Fifth International Conference on Information, Process, and Knowledge Management
II.
BACKGROUND
A. Software Quality
Software quality is a combination of various features.
These features are often organized in a hierarchy. A variety
of such hierarchies, known as software quality models, have
been proposed in software engineering literature, starting
from early work by Boehm and McCall at the end of 1970s.
We use a hierarchy proposed in an ISO 25010 standard [6].
We chose it due to its popularity among researchers and in
industry and because it has been published very recently but
is based on an earlier 9126 standard thus it can be
considered as both mature and contemporary.
TABLE I.
Features
Functional suitability
Performance efficiency
Compatibility
Usability
Reliability
Security
Maintainability
Transferability
Effectiveness
Efficiency
Satisfaction
Sub-features
Functional completeness
Functional correctness
Functional appropriateness
Time behaviour
Resource utilisation
Capacity
Coexistence
Interoperability
Appropriateness recognizability
Learnability
Operability
User error protection
User interface aesthetics
Accessibility
Maturity
Availability
Fault tolerance
Recoverability
Confidentiality
Integrity
Non-repudiation
Accountability
Authenticity
Modularity
Reusability
Analyzability
Modifiability
Testability
Adaptability
Installability
Replaceability
Effectiveness
Efficiency
Usefulness
Trust
Pleasure
Comfort
Economic risk mitigation
Health and safety risk mitigation
Environmental risk mitigation
Context completeness
Flexibility
ISBN: 978-1-61208-254-7
Characteristic \ Model
# process activities
# of process factors per activity
# of project factors
# of quality features
# of levels in quality hierarchy
reflects software composition
A
3
3
0
8
1
no
B
3
3
3
13
2
no
C
1
18
6
8
2
no
D
1
18
3
13
3
no
E
3
18
6
13
3
yes
27
eKNOW 2013 : The Fifth International Conference on Information, Process, and Knowledge Management
Weight for
criterion
3
2
1
1
1
5
4.4
1.9
2.3
3.0
3.2
2.6
2.67
4.0
2.5
2.9
2.9
2.9
2.4
2.72
4.1
2.8
3.3
3.2
3.3
3.1
3.12
3.5
3.5
3.8
3.2
2.9
3.3
3.01
3.0
4.2
4.4
2.9
2.3
2.8
2.55
architecture
performance
efficiency
effectiveness
CASE tool
usage
compatibility
deployment
platform
efficiency
UI type
satisfaction
target market
freedom
from risk
usability
Quality Features
adjusted for
Project Factors
Hierarchy
of Quality
Quality Features
adjusted for
Process Factors
security
maintainability
used
methodology
transferability
project
difficulty
ISBN: 978-1-61208-254-7
context
coverage
Process factors
adequacy of
methods and
tools
defined
process
followed
team
organization
leadership
quality
distributed
communication
problems
skills
process
quality
requirements
stability
experience
process
difficulty
staff quality
motivation
overall
process
quality
education
Dependencies
between
Quality Features
Process
Factors
reliability
stakeholder
involvement
problems
effort
process
effectiveness
Features
of internal & external
quality
Features
of quality in use
28
eKNOW 2013 : The Fifth International Conference on Information, Process, and Knowledge Management
functional
completeness
context
coverage
efficiency
effectiveness
functional suitability
adjustment by process
functional
correctness
satisfaction
compatibility
freedom
from risk
Quality features
functional suitability
(1)
(2)
performance efficiency
(3)
compatibility
(4)
MODEL VALIDATION
security
performance
efficiency
maintainability
V.
functional
appropriateness
usability
Difference(feature_i) = Median(feature_iprediction_1)
Median(feature_iprediction_2)
(2)
0.06
(3)
0.20
(4)
0.20
(5)
0.12
(6)
0.14
(7)
0.17
(8)
0.11
(9)
0.55
(10)
0.53
(11)
0.38
(12)
0.21
(13)
0.46
0.07
0.11
0.07
0.09
-0.29
0.10
0.05
0.13
0.09
0.10
-0.05
0.11
0.12
0.06
0.36
0.11
0.10
0.22
0.11
0.16
0.14
0.18
0.12
0.15
usability
0.18
0.07
0.49
0.10
0.10
0.44
0.09
0.19
0.18
0.28
0.16
0.18
(5)
reliability
0.12
0.08
0.17
0.11
0.20
0.22
0.17
0.18
0.18
0.17
0.15
0.19
(6)
security
0.13
-0.26
0.15
0.11
0.18
0.20
0.16
0.15
0.17
0.15
0.42
0.18
(7)
maintainability
0.10
0.06
0.22
0.32
0.13
0.13
0.11
0.16
0.13
0.16
0.14
0.18
(8)
transferability
0.10
0.04
0.16
0.09
0.16
0.16
0.17
0.15
0.15
0.15
0.10
0.15
(9)
effectiveness
0.38
0.09
0.17
0.14
0.12
0.11
0.17
0.11
0.37
0.29
0.17
0.29
(10) efficiency
0.34
0.05
0.14
0.12
0.11
0.11
0.13
0.10
0.35
0.21
0.14
0.25
(11) satisfaction
0.23
0.06
0.17
0.19
0.10
0.10
0.16
0.09
0.28
0.20
0.12
0.21
0.11
0.32
-0.03
0.07
0.11
0.15
0.09
0.12
0.08
0.11
0.25
0.11
0.12
0.17
0.06
0.09
0.14
0.29
0.12
0.25
0.11
0.21
0.19
0.16
ISBN: 978-1-61208-254-7
29
eKNOW 2013 : The Fifth International Conference on Information, Process, and Knowledge Management
TABLE V.
Process factors \ Quality features
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
0.21
0.13
0.19
0.22
-0.01
-0.02
0.09
-0.01
0.30
0.18
0.20
0.27
0.27
spec. effort
0.22
0.14
0.27
0.23
0.18
0.18
0.24
0.19
0.33
0.26
0.27
0.25
0.27
0.47
0.31
0.48
0.49
0.14
0.12
0.31
0.14
0.57
0.47
0.49
0.53
0.59
-0.01
0.09
0.10
-0.01
0.21
0.17
0.30
0.20
0.17
0.09
0.12
0.06
0.17
dev. effort
0.17
0.13
0.24
0.17
0.23
0.21
0.28
0.22
0.30
0.24
0.25
0.21
0.25
0.12
0.23
0.34
0.13
0.47
0.40
0.59
0.45
0.47
0.32
0.37
0.26
0.43
0.17
0.00
0.19
0.16
0.19
0.22
0.07
0.20
0.07
0.20
0.16
0.08
0.07
test. effort
0.21
0.11
0.27
0.22
0.22
0.22
0.23
0.23
0.28
0.27
0.26
0.22
0.25
0.41
0.09
0.48
0.40
0.43
0.49
0.28
0.45
0.33
0.50
0.43
0.30
0.30
TABLE VI.
Project factors \ Quality features
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
architecture
0.00
0.06
0.06
0.06
0.01
0.07
0.03
0.06
0.00
0.00
0.01
0.03
0.00
0.00
0.03
0.00
0.00
0.00
0.00
0.12
0.00
0.00
0.00
0.00
0.00
0.00
deployment platform
0.00
0.17
0.11
0.00
0.11
0.02
0.00
0.04
0.00
0.00
0.02
0.01
0.00
UI type
0.12
0.05
0.13
0.29
0.00
0.00
0.12
0.00
0.05
0.05
0.17
0.00
0.04
target market
0.00
0.00
0.03
0.00
0.00
0.00
0.11
0.04
0.00
0.00
0.00
0.00
0.00
used methodology
0.06
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.31
0.20
0.04
0.00
0.02
project difficulty
0.12
0.07
0.01
0.01
0.10
0.14
0.19
0.01
0.04
0.09
0.02
0.23
0.22
ISBN: 978-1-61208-254-7
30
eKNOW 2013 : The Fifth International Conference on Information, Process, and Knowledge Management
REFERENCES
[1]
[2]
[3]
[4]
[5]
[6]
[7]
[8]
[9]
[10]
[11]
[12]
[13]
[14]
[15]
ACKNOWLEDGMENTS
I would like to thank all participants of the questionnaire
survey for providing useful information and additional
thoughts inspiring this and further research. I would also like
to thank Magne Jrgensen and Richard Torkar from Simula
Research Laboratory in Norway and Norman Fenton from
Queen Mary, University of London for valuable comments
on building a Bayesian network model discussed here. This
work has been supported by research funds from the
Ministry of Science and Higher Education / National Science
Centre in Poland as a research grant no. N N111 291738 for
years 20102012.
ISBN: 978-1-61208-254-7
[16]
[17]
31