Académique Documents
Professionnel Documents
Culture Documents
https://doi.org/10.1108/eb020991
Downloaded on: 22 February 2018, At: 01:23 (PT)
References: this document contains references to 0 other documents.
To copy this document: permissions@emeraldinsight.com
The fulltext of this document has been downloaded 555 times since 2006*
Users who downloaded this article also downloaded:
(1996),"Tendering procedures, contractual arrangements and Latham: the contractors' view",
Engineering, Construction and Architectural Management, Vol. 3 Iss 1/2 pp. 97-115 <a href="https://
doi.org/10.1108/eb021025">https://doi.org/10.1108/eb021025</a>
(2002),"A multi-criteria approach to contractor selection", Engineering, Construction and
Architectural Management, Vol. 9 Iss 1 pp. 29-37 <a href="https://doi.org/10.1108/eb021204">https://
doi.org/10.1108/eb021204</a>
Access to this document was granted through an Emerald subscription provided by emerald-
srm:535196 []
For Authors
If you would like to write for this, or any other Emerald publication, then please use our Emerald
for Authors service information about how to choose which publication to write for and submission
guidelines are available for all. Please visit www.emeraldinsight.com/authors for more information.
About Emerald www.emeraldinsight.com
Emerald is a global publisher linking research and practice to the benefit of society. The company
manages a portfolio of more than 290 journals and over 2,350 books and book series volumes, as well
as providing an extensive range of online products and additional customer resources and services.
Emerald is both COUNTER 4 and TRANSFER compliant. The organization is a partner of the
Committee on Publication Ethics (COPE) and also works with Portico and the LOCKSS initiative for
digital archive preservation.
Evaluating p e r f o r m a n c e potential in t h e
s e l e c t i o n of c o n s t r u c t i o n c o n t r a c t o r s
GARY D. HOLT, PAUL O. OLOMOLAIYE & FRANK C. HARRIS
School of Construction Engineering & Technology, University of Wolverhampton, Wulfruna Street,
Wolverhampton, West Midlands WV1 1SB, UK
Paper submitted 6 October 1993; accepted for publication 6 May 1994; discussion open until
March 1995
Downloaded by International Islamic University Malaysia At 01:23 22 February 2018 (PT)
INTRODUCTION
Construction is normally 'purchased' before it is 'manufactured', therefore the
more usual methods of pre-purchase product appraisal (comparison, approval,
etc.) cannot be applied. Rather, the construction client must evaluate the
'manufacturers' of such products and repose in one (the chosen contractor) the
confidence to satisfactorily execute the construction contract. Subsequent success
or failure of the construction process (a function of contractor performance)
determines the overall level of satisfaction attained from the exercise by the client
(Mohsini & Davidson 1986). That existing contractor selection methods are
unable to predict a successful project outcome in terms of client satisfaction is
evidenced by the number of clients now utilizing alternative, predominantly
package deal, methods of procurement (Sullivan & Harris 1986). Clients' satis-
faction requirements may be broadly defined in terms of:
• Time - to utilize the product as soon as possible
• Cost - to purchase the product at the lowest possible price
• Quality - for the product to be of the highest standard (Odusote, 1990).
Cost is obviously of prime concern to the client. He/she will always be seeking to
29
30 Holt, G.D. et al.
balance this with project time and quality to secure all-round best value for
money. Any combination of two of these superlative criteria can normally be
achieved, but rarely if ever, all three (Watkinson 1992). Therefore, an effective
contractor selection technique must necessarily evaluate candidate contractors in
the context of their optimal ability in these performance requirements. Unfortu-
nately, current methods often fail in this objective. Discrimination between
contractors tends to be based predominantly on tender sum (Baker & Orsaah
1985; Merna & Smith 1990; Griffith 1992), but the lowest bid is not necessarily
the most economic solution in the long-term. Furthermore, current selection
practices exhibit inherent weaknesses which are not conducive to comprehensive
potential performance evaluation (Holt et al. 1993a).
Hence, the purpose of this paper is to present and illustrate, with a fully worked
Downloaded by International Islamic University Malaysia At 01:23 22 February 2018 (PT)
Attributes (Xj)
Alternatives (Ai) X1 X2 x3 X4 x5 X6
The model furnishes objective, relative, numeric values for each contractor
evaluated to serve as unambiguous references in the decision process. These
values are in the form of combined (P) scores, calculated at both prequalification
and tenderer evaluation stages. A final ranking (P3) identifies optimal choice (Fig.
1). P scores are achieved by expressing the sum of a contractor's attribute values,
i.e. variable scores (the Z score) as a percentage of the maximum attainable sum of
scores (ZMax), i.e. P score = Zscore/ZMax. Final ranking is a numerical amalgam
of P2 score and bid value (£). Because the model evaluates time, cost and quality
contractor attributes, combined scores mirror performance potential in the
context of a contractor achieving client satisfaction, by way of satisfactory project
performance for each of these performance standards - time, cost and quality.
The three basic functions of the model are:
Downloaded by International Islamic University Malaysia At 01:23 22 February 2018 (PT)
Identification within
'Logical' stage model Component purpose Component output
list for an appreciable amount of time it is conceivable that the firm may witness
negative changes within its corporate structure - liquidity, resources, etc., parti-
cularly in view of prevalent macroeconomic and market forces).
Theoretically, any number of contractors can be assessed and their respective
P1 score derived. Furthermore, there would appear scope for the 'experienced'
client with an on-going construction programme to develop a history of P1 scores,
to serve as a retrospective indicator of a contractor's past performance and
corporate stability trends. Mathematically P1 may be expressed as:
when:
• 2l = the twenty-one discriminating criteria attributed to P1 analysis
• Vij = variable scores achieved by contractor j for each variable
• Wi = importance weights attached to Vi.
Z1 Max is the maximum attainable Z score under P1 analysis. Maximum Vi
value is 1.0, therefore
It can be seen from the formula that a contractor who achieves a maximum
score in all variables Vi(i = 21) would have a P1 score of 1.0. Accordingly, a
contractor obtaining an average score of half would exhibit a potential perfor-
mance score of 50%, and so on. Be that as it may, one must not overlook that a
'respectable' combined score may be achieved by a contractor 'compensating'
poor scores for certain variables with 'good' scores in others. Hence, factor scores
(score achieved for a given set of variables - see later) may be derived and checked
for signs of specific contractor weakness. Factor scores are achieved via the
formula:
potential in relation to the proposed project. 'Project specific criteria can evaluate
contractors in terms of unusual expertise or specialist facilities required by the
project' (Russell 1992). Table 3 exhibits all P1 and P2 selection criteria included
in the model.
It should also be noted that P2 incorporates a utility weighting making use of
multi-attribute utility theory (Moore & Thomas 1979; Skitmore & Marsden 1988;
Moselhi & Martinelli 1990). If the practitioner/client is indifferent to all possible
outcomes and is willing to accept their effect regardless, then weighted criteria
alone are an appropriate decision technique. However, 'utility' allows the client's
perception of performance dimensions to be attached to each discriminating
criterion (Fig. 2), thereby increasing the probability that the selected contractor
will mirror the client's preferences as much as possible. This simultaneously
renders the model dynamic by responding to the specific circumstances pertaining
to a given project, and the owner's perception of a successful outcome. Mathe-
matically P2 score may be expressed as:
where Z2j = score achieved under P2 analysis for contractor j and is determined
via the formula:
when:
• 22...29 = the eight criteria attributable to P2 analysis
• V kj = variable scores achieved by contractor j under P2 analysis
• Wk = importance weights attached to Vk
• Uk = utility weights attached to Vk by practitioner/client.
Z2Max = maximum attainable Z score under P2 analysis. Because the max-
imum Vk and U k values are 1.0, then:
Weighting*
Factors/variables index (W1) Factor rank
The possible need to apply weightings to subvariables has not been discounted.
This will be confirmed over time by a detailed comparison of actual contractor
performance with the model prediction.
Space does not permit full explanation of how each individual variable is
quantified. This is fully elucidated, including pro-forma evaluation documenta
tion, in sister publications (Holt et al. 1993d; 1994). However, an example is given
Downloaded by International Islamic University Malaysia At 01:23 22 February 2018 (PT)
Calculating bid scores in this manner is based on the sole criterion of net value.
However, for large projects or where contract duration is at the contractor's
discretion, the client/practitioner may wish to broaden the analysis by considering
Downloaded by International Islamic University Malaysia At 01:23 22 February 2018 (PT)
the time value of capital. In such instances the lowest bid may not necessarily give
the best return on the investment since it represents a series of payments over time
(Hardy et al. 1981). Further variables may be considered including:
1 Tender cash flow - by plotting the cumulative cash flow curve
2 Price adjustment - under fluctuation contracts the anticipated escalation rate
may be applied to 1
3 Positive cash flows - stemming from early completion, e.g. generation of
revenue.
Finally, mobilization payments, site establishment costs and retention monies
may all have some influence on financial analysis of the bid. By plotting all the
above and performing a discounted cash flow analysis (Smit 1978; Hardy et al.
1981; Mott 1992) then the smallest Net Present Value (NPV) will identify the
most financially attractive bid. NPV values may be converted to a bid score for
inclusion in the model via the formula:
THE S C E N A R I O
For the purpose of this example a small industrial development is assumed. The
client estimates that the contract value will be in the region of £484 000 made up
as follows:
Building cost including light, power and heating services but
ignoring any effect of VAT/loose or special equipment @ £267/M2* 440000
Add 10% for external works/sundry items 44 000
£484 000
* mean value from Spons (1992).
PREQUALIFICATION - P1 ANALYSIS
See Appendix A - P1 Summary Analysis Sheet. As shown, the variable scores
(V 1 -V 21 ) have been summarized and multiplied by their relevant weighting
indices (W 1 -W 2 1 ), producing a rationalized score for each attribute.
En route to calculating P 1 , we may divide the sum of rationalized scores for all
variables under each P1 factor, by the sum of weighting indices for the same
Downloaded by International Islamic University Malaysia At 01:23 22 February 2018 (PT)
variables, to produce factor scores. This allows the practitioner to check for signs
of specific weakness in the contractor company (refer 'pass marks' earlier). Table
4 exhibits factor scores achieved by the contractor undergoing prequalification
(the maximum possible factor score is 1.0). For our contractor the factor financial
standing (consisting variables: ratio analysis, bank reference, credit references,
turnover history) ranks lowest with a factor score of 0.76. This does not seem a
particularly low score and therefore does not give cause for concern.
By dividing the sum of rationalized variable scores under each factor (2.662 +
1.995 + 2.318 + 1.850 + 2.110 = Z1score = 10.935) by the sum of weighting
indices for each factor (3.001 + 2.601 + 2.833 + 2.334 + 2.463 = Z1Max =
13.232), the contractor achieves a P1 score of 0.826. This combined score maybe
expressed as 8 3 % potential performance in terms of being an all round good
prospect for the job. We will assume for the purpose of this example that this score
leads to the contractor being invited to tender and, therefore, subsequently sub-
jected to P2 analysis. Obviously, where several contractors have undergone P1
analysis, selection of tenderers will primarily be dependent upon their scores
relative to each other.
factor (2.679 + 2.155 = Z2Max = 4.834) achieves a P2 score of 0.765, which may
be expressed as 77% potential performance in terms of the contractor being a
good prospect for this particular contract.
The resultant effect of the utility coefficients on the P2 score is worthy of more
detailed examination. Assume a contractor has been evaluated and has achieved
P2 variable scores as shown in column 1 of Table 5. We may now observe two
scenarios:
Scenario 1
Assumes that the contractor has scored well in those variables perceived as
important by the client, i.e. there is strong correlation (coefficient = 0.78) between
high variable scores (column 1) and high utility weights (column 2).
Scenario 2
Assumes that the contractor has not scored so well in those variables perceived as
important by the client, i.e. there is strong correlation (coefficient = -0.96)
between low variable scores (column 1) and high utility weights (column 3).
Between columns 1 and 2 there is a high degree of correlation between selection variables in which the contractor has
scored well and has high utility weights (coefficient 0.78). Between columns 1 and 3. the same utility weights are utilized but
their redistribution means that the correlation is much lower (coefficient-0.96).
P2 score calculations for both the above scenarios are shown in Tables 6 and 7,
respectively. It can be seen that a higher P2 score (64%) is achieved by the con-
tractor who has high variable scores for those criteria perceived as important by the
client. Conversely, a lower P2 score (58%) is yielded for the contractor who does
not score well in these same criteria. In short, a contractor exhibits greater
potential for achieving client satisfaction (i.e. a higher P2 score) where high
variable scores are achieved in those selection criteria that the client perceives as
important to his/her particular project.
Table 6 P2 score calculation. High correlation between high variable and high utility scores
Table 7 P2 score calculation. Low correlation between high variable and high utility scores
contractor compared in relation to the other five who were invited to tender. 'Our'
contractor is identified as contractor Cr1 in the following text. Table 8 exhibits P2
and tender sums submitted by all contractors competing for the award.
It is worth noting at uiis point that under current selection practice, contractor
3, i.e. Cr 3 , would most probably be awarded the contract having submitted the
lowest bid. However, having used this alternative selection technique to evaluate
the firm's performance potential, he/she may not be the best contractor for the job
- as evidenced by his/her P2 score (0.380). 'Our' contractor Cr1 submitted the
second highest bid and would therefore stand little chance of the award under the
traditional tendering approach.
However, if we apply the alternative selection technique to all contractors, first
by calculating bid scores (Table 9) and subsequently determining respective P3
scores (Table 10), then our contractor now ranks highest overall and would,
under this method, be most eligible for the contract. Indeed, the lowest bidder
(Cr 3 ) now achieves the lowest rank due to a very poor P2 score. Therefore, the
model has identified the best all-round contractor for the project along with the
contractor who (albeit submitted the lowest bid) in this instance exhibits a greater
Downloaded by International Islamic University Malaysia At 01:23 22 February 2018 (PT)
SUMMARY
mould the new technique to alternative procurement forms, e.g. design and build
or, by including alternative project specific criteria such as safety record, internal
security regime, etc., to adapt to specific project types. Indeed, survey of selection
practitioners/client groups for any particular country would identify essential
national selection criteria (e.g. bonding capacity - USA) for wider application. In
contrast, a more compact version may be of interest to contractors themselves for
selecting sub-contractors, or to management contractors for selecting trade-
packages.
Finally, the significance of the research is confirmed when one observes the
interim findings of the government instigated review of me construction industry,
being conducted by Sir Michael Latham. 'Choice of consultant or contractor
should be made on a value for money basis, with proper weighting of criteria for
Downloaded by International Islamic University Malaysia At 01:23 22 February 2018 (PT)
ACKNOWLEDGEMENTS
The authors wish to thank the Leverhulme Trust for funding this research, and
numerous selection practitioners and client groups for their collaboration and
invaluable ongoing input. The anonymous reviewers of the paper are also
acknowledged for their constructive comments.
References
Baker, M. & Orsaah, S. (1985) How do the customers choose a contractor? Building Magazine, May,
30-31.
Birrell, G.S. (1988) Bid Appraisal Incorporating Past Performances By Contractors. American Association
of Cost Engineers. Trans. D 1.1-D 1.6.
C.I.O.B. (1989) Quality Assurance in Building, 2nd edn, Chartered Institute of Building, London.
Diekmann, J.E. (1979) Selection of cost plus contractors using normative decision methodologies. PhD thesis,
University of Washington.
Griffith, A. (1990) Quality Assurance in Building. MacMillan, London.
Griffith, A. (1992) Small Building Works Management. Macmillan, London.
Hardy, S.C., Norman, A. & Perry, J.G. (1981) Evaluation of bids for construction contracts using discounted
cashflow techniques. Proceedings of the Institute of Civil Engineers, 70 (1), 91-111.
Hawwash, K. (1991) Bid Evaluation By Points: Review. Management of Contracts & Projects - Project
Management Group, Institute of Science and Technology, University of Manchester.
Holt, G.D., Olomolaiye, P.O. & Harris, F.C. (1993a) A conceptual alternative to current tendering
practice. Building Research & Information, 21 (3), 167-72.
Holt, G.D., Olomolaiye, P.O. & Harris, F.C. (1993b). Tendering practice - exploring alternatives.
Faculty of Building Journal, Autumn edn, 28-30.
Holt, G.D., Olomolaiye, P.O. & Harris, F.C. (1993c) Factors influencing UK construction clients'
choice of contractor. Building and Environment, 241-248.
Holt, G.D., Olomolaiye, P.O. & Harris, F.C. (1993d) Evaluating prequalification criteria in contractor
selection. Building and Environment, Pergamon Press, Oxford.
Holt, G.D., Olomolaiye, P.O. & Harris, F.C. (1994) Incorporating project specific criteria and client
utility into the evaluation of construction tenderers. Building Research & Information.
Hwang C. & Yoon K. (1981) Multi-Attribute Decision Making- a state of the art survey. Verlag, Berlin.
ISO (9000) Standard 9000, Quality Systems. International Standards Organization, Switzerland.
Latham, M. (1993) Trust and Money. Interim report of the joint Government/industry review of
procurement and contractual arrangements in the UK construction industry. Department of the
Environment.
Mascoll, S.G. (1984) Organisational structures and contracts for construction projects and selection. PhD
thesis, University of Leeds.
Merna, A. & Smith, N . (1990) Bid Evaluation for Public Sector ConstructionContracts. Proceedings of the
Institution of Civil Engineers, 88 (1), 91-105.
Mohsini, R. & Davidson, C.H. (1986) Procurement Organisation Design and Building Team Performance-
A Study of Inter-firm Conflict. CIB Proc., 8, Washington DC.
Moselhi, O. & Martinelli, A. (1990) Analysis of Bids Using Multi Attribute Utility Tlieory. Proceedings of
the International Symposium on Building Economics & Construction Management. Sydney,
Australia, 335-345.
Moore, P.G. & Thomas H. (1979) The Anatomy of Decisions. Penguin, Middlesex.
Mott, G. (1992) Investment Appraisal. Pitman, London.
Odusote, O.O. (1990) An examination of the importance of resource considerations when contractors make
project selection decisions. MSc Dissertation, University of Bath.
Downloaded by International Islamic University Malaysia At 01:23 22 February 2018 (PT)
Olomolaiye, P.O., Wahab, K. & Price, A. (1987) Problems facing craftsmen's productivity in Nigeria.
Building & Environment, 22 (4), 317-23.
Russell, J. (1992). Decision models for analysis and evaluation of construction contractors. Con-
struction Management & Economics, 10, 185-202.
Skitmore, R.M. & Marsden, D.E. (1988) Which procurement system? Towards a universal
procurement selection technique. Construction Management & Economics, 6, 71-89.
Smit, J.J. (1978) Tender evaluation, the whole concept. The Civil Engineering Contractor (South Africa),
13 (10), 39-19.
Spons (1992) Spoils' Architects and Builders Price Book. E & FN Spon, London.
Sullivan, A. & Harris, F.C. (1986) Delays on large construction projects. International Journal of
Operational and Production Management 6 ( 1 ) .
Watkinson, M. (1992) Procurement alternatives. Faculty of Building Journal Autumn, Winter edns.
APPENDIX A
PREQUALIFICATION (P1) SUMMARY ANALYSIS SHEET
Factor: Organizational structure
b
divided by a = Organizational structure. Factor score = 0.887c
e f
divided by d = Financial stability. Factor score = 0.767
h
divided by g = Management resource. Factor score = 0.818i
k m
divided byj = Past experience. Factor score == 0.792
Z1 scorer divided by Z1 Maxq = P1 score == 0.826 which may be expressed as 83% performance potential.
APPENDIX B
TENDER EVALUATION (P2) SUMMARY ANALYSIS SHEET
Factor: Project specific
t
divided by s = Project specific. Factor score == 0.813u
w
divided by v = other specific. Factor score = 0.705x
T e n d e r e v a l u a t i o n ( P s ) final c a l c u l a t i o n
Z2 score z divided by Z2Max y == P2 score = 0.765 which may be expressed as 77 performance potential.
1. Olugbenga Jide Olaniran. 2015. The effects of cost-based contractor selection on construction
project performance. Journal of Financial Management of Property and Construction 20:3, 235-251.
[Abstract] [Full Text] [PDF]
2. Amirhossein Movahedian Attar, Mostafa Khanzadi, Shahin Dabirian, Elmira Kalhor. 2013.
Forecasting contractor's deviation from the client objectives in prequalification model using support
vector regression. International Journal of Project Management 31:6, 924-936. [Crossref]
3. Amirhosein Jafari. 2013. A contractor pre-qualification model based on the quality function
deployment method. Construction Management and Economics 31:7, 746-760. [Crossref]
4. Pertti Lahdenperä. 2013. Determining ‘the most economically advantageous tender’ based on
capability and fee-percentage criteria. Journal of Public Procurement 13:4, 409-446. [Abstract] [PDF]
Downloaded by International Islamic University Malaysia At 01:23 22 February 2018 (PT)
5. Firuzan Yasamis-Speroni, Dong-Eun Lee, David Arditi. 2012. Evaluating the Quality Performance
of Pavement Contractors. Journal of Construction Engineering and Management 138:10, 1114-1124.
[Crossref]
6. Lijuan Tao, Mohan Kumaraswamy. 2012. Unveiling relationships between contractor inputs and
performance outputs. Construction Innovation 12:1, 86-98. [Abstract] [Full Text] [PDF]
7. Gary Holt. 2010. Contractor selection innovation: examination of two decades' published research.
Construction Innovation 10:3, 304-328. [Abstract] [Full Text] [PDF]
8. Ka-Chi Lam, Mike Chun-Kit Lam, Dan Wang. 2010. Efficacy of Using Support Vector Machine
in a Contractor Prequalification Decision Model. Journal of Computing in Civil Engineering 24:3,
273-280. [Crossref]
9. Ka Chi Lam, Ekambaram Palaneeswaran, Chen-yun Yu. 2009. A support vector machine model for
contractor prequalification. Automation in Construction 18:3, 321-329. [Crossref]
10. T.H. Nguyen, T. Shehab, Z. Gao. 2008. Selecting an architecture‐engineering team by using fuzzy
set theory. Engineering, Construction and Architectural Management 15:3, 282-298. [Abstract] [Full
Text] [PDF]
11. Luciana Hazin Alencar, Adiel Teixeira de Almeida, Caroline Maria de Miranda Mota. 2007.
Sistemática proposta para seleção de fornecedores em gestão de projetos. Gestão & Produção 14:3,
477-487. [Crossref]
12. Florence Yean Yng Ling. 2004. Consultancy Fees: Dichotomy between A/E’s Need to Maximize
Profit and Employers’ Need to Minimize Cost. Journal of Professional Issues in Engineering Education
and Practice 130:2, 120-123. [Crossref]
13. Ekambaram Palaneeswaran, Mohan Kumaraswamy, Thomas Ng. 2003. Targeting optimum value in
public sector projects through “best value”‐focused contractor selection. Engineering, Construction
and Architectural Management 10:6, 418-431. [Abstract] [Full Text] [PDF]
14. . References and Bibliography 409-447. [Crossref]
15. Ekambaram Palaneeswaran, Mohan Kumaraswamy, Motiar Rahman, Thomas Ng. 2003. Curing
congenital construction industry disorders through relationally integrated supply chains. Building
and Environment 38:4, 571-582. [Crossref]
16. Jakrapong Pongpeng, John Liston. 2003. TenSeM: a multicriteria and multidecision-makers' model
in tender evaluation. Construction Management and Economics 21:1, 21-30. [Crossref]
17. Stephen C. Ngai, Derek S. Drew, H. P. Lo, Martin Skitmore. 2002. A theoretical framework for
determining the minimum number of bidders in construction bidding competitions. Construction
Management and Economics 20:6, 473-482. [Crossref]
18. Ekambaram Palaneeswaran, Mohan M. Kumaraswamy, Xue Qing Zhang. 2001. Reforging
construction supply chains:. European Journal of Purchasing & Supply Management 7:3, 165-178.
[Crossref]
19. S.Thomas Ng. 2001. EQUAL: a case-based contractor prequalifier. Automation in Construction 10:4,
443-457. [Crossref]
20. Ekambaram Palaneeswaran, Mohan Kumaraswamy. 2001. Recent advances and proposed
improvements in contractor prequalification methodologies. Building and Environment 36:1, 73-87.
[Crossref]
21. Prasanta Kumar Dey. 2000. Managing projects in fast track – A case of public sector organization
in India. International Journal of Public Sector Management 13:7, 588-609. [Abstract] [Full Text]
[PDF]
22. Ekambaram Palaneeswaran, Mohan M. Kumaraswamy. 2000. Contractor Selection for Design/Build
Downloaded by International Islamic University Malaysia At 01:23 22 February 2018 (PT)