Académique Documents
Professionnel Documents
Culture Documents
In all 255 adult professionals concerned with selection, assessment and training completed a questionnaire which asked their beliefs about the validity, cost, practicality and
legality of different assessment techniques (i.e., Assessment Centres, Biodata, Interviews) and their knowledge and use of both personality and ability tests. Participants
tended to be positive about the tests themselves, how they were used and about test
publishers. They rated Assessment Centres, Cognitive ability tests and Work Samples as
the most valid, while Interviews were rated as most practical. Results from knowledge of
personality and intelligence tests indicated that only a few tests were widely known, more
so in personality/motivation than intelligence. Implications of these results for educating
and informing practitioners are considered.
1. Introduction
Application Form, Ability Test, Personality Test, Assessment Centre, Structured Interview, Biodata. A similar
American Study (Rynes, Orlitzky, & Bretz, 1997) of 251
employers however showed a rather different pattern:
References, Structured Interview, Drug Test, School/
University Grades, Interview, Work Trial, Work Sample, Ability Test, Personality Test, Assessment Centre,
Biodata. Overall however an unstructured interview,
references and some application form data seem to be
collected for nearly every selection task (Cook, 2004).
Paradoxically they have been shown to be some of the
least valid ways to assess people. The American Management Association published an important review in
2001 which showed just under a third used tests for
various purposes.
This study attempted to look at HR practitioners
beliefs about, knowledge and use of both psychometric
power (ability) and preference (personality) tests. It
was a survey of a large British population of HR test
users. It hoped to give a representative overview of the
beliefs and practices of mainly Human Resource Practitioners working in an average to large sized British
& 2008 The Author. Journal compilation & 2008 Blackwell Publishing Ltd,
9600 Garsington Road, Oxford, OX4 2DQ, UK and 350 Main St., Malden, MA, 02148, USA
2. Method
2.1. Participants
A total of 255 participants responded to invitations to
complete the survey either as a paper survey or on the
internet. The vast majority (88%) were British-based
HR practitioners in large companies employing over
250 people. The average age was 40.23 yrs
(SD 11.37). The sample consisted of 48.4% males
and 51.6% females. One hundred and forty eight
respondents had Level A Certificates (or equivalent)
with many of these having Level B as well. 81% of the
sample was from the United Kingdom with the remainder
from a variety of mainly European countries. To be
included in the survey respondents had to be responsible
for, and/or regularly involved in personnel selection.
2.2. Survey
This was divided essentially into two parts:
The first section itself was divided into two parts. The
first part was a grid. It listed 12 methods to assess
people including all the most well-known and well-used
methods (assessment centres, interview, references).
Respondents were required to rate each on four
criteria that seemed most appropriate for practitioners.
This section asked people simply to reveal their experience and qualifications for using various types of
tests.
The second section was also divided into two sections. The first section consisted of 21 personality and
motivational tests commonly used by consultants, HR
specialists and organisational psychologists in selection
and assessment. The list was derived from 20 Interviews with suppliers and users and past surveys on test
use. It aimed to be comprehensive reflecting test usage
in Great Britain. Inevitably some less well-known and
used tests were not included. The second section listed
19 aptitude, ability and intelligence tests. The same
procedure was used to decide which should or should
not be included. This part of the questionnaire also
provided space for respondents to list the names of
tests that were not mentioned above. Each of both
types of tests were rated on six dimensions, three Yes/
No: Have you heard of this test? Have you completed
this test? Does your organisation use this test? Three
ratings were done on a 10-point scale (1 low,
10 high). How valid do you rate this test? How useful
is this test for selection? How useful is this test for
development?
301
2.3. Administration
The questionnaire was sent out in NovemberDecember 2004. Responses arrived soon after but the last
questionnaire was included in March 2005. Questionnaires were sent both by post and electronically (internet) depending on how easy it was to contact
individuals. Some respondents replied by post, some
downloaded and completed a paper questionnaire, and
some responded via the internet.
Individuals were contacted essentially via two means.
Firstly, through a consortium specialising in HR practice
and secondly through a network of consultants, academics and test publishers. They were asked to give it
to colleagues where they thought they were appropriate. Hence it is difficult to specify the response rate.
It is estimated 500600 questionnaires were targeted at
specific people. Over 220 were returned which gives a
response rate between 30% and 40%.
302
Adrian Furnham
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
Interview
Reference
Peer ratings
Biodata
Cognitive Ability Tests
Personality Tests
Assessment Centres
Work sample
Job Knowledge
Educational Qualifications
3601 Appraisal Data
Personal hunch
Criteria*
A. Validity
B. Cost
C. Practicality
D. Legality
3.11
2.23
3.08
2.80
3.90
3.55
4.03
3.90
3.65
3.13
3.56
1.83
2.99
1.71
2.39
2.58
3.41
3.56
4.42
3.07
2.27
1.64
3.46
1.39
3.83
3.37
2.74
2.94
3.20
3.25
2.71
3.00
3.49
3.69
2.73
3.03
3.61
2.95
2.56
2.76
3.37
3.23
3.70
3.51
3.47
3.43
3.03
1.53
(1.04)
(1.06)
(.98)
(.99)
(.81)
(.82)
(.88)
(.86)
(.87)
(.95)
(.91)
(1.02)
(1.06)
(.97)
(1.03)
(1.18)
(.95)
(.91)
(.95)
(1.01)
(.99)
(.97)
(1.07)
(.93)
A great deal
(.86)
(1.12)
(1.01)
(1.12)
(.86)
(.85)
(1.07)
(1.02)
(.93)
(1.11)
(1.08)
(1.61)
(1.02)
(1.16)
(1.10)
(1.17)
(.97)
(.96)
(.95)
(1.07)
(1.07)
(1.19)
(1.05)
(1.00)
Very little
6 (%)
5 (%)
4 (%)
3 (%)
2 (%)
1 (%)
SD
9.2
6.8
18.7
12.4
10.01
7.1
12.0
11.2
10.6
23.6
18.2
17.4
20.0
22.9
22.0
22.8
30.5
24.9
4.04
4.33
3.93
1.57
1.56
1.81
303
Have you
heard of
this test?
% Yes
Have you
completed
this test?
% Yes
Does your
organisation
use this
test? % Yes
How valid
do you rate
this test?
110
How useful
is this test
for Selection?
110
How useful
is this test
for Development? 110
85.5
63.9
28.6
6.94 (2.04)
6.16 (2.22)
6.59 (2.20)
40.3
13.7
9.1
4.89 (2.24)
4.12 (2.25)
5.51 (2.41)*
71.8
62.5
46.3
28.2
62.8
59.3
41.5
23.0
9.3
27.1
39.8
22.9
7.5
4.6
7.1
5.49
7.20
6.87
5.29
6.44
3.55
6.37
5.42
3.81
5.25
6.24
6.49
5.71
4.90
5.42
61.3
39.9
31.3
6.35 (2.18)
4.55 (2.50)
6.71 (2.39)
46.4
24.6
15.9
6.37 (2.25)
5.85 (2.41)
6.19 (2.44)
26.3
25.1
8.5
5.7
3.3
3.3
5.12 (2.29)
5.31 (2.28)
4.20 (2.13)
4.98 (2.17)
5.23 (2.18)*
5.23 (2.40)*
40.5
84.2
79.8
19.4
72.2
52.6
11.7
55.6
34.7
6.00 (2.32)
6.92 (2.14)
6.98 (2.01)
5.05 (2.49)
3.82 (2.68)
6.12 (2.19)
6.03 (2.46)*
7.25 (2.37)
6.03 (2.22)
51.4
18.2
19.2
31.3
12.1
2.4
5.3
12.1
6.3
1.7
1.3
2.9
5.59
5.12
5.24
5.08
4.44
4.94
5.15
4.71
5.33
4.69
4.87
5.03
28.3
13.4
10.9
7.3
6.3
1.6
4.87 (2.41)
4.54 (2.36)
5.66 (2.47)
4.35 (2.47)
4.70 (2.36)*
4.58 (2.91)**
38.6
30.6
29.4
4.85 (2.39)
4.31 (2.38)
4.89 (2.47)**
(2.04)
(1.99)
(2.68)
(2.27)
(2.28)
(2.43)
(2.53)
(2.15)
(2.31)
(2.42)
(2.15)
(2.52)
(2.49)
(2.27)
(2.48)
(2.59)
(2.44)
(2.34)
(2.16)
(2.32)
(2.60)*
(2.41)*
(2.34)
(2.50)*
(2.69)**
(2.50)**
(2.46)*
*Indicates where fewer than 100 (**o50) people answered the final three questions. This indicates few people really knew about this test.
304
Adrian Furnham
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
Aptitude/Cognitive
Ability Tests
Have you
heard of
this test?
% Yes
Have you
completed
this test?
% Yes
Does your
organisation
use this test?
% Yes
How valid
do you rate
this test?
110
How useful
is this test
for Selection?
110
How useful
is this test
for Development? 110
38.3
30.6
29.4
6.41 (2.49)
6.26 (2.67)
4.13 (2.39)
42.2
33.5
30.6
6.56 (2.40)
6.15 (2.62)
4.34 (2.42)
36.4
36.0
27.3
29.6
27.9
23.0
24.5
24.9
24.3
5.83 (2.56)
5.78 (2.57)
5.19 (2.54)
5.44 (2.57)
5.41 (2.59)
4.85 (2.54)
5.51 (2.32)
5.55 (2.25)
3.97 (2.42)*
29.4
45.3
21.4
33.7
12.5
29.5
5.43 (2.72)
6.71 (2.24)
5.20 (2.73)
6.46 (2.37)
4.29 (2.64)*
4.82 (2.51)
29.9
24.3
25.0
5.95 (2.70)
5.63 (2.65)
4.34 (2.28)*
44.7
51.6
25.0
39.9
25.4
35.2
6.58 (2.27)
6.80 (2.30)
6.28 (2.36)
6.62 (2.43)
5.22 (2.45)
4.70 (2.54)
25.8
23.9
24.2
5.87 (2.87)
5.48 (2.65)
4.53 (2.32)*
36.5
33.3
31.4
6.35 (2.45)
6.02 (2.53)
4.31 (2.19)
24.6
21.8
21.6
5.51 (2.57)
5.43 (2.61)
4.58 (2.42)*
30.3
37.3
22.2
27.0
23.3
24.6
5.37 (2.69)
6.04 (2.63)
5.09 (2.71)
5.77 (2.61)
4.11 (2.32)*
4.58 (2.52)*
42.6
29.5
50.4
36.6
23.9
42.4
28.0
25.4
39.0
6.40 (2.56)
5.76 (2.77)
6.76 (2.26)
5.76 (2.47)
5.63 (2.76)
6.37 (2.36)
4.32 (2.19)
4.29 (2.28)*
4.68 (2.44)
30.0
22.7
21.7
5.39 (2.59)
5.19 (2.71)
4.27 (2.30)*
ence; the country they work in; test publisher marketing; popular articles about testing, litigation, etc. Their
knowledge and use of test is based on very different
criteria than that used by academic differential psychologists and psychometricians. Hence some tests remain
very popular among practitioners (FIRO-B, MBTI, Belbin Team Role) despite being little used in research and
frequently condemned by researcher in terms of their
psychometric properties. This study attempted to go
some way to inform academics about the perceptions
of those who use these tests.
References
American Management Association (2001) The 2001 AMA
Survey on Workplace Testing. New York: AMA.
Anderson, N. and Cunningham-Snell, N. (2000) Personnel
Selection. In: Chmiel, N. (ed.), Introduction to Work and
Organizational Psychology. Oxford: Blackwell, pp. 6999.
Arnold, J., Silvester, J., Patterson, R., Robertson, I., Cooper, C.
and Burnes, B. (2005) Work Psychology: Understanding human
behaviour in the workplace. Harlow: Prentice-Hall.
305
Kwiatkowski, R. (2003) Trends in Organisations and Selection.
Journal of Managerial Psychology, 18, 382394.
Lievens, F., van Dam, K. and Anderson, N. (2002) Recent
Trends in Challenges in Personnel Selection. Personnel
Review, 31, 580601.
Oakland, T. (2004) Use of Educational and Psychological Tests
Internationally. Applied Psychology, 53, 157172.
Ones, D. and Anderson, N. (2002) Gender and Ethnic Group
Differences on Personality Scales in Selection. Journal of
Occupational and Organisational Psychology, 75, 255276.
Ones, D. and Viswesvaran, C. (1998) Integrity Testing in
Organisations. In: Griffin, R., OLeary-Kelly, A. and Collins,
J. (eds), Dysfunctional Behaviour in Organisations. Greenwich,
CT: AI Press.
Ryan, A.M. and Sackett, P. (1988) Individual Assessment:
The research base. In: Jeanreret, R. and Sulzer, R. (eds),
Individual Psychological Assessment. San Francisco: Jossey
Bass, pp. 5487.
Rynes, S., Orlitzky, M. and Bretz, R. (1997) Experience Hiring
Versus College Recruiting: Practices and emerging trends.
Personnel Psychology, 50, 309339.
Silzer, R. and Jeanneret, R. (2000) Anticipating the
Future; Assessment Strategies for Tomorrow. In: Jeanreret,
R. and Silzer, R. (eds), Individual Psychology Assessment. San
Francisco: Jossey Bass, pp. 445477.
Te Nijenhuis, J., Voskuijl, O. and Schijive, N. (2001) Practice on
Coaching on IQ Tests. International Journal of Selection and
Assessment, 9, 302306.