Académique Documents
Professionnel Documents
Culture Documents
ORIGINAL ARTICLE
Aim: To evaluate the validity and potential value of the parent-completed Infant/Child Monitoring Questionnaire (IMQ) as a screening measure
for developmental delay in high-risk infants.
Methods: One hundred and forty-one term infants born with moderate or severe newborn encephalopathy (NE) and 374 randomly selected
comparison infants were administered a Grifths Mental Development Scales (GMDS) assessment and an IMQ concurrently. Concordance of
classications between measures was compared for agreement, sensitivity, specicity, positive predictive value, negative predictive value, false
positives and false negatives.
Results: Overall, sensitivity and specicity of the IMQ for infants with NE averaged across all age groups was 87%, positive predictive value 57%
and negative predictive value 97%. The IMQ did not perform as well for comparison infants with a sensitivity of 50%, specicity 94%, positive
predictive value 15% and negative predictive value 99% averaged across all age groups. Overall under-referral for infants with NE was 13%,
compared with 50% for comparison infants.
Conclusions: Use of the IMQ as an accurate screening measure in infants at risk of developmental delay is supported. The low sensitivity of
the IMQ for the comparison infants indicates a need for caution when considering its application for general population screening.
Key words: developmental delay; parent; questionnaire; screening.
questionnaire6 and was later renamed the Ages and Stages Methods
Questionnaire (ASQ) in 1995 with minimal revision to content.
The change of content was so minimal that the data collected Participants
from the IMQ and the revised ASQ were combined to report
Participants were members of a longitudinal cohort study in
psychometric properties for the revised ASQ, which is essen-
Perth, Western Australia, who were originally recruited in a case
tially the same tool with a new name.7
control study established to investigate the antecedents of
Although there have been a number of comparisons of the
newborn encephalopathy (NE) and subsequently followed to
IMQ and/or ASQ with popular developmental assessments
determine their outcomes. The methods for the Western Aus-
used overseas, the concurrent validity of the IMQ/ASQ with
tralian NE Study have been described in detail previously11 and
criterion measures used in Australia through a population-
are outlined briefly here.
based study has not, as far as we are aware, been evaluated. A
study of 167 infants born prematurely8 and considered at risk Eligibility criteria of children diagnosed with NE
of developmental disability reported the concurrent validity
and test characteristics of the IMQ with the Griffiths Mental Infants with NE were all live infants born at term (37 weeks)
Development Scales (GMDS).9 Based on their results of high in Western Australia between 1 June 1993 and 31 December
negative predictive values, Skellern et al. supported the use of 1996 who fulfilled the criteria in Figure 1. Deaths in the first
the ASQ as a screening tool for cognitive and motor delays in week of life were reviewed to ensure that no baby who fulfilled
the follow-up of ex-premature infants but suggest combining the eligibility criteria died before inclusion in the study.
the screening instrument with other strategies for comprehen- The severity of NE was graded by a neonatologist as moderate
sive follow-up.8 or severe according to the criteria modified from Sarnat and
However, another study examining the test characteristics Sarnat.11,12 In the total sample there were 177 infants with
of the IMQ with high-risk infants from a neonatal intensive care moderate NE and 99 with severe NE. The incidence of moderate
unit reported that the IMQ had a high under-referral rate of or severe NE was 3.80 per 1000 term live births (95% confi-
33% and was therefore considered to have limited value as a dence interval 3.244.43).11
screening instrument of high-risk populations.10 In the absence
of consistent research findings about the utility of this screening Comparison cohort
tool in Australian populations other than ex-premature or very
There were 564 infants in the comparison cohort who were
high-risk infants, the immediate and long-term implications of
randomly selected from the population of term live births
introducing the ASQ (formerly IMQ) into clinical and non-
without NE delivered in metropolitan Perth during the same
clinical populations for comprehensive follow-up programmes
time period as the infants with NE.
remain unclear.
The primary aim of this study was to compare the IMQ with Follow-up procedures
a concurrently administered gold standard measure, the
GMDS, to examine the test characteristics and concurrent valid- The follow-up protocol requested parents to complete the IMQ
ity in two groups of children, one of which is high-risk. when their children were aged 4, 8, 12, 18, 24, 36 and
48 months. When infants were aged 12 months, the parents the IMQ and GMDS was determined by the concordance
were contacted to have their child assessed by a trained assessor between classifications on the screening measure (IMQ) and
(blind to the case control status of the child) using the GMDS. If criterion measure (GMDS) and was calculated as percentage
families were unavailable for a Griffiths assessment when their agreement using the binary prediction model.19 Measures of
child was 12 months of age, the assessment was arranged for association adjusted for chance agreement (Kappa coefficient)
a later date which resulted in some children being older than were used to measure classification accuracy. Sensitivity, speci-
12 months when the GMDS was completed. ficity, positive and negative predictive values, over-referrals and
under-referrals were calculated in each age group, across all age
Measures groups and for each area of development.
GMDS, Grifths Mental Development Scales; IMQ, Infant/Child Monitoring Questionnaire; NE, newborn encephalopathy.
IMQ age N Sensitivity Specicity Positive Negative Over-referrals Under-referrals Kappa P-value
(%) (%) predictive predictive (false positives) (false negatives)
value (%) value (%) (%) (%)
GMDS, Grifths Mental Development Scales; IMQ, Infant/Child Monitoring Questionnaire; NE, newborn encephalopathy.
Table 3 Concordance classication indices of concurrent IMQ and GMDS according to area of development
Development Sample (N) Sensitivity Specicity Positive Negative Over-referrals Under-referrals Kappa P-value
(%) (%) predictive predictive (false (false negatives)
value (%) value (%) positives) (%) (%)
GMDS, Grifths Mental Development Scales; IMQ, Infant/Child Monitoring Questionnaire; NE, newborn encephalopathy.
were comparison infants. The characteristics of the validity P = 0.001, n = 54), almost perfect at 18 months (Kappa = 0.845,
measures according to age are given in Table 2. Because of the P < 0.001, n = 55) and moderate at 24 months (Kappa = 0.471,
small numbers, validity measures are not provided beyond age P = 0.043, n = 18). The association of agreement for the
24 months. comparison group showed slight agreement at 12 months
For infants with NE, across all ages, the sensitivity and speci- (Kappa = 0.106, P = 0.004, n = 146), was fair at 18 months (Kappa
ficity of the IMQ was 87%, positive predictive value 57% and = 0.279, P < 0.001, n = 175) and slight at 24 months (Kappa =
negative predictive value 97%. For comparison infants across 0.130, P < 0.484, n = 29).
all ages, the sensitivity of the IMQ was 50%, specificity 94%, Classifications of at-risk of delay on the IMQ and being
positive predictive value 15% and negative predictive value delayed on the GMDS were also compared according to cor-
99%. Overall under-referral for infants with NE was 13%, com- responding areas of development to determine if parents and
pared with 50% for comparison infants. professionals had parallel agreement in detecting delay in spe-
For infants with NE the agreement between the IMQ and cific areas of development (Table 3). Overall, the sensitivity was
GMDS measured by Kappa was fair at 12 months (Kappa = 0.340, lower for corresponding areas of development compared with
agreement for overall failure by age groups. Sensitivity for the 12-month age group for both the infants with NE and the
infants with NE ranged from 41% (fine motor) to 94% (gross comparison infants. The question is whether fewer false posi-
motor) and only met the acceptable level in gross motor devel- tives are more optimal in terms of costs than higher rates of false
opment, whereas sensitivity for comparison infants was lower negatives. The initial financial costs of further professional
in all developmental areas. testing could be high and would seem to defeat the purpose
of screening; however, the longer-term cost of under-referral
Parent comments could be significant when a child potentially misses out on early
intervention for a problem harder to habilitate at a later age.
Parent comments to the open-ended unscored questions on However, it should be acknowledged that over-inclusion (over-
the IMQ were also examined. Overall, 182 (35%) had parental referral) could provoke unnecessary anxiety in parents of chil-
comments on the IMQ with infants with NE (53%) having more dren referred for further diagnostic testing yet subsequently not
parental comments than comparison infants (29%). When shown to have a problem, which in itself is not without cost.
further examined according to infants who passed or failed the Among the failures on the IMQ for both groups, parents made
concurrent GMDS, there were more comments on the IMQ of comments at almost twice the rate they did when the child
failed infants (96% of infants with NE and 50% of comparison passed their IMQ. The parents comments on the open-ended
infants) compared with infants who passed (45% of infants with questions in the overall section of the questionnaires may offer
NE and 28% of comparison infants). Of the seven false nega- a way to augment quantitative data and increase early detection
tives on the IMQ, all infants with NE (3) had parental concerns of more subtle problems. The true value of parent comments to
noted and none of the four comparison infants had parental the open-ended questions should be more thoroughly exam-
concerns noted. ined to facilitate ways to quantitatively process these concerns
and accurately assess their value. Previous research has shown
Discussion that screening measures which accurately elicit parental con-
cerns are as predictive as other screening measures.21 Such
We examined the screening characteristics of the IMQ in two screening measures also serve to actively involve parents in
relatively large groups of children, the encephalopathy survi- their childs health care which could facilitate advice and infor-
vors born at term who represent a group at high risk of devel- mation in response to parental concerns to be delivered within
opmental delay and the comparison cohort who represent the the broader historical and family context.22
general population of children born at term in Western Austra- Parent-completed screening measures which meet criteria for
lia. We compared the IMQ results with the professionally adequate psychometric properties (sensitivity and specificity
administered Griffiths test and our findings support the use of >70%) may be appropriate for follow-up programmes designed
the IMQ as an accurate and potentially cost-effective alternative to detect certain conditions and as such, should be confined to
to professional screening of infants at risk of developmental these conditions. However, even with evidence of the effective-
delay aged 018 months. These results for the high-risk group ness of such screening, it is recommended that the quality of the
were similar to those reported by Skellern et al.8 However, test be just part of an overall process which will include the test,
agreement between parents of comparison infants and profes- the interpretation, and training of testers, tracking, referral,
sionals is only slight or fair which may be a function of the reporting, support and overall management (NHMRC Report).
general population being at low risk for developmental delay. The notion of one-off screening in itself should not be the
The results from this sample of infants indicate exercising central focus for a pass/fail result as these tests are not diag-
caution before any widespread introduction of the IMQ as a nostic22 but alternatively could provide reinforcement for a
single method to monitor or screen the general population. surveillance system which is family-centred in practice to effec-
Overall, the IMQ performed better for infants with NE com- tively monitor the health of the whole community of children
pared with the comparison infants when individual areas of over time.23
development were examined for agreement with the gold stan- In summary, our findings support the potential value of using
dard assessment. These results could indicate that the IMQ is the parent-completed IMQ (now ASQ) for infants at risk of
sensitive to developmentally at-risk populations whereby developmental delay in Australian populations. The test char-
the most obvious and severe problems are detected more easily acteristics of the IMQ make it useful for the follow-up surveil-
than the more subtle problems or it could also reflect that the lance of infants up to the age of 18 months with wider coverage
parents of infants with NE were more anxious and therefore of rural and remote locations at potentially less cost compared
more vigilant about signs of delay in their children compared with a professional assessment. On the basis of the results from
with parents of comparison infants. The heightened anxiety of this study, the widespread use of the IMQ as a screening instru-
parents of infants who have experienced a serious illness or ment in the general population where the risk of developmental
accident early in life resulting in perceived child vulnerability delay was perceived to be minimal is not recommended in
has been well researched and supported in previous studies20 isolation or without caution when interpreting results, and
and it is thus plausible that parents of children with NE could further research is needed with larger numbers of children aged
have a perceived child vulnerability resulting in the differences more than 18 months to examine the efficacy of such measures.
in parent responses in the two groups. Finally, the value of parents comments on the IMQ in closing
When the sensitivity of an instrument is low and specificity is the gap on the under-referrals in all groups needs to be further
high, there will be fewer false positives (over-referrals), but evaluated. Initial examination appears to suggest that parents
there will be more false negatives (under-referrals) as is seen in have a valuable contribution to make in detecting the early signs
of more subtle and complex problems before they are apparent 10 Hughes CA, Thomas KA, Iatrow AM, Bozynski ME. The value of
to professionals or rate as failures on screening measures. the Infant/Child Monitoring Questionnaire for identication of
developmental disability among neonatal intensive care unit
graduates. J. Perinatol. 1998; 18: 25965.
Acknowledgements 11 Badawi N, Kurinczuk JJ, Keogh JM et al. Antepartum risk factors for
The Western Australian Newborn Encephalopathy Study was newborn encephalopathy: the Western Australian case-control study.
BMJ 1998; 317: 154952.
funded by the Public Health Research and Development Com-
12 Sarnat HB, Sarnat MS. Neonatal encephalopathy following fetal
mittee of the National Health and Medical Research Council
distress. Arch. Neurol. 1976; 33: 696705.
of Australia (94/3368) and the National Health and Medical 13 Rossiter EJR. Use of developmental screening and assessment
Research Council of Australia (96/0560, 96/3209, 98/7062, instruments by paediatricians in Australia. J. Paediatr. Child Health
00/3209). 1993; 29: 3579.
14 Beggs S, Sewell J, Efron D, Orkin C. Developmental assessment of
References children: a survey of Australian and New Zealand paediatricians.
J. Paediatr. Child Health 2005; 41: 4448.
1 Glascoe FP. Are overreferrals on developmental screening tests really 15 Hanson R, Aldridge-Smith J. Achievements of young children on items
a problem? Arch. Pediatr. Adolesc. Med. 2001; 155: 549. of the Grifths Scales: 1980 compared with 1960. Child Care Health
2 Centre for Community Health, Royal Childrens Hospital Melbourne for Dev. 1987; 13: 18195.
the National Health and Medical Research Council. Child Health 16 Hanson R, Aldridge-Smith J, Hume W. Achievements of infants on
Screening and Surveillance: A Critical Review of the Evidence. items of the Grifths Scales: 1980 compared to 1950. Child Care
Melbourne: National Health and Medical Research Council of Health Dev. 1985; 11: 91104.
Australia, 15 March 2002. CH42. 17 Robertson CMT, Finer NN, Grace MGA. School performance of
3 Sonnander K. Early identication of children with developmental survivors of neonatal encephalopathy associated with birth asphyxia
disabilities. Acta Paediatr. Supplement 2000; 434: 1723. at term. J. Pediatr. 1989; 114: 75360.
4 Aylward G. Conceptual issues in developmental screening and 18 Yudkin PL, Johnson A, Clover LM, Murphy KW. Clustering of perinatal
assessment. J. Dev. Behav. Pediatr. 1997; 18: 3409. markers of birth asphyxia and outcome at age 5 years. Br. J. Obstet.
5 Glascoe FP. Parents concerns about childrens development: Gynaecol. 1994; 101: 77484.
prescreening technique or screening test? Pediatrics 1997; 99: 19 Fielding AH, Bell JF. A review of methods for the assessment of
5228. prediction error in conservation presence/absence models. Environ.
6 Bricker D, Squires J. (a) The effectiveness of parental screening of Conserv. 1997; 24: 3849.
at-risk infants: the Infant Monitoring Questionnaires. Top Early Child. 20 Forsyth BWC, Horowitz SM, Leventhal JM, Burger J. The Child
Spec. 1989; 9: 6785. Vulnerability Scale: an instrument to measure parental perceptions of
7 Squires J, Bricker D, Potter LW. Revision of a parent-completed child vulnerability. J. Pediatr. Psychol. 1996; 21: 89101.
developmental screening tool: Ages and Stages Questionnaires. 21 Glascoe FP. Evidence-based approach to developmental and
J. Pediatr. Psychol. 1997; 22: 31328. behavioural surveillance using parents concerns. Child Care Health
8 Skellern CY, Rogers Y, OCallaghan MJ. A parent-completed Dev. 2000; 26: 13749.
developmental questionnaire: follow up of ex-premature infants. 22 Glascoe FP, Dworkin PH. Obstacles to effective developmental
J. Paediatr. Child Health 2001; 37: 1259. surveillance: errors in clinical reasoning. J. Dev. Behav. Pediatr. 1993;
9 Grifths R. The Abilities of Young Children. A Comprehensive System 14: 3449.
of Mental Measurement for the First Eight Years of Life. London: Child 23 Hall DMB. Health for All Children, 3 edn. New York: Oxford University
Development Research Centre, 1970. Press, 1996.