Evaluation of the Accuracy of Aorta Scan BVI 9600 in Screening for
Abdominal Aortic Aneurysm
A.T.V. Nguyen, G.B. Hill, I.A. Thomson, A.M. van Rij * Department of Surgical Sciences, Dunedin School of Medicine, University of Otago, Dunedin, New Zealand WHAT THIS PAPER ADDS Attempts have been made to reduce the cost of ultrasound equipment, operators, and their training, which make up a signicant proportion of the cost of abdominal aortic aneurysm (AAA) screening programmes. With this in mind, the BVI 9600 promised to be a cost-effective automated ultrasound device to detect AAA without a trained operator. Prior reports are equivocal about its suitability, and this study evaluates the accuracy of this device for the purpose of detecting AAA as part of a low-cost AAA screening programme. We describe some critical limitations of this device and recommend improvements required before it or other similar devices could be used in screening. Objectives: Despite a decreasing incidence of abdominal aortic aneurysm (AAA), the cost-effectiveness of AAA ultrasound screening can be improved by reducing the screening costs and increasing the uptake rates. The BVI 9600 (BVI) is a promising tool for this purpose as it is inexpensive and can detect AAA without a trained operator. This study aims to investigate whether the BVI can be used to detect AAA for the purpose of a low-cost outreach screening approach. Methods: A total of 142 subjects had their abdominal aortae measured by ve sonographers using the BVI and a conventional ultrasound machine. The examination included four anterioreposterior measurements at four equally spaced scanning locations from the xiphisternum to the umbilicus. The measurements produced by each machine were compared using BlandeAltman plots, followed by an analysis of the AAA detection performance. Results: The BVI measured the aortic diameter to within 0.88e1.56 cm of the true diameter, exceeding the 0.5 cm clinically acceptable difference (CAD). Its accuracy was poorer when measuring the aneurysmal aortae (mean difference 0.56 cm, variability 1.72 cm) than normal aortae (mean difference 0.02 cm, variability 0.76 cm). Nine out of 52 aneurysms were not detected due to undersizing measurement and non-visualization of the aortae. Conclusions: At present, the BVI is not sufciently accurate to detect AAA for screening purposes. A number of technical features require improvement. 2014 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved. Article history: Received 8 December 2013, Accepted 24 April 2014, Available online XXX Keywords: Aortic aneurysm, Ultrasound, Screening INTRODUCTION National screening programmes for abdominal aortic aneurysm (AAA) are being implemented based on the re- sults from several randomized trials in the 1990s. 1 These trials suggested that AAA prevalence and the expected number of AAA detected by ultrasound screening were sufciently high to justify the benets and cost- effectiveness of screening. Although the benets of AAA screening remain signicant, 2 the cost-effectiveness of screening in the future is uncertain. Such uncertainty emerged after the observation that incidence of AAA is decreasing 3 and current screening programmes have low yield. 4,5 Lederle 6 suggested that such low yield could be due to low uptake rates by populations with high risk of AAA, many of whom are socially deprived and living in rural areas. 7 In addition, the current screening approach is ex- pected to be costly in the long term due to expensive ul- trasound equipment 8 and the ongoing training costs of screeners with high turnover rates. 9 In order to maintain the cost-effectiveness of screening in the future, it is necessary to have a different screening model that costs less and produces a higher uptake. With this in mind, the BVI 9600 (Verathon Medical UK Ltd, High Wycombe, UK) has been trialled for AAA screening with some promising results. 10 This device is inexpensive and can be used by operators without training in ultrasound imaging. Therefore, screening can potentially be provided at low cost by * Corresponding author. A.M. van Rij, Department of Surgical Sciences, Dunedin School of Medicine, University of Otago, PO Box 56, Dunedin 9054, New Zealand. E-mail address: andre.vanrij@otago.ac.nz (A.M. van Rij). 1078-5884/$ e see front matter 2014 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved. http://dx.doi.org/10.1016/j.ejvs.2014.04.030 Please cite this article in press as: Nguyen ATV, et al., Evaluation of the Accuracy of Aorta Scan BVI 9600 in Screening for Abdominal Aortic Aneurysm, European Journal of Vascular and Endovascular Surgery (2014), http://dx.doi.org/10.1016/j.ejvs.2014.04.030 practice nurses in primary care settings regardless of the geographical location, thus potentially increasing the uptake rate of rural dwellers. In addition to being cost-effective, a successful screening programme needs to be safe. This relies on the accuracy of the ultrasound device at measuring the aortic diameter. Two previous studies in this topic provided conicting results; Flu et al. 10 concluded that the device demonstrated acceptable sensitivity whereas Abbas et al. 11 suggested that the device lacks adequate sensitivity for screening. Our aim was to investigate further whether the BVI 9600 (BVI) is sufciently accurate and with sufciently low variability to be used in AAA screening. The BVI was compared with a conventional ultrasound (US) machine for accuracy of aortic measurements and AAA detection performance. METHODS Settings and patient recruitment This study was conducted over a 4-month period, with par- ticipants recruited from patients referred to the Otago Vascular Diagnostics Laboratory in Dunedin. Inclusion criteria was people aged 50 years and above. There were no exclusion criteria other than age <50 years. Some participants had existing known AAA and were either under surveillance or awaiting treatment. Written, informed consent was obtained having ethical approval from the regional Ethics Committee. Equipment The BVI has a 3.0-MHz circular transducer of 18 cm pene- tration depth capacity. It generates a three-dimensional (3D) scan of the aortic region using ultrasound reections on multiple planes in order to construct a 3D geometry of the aorta. Subsequently, the diameter of the aorta is directly deduced. 10 If the diameter is deemed 3.0 cm or larger, its specic measurement is shown with a result display (which shows a B-mode cross-sectional image of aorta) and an aiming display (which shows the position of the aorta relative to the US probe). If the diameter is deemed to be less than 3.0 cm, the measurement and aiming display will not be shown, in which case the operator manually measured the diameter on the result display using electronic callipers. Comparison US evaluation of the aortic diameters was per- formed by a conventional US device (Toshiba Alipo XG, Zoetmeer, The Netherlands) with a 3.5-MHz abdominal transducer of 28 cm penetration depth capacity, used routinely in the clinical setting. Operators The operators were ve experienced vascular sonographers. A training session was provided by the device manufacturer, including an instruction booklet for revision. None of the operators had used this device prior to this study. Scanning process Each aorta was measured by one sonographer using the BVI rst, followed by a second blinded sonographer using the conventional US machine. Four anterioreposterior aortic diameter measurements were taken on the transverse plane at four equally spaced segments marked along the midline between the xiphisternum and the umbilicus as per the manufacturers instructions (Fig. 1). Measurements us- ing the BVI and conventional US were made at the same marked points. The aortic diameter was measured from inner-to-inner (ITI) sides of the wall using the BVI, whereas using conventional US the aortae were measured from the outer-to-outer (OTO) sides of the walls as in the clinical setting. We dened an AAA as one with a diameter of 3.0 cm or more at any aortic segment, measured from the OTO of the aortic walls. Patients found to have a previously undiagnosed AAA by the conventional US machine were referred back for formal evaluation in the vascular laboratory. Statistical analysis The repeated measurements from both machines were compared. The variability, calculated as 1.96 times the standard deviation of the mean difference, signies how much the BVI measurements varied from those of the conventional US system. This variability was compared with a clinically acceptable difference (CAD) of 0.5 cm, described by Jaakola et al. 12 The 95% limits of agreement (LOA), calculated by the sum of the mean difference and the variability, is the range within which 95% of the differences between the BVI and the US measurements lie. The above statistical measures are illustrated using BlandeAltman plots in which the differences between measurements of each BVIeUS pair are plotted against the averages of those Figure 1. The four scanning locations of the BVI (A, B, C, and D) at which the anterioreposterior aortic diameters were measured in the transverse plane. 2 A.T.V. Nguyen et al. Please cite this article in press as: Nguyen ATV, et al., Evaluation of the Accuracy of Aorta Scan BVI 9600 in Screening for Abdominal Aortic Aneurysm, European Journal of Vascular and Endovascular Surgery (2014), http://dx.doi.org/10.1016/j.ejvs.2014.04.030 measurements. The proportion, measured in percentages of the BVI measurements that were within 0.5 cm of the US measurements, was calculated as described by Lederle et al. 13 Kappa statistics were calculated to determine the inter-observer agreement of the AAA detection between the BVI and US. An analysis of the sensitivity, specicity, positive predictive value (PPV), and negative predictive value (NPV) was performed to enable a direct comparison with the literature. However, the conclusion of our data was drawn from the measurement of variability and the Blande Altman plots for comparing two clinical methods. 14 Visual- isation proportion was dened as the proportion of aortic segments that were visualised adequately to enable aortic diameter measurements by each device. An analysis of the aneurysms that the BVI failed to detect was performed with regard to the likely accountable factors. These statistical analyses were applied to measurements of individual seg- ments of the aorta (A, B, C, and D) and the maximal aortic diameter (the largest measurement out of these four measurements). RESULTS During the study period, 142 participants were scanned. The mean maximal aortic diameter of all the aortae was 3.02 cm (range 1.39e9.46 cm); that of normal aortae was 2.11 cm and of aneurysmal aortae 4.63 cm. Conventional US detected 52 aneurysms (size 3.10e9.46 cm); the BVI detected 43 aneurysms (83%), including eight of the 12 large aneurysms (>5.5 cm, 67%) and 35 of the 40 small and medium aneurysms (3.0e5.4 cm, 88%). Inter-device differences The measurement mean differences, variability, and LOA for the BVIeUS pairs of each aortic segment are presented in Table 1. The BVI measurements were within the CAD in 75e 87% of the time. However, overall the variability was large, ranging between 0.88 and 1.56 cm (Table 1), and increased as aortic diameter increased (Fig. 2). Measurements at the distal segments (C and D) were less accurate than those of the proximal segments (A and B), though a systemic mea- surement bias was present with the BVI consistently under- measuring aortic diameters (Fig. 2). The distal aortic seg- ments were found to associate with more aortic dilatations over 3.0 cm than the proximal counterparts (32 and 42 aneurysms at C and D respectively, compared to 3 and 10 at A and B). Measurement accuracy of the aneurysmal aortae and non- aneurysmal aortae The measurement accuracy of the BVI when measuring aneurysmal aortae was distinctly inferior to that of normal aortae (Fig. 2). This was also demonstrated by a lower percentage of measurements that achieved the CAD (59% vs. 88%, p < .05), a larger systematic bias (mean difference 0.56 vs. 0.02 cm) and a larger variability (1.72 cm vs. 0.76 cm) (Table 2). Consequently, the BVI failed to detect three aneurysms (3.1 cm, 3.56 cm, and 5.74 cm) due to an under-measurement by 0.9e3.9 cm compared to conventional US equipment. Table 1. BVI compared with conventional ultrasound: mean differences, variabilities, limits of agreement (LOA), proportion of measurements within the clinically acceptable difference (CAD), and the number of missed images for measurements of the abdominal aorta taken in the transverse plane at location A, B, C, and D and the maximal measurement from 142 subjects. Mean difference (95% CI) Variability LOA Proportion within CAD (%) n a (total 142) Total number of missed images Number of non-visualised segments (BVI, US) A 0.02 (0.11 to 0.07) 0.88 0.90, 0.86 77 101 41 (29%) 35 (25%), 19 (13%) B 0.03 (0.12 to 0.06) 0.94 0.97, 0.91 81 112 30 (21%) 25 (18%), 8 (6%) C 0.12 (0.25 to 0.02) 1.48 1.59, 1.36 80 120 22 (15%) 21 (15%), 3 (2%) D 0.27 (0.41 to 0.13) 1.56 1.83, 1.29 77 123 19 (13%) 18 (13%), 5 (4%) Maximum 0.19 (0.31 to 0.08) 1.32 1.48, 1.10 78 135 7 (5%) 7 (5%), 0 a Number of BVIeUS pairs. Scans from which no measurement could be obtained were excluded from the analysis and thus the numbers of BVIeUS pairs are different at each aortic segment. CAD: difference <0.5 cm. Figure 2. BlandeAltman plots illustrating the BVI measurement bias where aortic diameters were consistently under-measured, with increasing variability as aortic diameter increased. The dotted red lines demarcate the limits of agreement (mean difference 1.96 SD), the horizontal line is drawn at the mean difference and the variability is indicated as the distance between the horizontal line and each of the dotted red line. European Journal of Vascular and Endovascular Surgery Volume - Issue - p. 1e6 Month/2014 3 Please cite this article in press as: Nguyen ATV, et al., Evaluation of the Accuracy of Aorta Scan BVI 9600 in Screening for Abdominal Aortic Aneurysm, European Journal of Vascular and Endovascular Surgery (2014), http://dx.doi.org/10.1016/j.ejvs.2014.04.030 Non-visualisation of the aorta Non-visualisation occurred more frequently among aortic scans by the BVI (18% of all scan measurements) than the conventional US system (6%) (Table 1). Complete non- visualisation (i.e., involving all four aortic segments) occurred in seven aortae examined by the BVI; whereas this issue was not encountered by the conventional US. Simi- larly, non-visualisation of the distal segments (C or D) occurred in 19 aortae examined by the BVI, compared to eight by conventional US. Consequently, the BVI failed to detect three aneurysms (size 3.7, 5.47, and 6.17 cm) due to complete non-visualisation and another three aneurysms (size 3.4, 4.0, and 5.6 cm) due to non-visualisation of the distal segments. Aneurysm detection The BVI had modest levels of agreement with US in the diagnosis of AAA, having a kappa coefcient of 0.83 (95% CI 0.73e0.92). The sensitivity was 83% (70e92%), specicity 98% (92e100%), positive predictive value 96% (85e99%), negative predictive value 90% (82e96%), false positive rate 2% and false negative rate 17%. DISCUSSION The BVI is a promising tool, suitable for a low-cost and easily accessible AAA screening outreach approach. Unfortunately, its accuracy in AAA detection has not received much attention from the screening literature. This study evaluated the measurement accuracy of the BVI against that of a conventional US machine in 142 subjects. We conclude that, at present, the BVI is not sufciently accurate to detect AAA for the purpose of screening. This is consistent with the conclusion by Abbas et al., 11 where the AortaScan AMI 9700 was compared with CT in 91 subjects (excluding large AAAs and participants with BMI >35 kg/m 2 ). The authors concluded that the device lacked adequate measurement sensitivity (81%) to be used in screening. In contrast, Flu et al., 10 comparing the BVI 9600 with conventional US in 150 subjects clinically suspected of AAA, concluded that the BVI 9600 demonstrated a sensitivity (90%) acceptable for screening. It is difcult to interpret these results, as the specic ultrasound measurement variability of the aortic diameter was not reported in either study. Other studies comparing CT and US measurements of the abdominal aorta commonly regard differences of less than 0.5 cm (the CAD) between the equivalent methods clinically accept- able. 12,13,15,16 In this study, aortic measurements with the BVI exceeded this specied limit. The operators were highly skilled which suggests that the poor performance of the BVI in this study is mainly the result of its technical shortcomings. Because the BVI de- mands minimal operator skills, it is doubtful that more training of the operators can improve the AAA detection accuracy without substantial technical improvement to the device. Hartshorne et al. 8 suggested the same, and that the accuracy achieved should be within the CAD before it could be used in AAA screening. Aneurysm detection Out of 52 aneurysms detected by conventional US, the BVI failed to detect nine aneurysms, three due to measurement inaccuracy, three due to non-visualization of all four seg- ments of the aorta, and three due to non-visualization of the distal segments. Reliable identication of aneurysm is of course the goal of screening. The manufacturer of the BVI stated that the device was designed to simply detect aortic diameters over 3.0 cm, not to accurately measure the di- ameters. 11 However, inaccurate measurements of the aneurysmal aortic diameters by the BVI around this point may have led to its failure to detect a proportion of aneu- rysms in this study. The aneurysmal aortae were less accurately measured than the normal ones, evident by a larger systematic under-measurement bias (0.56 cm) and measurement variability (1.72 cm). Consequently, the BVI failed to detect three aneurysms (3.1 cm, 3.56 cm, and 5.74 cm) due to an under-measurement by 0.9 to 3.9 cm compared to US. Abbas et al. 11 have suggested that the BVI would be more accurate for larger aortae, but this issue remains controversial in studies comparing different con- ventional US devices. 17,18 Failure of the BVI to detect a signicant proportion (33%) of large aneurysms (4 of 12 aneurysms measuring over 5.5 cm) is particularly serious with signicant imminent risk of rupture and the lost op- portunity for immediate repair. The failure to detect 12% of the smaller AAA while having fewer immediate conse- quences for the patients still may signicant clinical implications. There are several possible factors accounting for the poorer performance of the BVI. They include the systematic bias produced by the difference in measuring the OTO wall of the vessel with conventional US compared to an ITI wall technique with the BVI. This would have lead to a system- atic under-measurement by the BVI and the failure to detect borderline aneurysms. Automatic adjustment for this systematic bias is attractive however the size of this effect was too variable. The effect would be accentuated when Table 2. BVI compared with conventional ultrasound: mean differences, variabilities and limits of agreement (LOA), proportion of measurements within the clinically acceptable difference (CAD), and the number of missed images of the maximum normal and aneurysmal aortae diameters with BVI. Mean difference (95% CI) Variability LOA Proportion within CAD (%) n a Number of non-visualised segments (BVI) Normal aortae 0.02 (0.06 to 0.10) 0.76 0.73, 0.76 88 86 4 (4.4%) Aneurysmal aortae 0.56 (0.81 to 0.32) 1.72 2.25, 1.11 59 49 3 (5.8%) a Number of BVIeUS pairs. Scans from which no measurement could be obtained were excluded from the analysis. CAD: difference <0.5 cm. 4 A.T.V. Nguyen et al. Please cite this article in press as: Nguyen ATV, et al., Evaluation of the Accuracy of Aorta Scan BVI 9600 in Screening for Abdominal Aortic Aneurysm, European Journal of Vascular and Endovascular Surgery (2014), http://dx.doi.org/10.1016/j.ejvs.2014.04.030 there is poorer resolution of the BVI to automatically detect the inner margin as may occur in aneurysms burdened by mural thrombi. From this study we considered it to be preferable for the further development of the BVI or any other upcoming non-conventional ultrasound devices designed for AAA screening to follow the more widely used conventional OTO wall measurement of the aortae. It would make comparison with current criteria of AAA easier. However, the measurement technique for the abdominal aorta remains controversial. 19 A recent study by Hartshorne et al. 20 found that the ITI wall method was more repro- ducible and it is used in at least one screening programme. The large measurement variability of aneurysmal aortae with the BVI protocol may be contributed to by the dif- culties in assessing the aortic diameter in the presence of vessel tortuosity. Tortuosity makes the detection of the true cross sectional image difcult. Tortuosity is present in most ectatic aortae 21 and in a signicant number of aortae going on to expand into aneurysms. 22 The ability to cope with vessel tortuosity to insure true cross sectional measure- ment should be a development priority in the technical improvement of the BVI, as also recommended by Hartshorne. 8 Non-visualization Non-visualization of the whole aorta or the distal segments led to failure of the BVI to detect six aneurysms (size range 3.4e6.47 cm). Non-visualization is a well-recognized chal- lenge in ultrasound scanning of the abdominal aorta, commonly due to bowel gas and participant obesity. 23 This was no different in this study although it was not quanti- ed. Real-time scanning and adequate depth of US pene- tration are both needed to minimize these impediments to visualization. Unfortunately, the BVI lacks real-time imaging and has a penetration of only 18 cm. As obesity is associ- ated with AAA, 24 it would be advantageous if real-time scanning and greater penetration depth could be incorpo- rated into the BVI. These technical improvements could particularly minimise the risk of the BVI failing to detect large aneurysms, four out of 12 large aneurysms (>5.5 cm) in this study, due to non-visualisation of the aorta, or its misidentication. Strength of measurement agreement A reasonable kappa score of AAA detection was achieved, signifying an agreement between the BVI and conventional US in regard to detection. In contrast, the sensitivity of detecting AAA is consistent with the results by Abbas et al., 11 who concluded that the BVI was not sufciently sensitive for AAA screening. However, these statistical measures may be misleading due to AAA being a disease of relatively low prevalence, a statistical issue reported by Meehl and Rosen. 25 Implications for screening The conventional US screening cut off for an AAA is 3.0 cm but the BVI device using an ITI measurement may under estimate this by as much as 2e3 mm and exclude signicant numbers of small aneurysms for further surveillance. Hart- shorne et al. 8 suggested that a screening programme using an automated device like the BVI could select a diameter threshold below 3.0 cm for participants to have a follow up conventional US re-evaluation for additional safety. Such an approach with many additional conventional US scans may offset the cost-effectiveness of screening programmes. The minimal operator skill requirement of the BVI eliminates the need to train staff extensively and bypasses the requirement of sophisticated ultrasound operator skills. Therefore, this remains an important potential advantage of the BVI. How- ever, only with further technical development of the BVI scanning technology is this strategy with a low-cost auto- mated device likely to succeed. Another shortcoming of the BVI currently is its lack of ability to detect iliac artery aneu- rysms (IAAs). IAAs share similar risk factors with AAAs yet are underdiagnosed and more lethal when rupturing; thus, there has been suggestion to screen for isolated and coexisting IAA during AAA screening. 26 However, further studies into the cost-effectiveness of such approach are required due to the low incidence of isolated IAA and the unreliable diagnostic accuracy of ultrasonography in detecting co-existing IAA. 27 Limitations of the study include the use of the criteria of less than 0.5 cm as the acceptable measure of variability. This is based on inter-observer and intra-observer variability using conventional US. 15,28 However these inter-observer and intra-observer measures may be different for BVI and was not analysed in this study. It is expected that such variability may have contributed to the measurement vari- ability between the BVI and US system. This does not detract from the overall reasonable basis for this criteria. The sonographers in this study had never used the BVI prior to the study. However, because of their prior experi- ence in ultrasonography they had a considerable advantage over inexperienced prospective screeners in the community for whom the device is designed. We suggest that the generalisability of the study ndings would apply. Larger studies in the future are recommended to test the accuracy of an improved device when used by novices. CONCLUSION At present the BVI is not sufciently accurate to detect AAA for the purpose of screening. The BVI requires sig- nicant technical development before it can be consid- ered for screening in the future. However, were it possible to make these improvements to make the BVI more accurate while maintaining a low-cost prole by eliminating the need for extensively trained ultrasound operators, it could suit a screening model that aims for low-cost and easy accessibility to residents of rural areas and other settings where capture rates of current screening models are low. FUNDING The New Zealand National Heart Foundation (Grant number: 1444). European Journal of Vascular and Endovascular Surgery Volume - Issue - p. 1e6 Month/2014 5 Please cite this article in press as: Nguyen ATV, et al., Evaluation of the Accuracy of Aorta Scan BVI 9600 in Screening for Abdominal Aortic Aneurysm, European Journal of Vascular and Endovascular Surgery (2014), http://dx.doi.org/10.1016/j.ejvs.2014.04.030 CONFLICT OF INTEREST None. ACKNOWLEDGEMENTS The authors gratefully acknowledge Professor Peter Herbi- son for his guidance and assistance with the statistical analysis of this study, and all members of the Otago Vascular Diagnostics Laboratory for contributing to the study. REFERENCES 1 Cosford PA, Leng GC. Screening for abdominal aortic aneurysm. Cochrane Database Syst Rev 2009;2:CD002945. 2 Lindholt JS, Norman PE. Meta-analysis of postoperative mor- tality after elective repair of abdominal aortic aneurysms detected by screening. Br J Surg 2011;98(5):619e22. 3 Sandiford P, Mosquera D, Bramley D. Trends in incidence and mortality from abdominal aortic aneurysm in New Zealand. Br J Surg 2011;98(5):645e51. 4 Svensj S, Bjrck M, Grtelschmid M, Djavani Gidlund K, Hellberg A, Wanhainen A. Low prevalence of abdominal aortic aneurysm among 65-year-old Swedish men indicates a change in the epidemiology of the disease. Circulation 2011;124(10): 1118e23. 5 Earnshaw JJ. Doubts and dilemmas over abdominal aortic aneurysm. Br J Surg 2011;98(5):607e8. 6 Lederle FA. The rise and fall of abdominal aortic aneurysm. Circulation 2011;124(10):1097e9. 7 Badger SA, ODonnell ME, Sharif MA, Boyd CS, Hannon RJ, Lau LL, et al. Risk factors for abdominal aortic aneurysm and the inu- ence of social deprivation. Angiology 2008;59(5):559e66. 8 Hartshorne T. Comments regarding Assessment of the accu- racy of AortaScan for detection of abdominal aortic aneurysm (AAA). Eur J Vasc Endovasc Surg 2012;43(3):359. 9 Earnshaw JJ. Ultrasound imaging in the National Health Service Abdominal Aortic Aneurysm Screening Programme. Ultrasound 2010;18(4):167e9. 10 Flu WJ, Van Kuijk JP, Merks EJW, Kuiper R, Verhagen HJM, Bosch JG, et al. Screening for abdominal aortic aneurysms us- ing a dedicated portable ultrasound system: early results. Eur J Echocardiogr 2009;10(5):602e6. 11 Abbas A, Smith A, Cecelja M, Waltham M. Assessment of the accuracy of AortaScan for detection of abdominal aortic aneurysm (AAA). Eur J Vasc Endovasc Surg 2012;43(2):167e70. 12 Jaakkola P, Hippelinen M, Farin P, Rytknen H, Kainulainen S, Partanen K. Interobserver variability in measuring the di- mensions of the abdominal aorta: comparison of ultrasound and computed tomography. Eur J Vasc Endovasc Surg 1996;12(2):230e7. 13 Lederle FA, Wilson SE, Johnson GR, Reinke DB, Littooy FN, Acher CW, et al. Variability in measurement of abdominal aortic aneurysms. Eur J Echocardiogr 1995;21(6):945e52. 14 Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986;327(8476):307e10. 15 Ellis M, Powell JT, Greenhalgh RM. Limitations of ultrasonog- raphy in surveillance of small abdominal aortic aneurysms. Br J Surg 1991;78(5):614e6. 16 Wanhainen A, Bergqvist D, Bjrck M. Measuring the abdominal aorta with ultrasonography and computed tomography e dif- ference and variability. Eur J Vasc Endovasc Surg 2002;24(5): 428e34. 17 Pleumeekers HJ, Hoes AW, Mulder PG, van der Does E, Hofman A, Lamris JS, et al. Differences in observer variability of ultrasound measurements of the proximal and distal abdominal aorta. J Med Screen 1998;5(2):104e8. 18 Singh K, Jacobsen BK, Solberg S, Kumar S, Arnesen E. The dif- ference between ultrasound and computed tomography (CT) measurements of aortic diameter increases with aortic diam- eter: analysis of axial images of abdominal aortic and common iliac artery diameter in normal and aneurysmal aortas. The Troms Study, 1994e1995. Eur J Vasc Endovasc Surg 2004;28(2):158e67. 19 Long A, Rouet L, Lindholt JS, Allaire E. Measuring the maximum diameter of native abdominal aortic aneurysms: review and critical analysis. Eur J Vasc Endovasc Surg 2012;43(5):515e24. 20 Hartshorne TC, McCollum CN, Earnshaw JJ, Morris J, Nasim A. Ultrasound measurement of aortic diameter in a national screening programme. Eur J Vasc Endovasc Surg 2011;42(2): 195e9. 21 Schmidt G. Differential diagnosis in ultrasound imaging: a teaching Atlas. New York: Thieme; 2006. p. 7. 22 Devaraj S, Dodds SR. Ultrasound surveillance of ectatic abdominal aortas. Ann R Coll Surg Engl 2008;90(6):477e82. 23 Hoffmann B, Bessman ES, Um P, Ding R, McCarthy ML. Suc- cessful sonographic visualisation of the abdominal aorta differs signicantly among a diverse group of credentialed emergency department providers. Emerg Med J 2011;28(6):472e6. 24 Cronin O, Walker PJ, Golledge J. The association of obesity with abdominal aortic aneurysm presence and growth. Atheroscle- rosis 2013;226(2):321e7. 25 Meehl PE, Rosen A. Antecedent probability and the efciency of psychometric signs, patterns, or cutting scores. Psychol Bull 1955;52(3):194e216. 26 Lee ES, Pickett E, Hedayati N, Dawson DL, Pevec WC. Imple- mentation of an aortic screening program in clinical practice: implications for the Screen For Abdominal Aortic Aneurysms Very Efciently (SAAAVE) Act. Eur J Echocardiogr 2009;49(5): 1107e11. 27 Moll FL, Powell JT, Fraedrich G, Verzini F, Haulon S, Waltham M, et al. Management of abdominal aortic aneurysms clinical practice guidelines of the European society for vascular sur- gery. Eur J Vasc Endovasc Surg 2011;41(Suppl. 1):S1e58. 28 Singh K, Bnaa KH, Solberg S, Srlie DG, Bjrk L. Intra- and interobserver variability in ultrasound measurements of abdominal aortic diameter. The Troms study. Eur J Vasc Endovasc Surg 1998;15(6):497e504. 6 A.T.V. Nguyen et al. Please cite this article in press as: Nguyen ATV, et al., Evaluation of the Accuracy of Aorta Scan BVI 9600 in Screening for Abdominal Aortic Aneurysm, European Journal of Vascular and Endovascular Surgery (2014), http://dx.doi.org/10.1016/j.ejvs.2014.04.030