Académique Documents
Professionnel Documents
Culture Documents
ORG
Table of Contents
Mission of the Program Background Subject Examination Program Goals Policy on Use of Subject Examinations Executive Chief Proctor (ECP) Primary Responsibilities of the ECP Security of Examinations Test Delivery Options Paper Examinations at Your Institution Web Examinations at Your Institution Web Examinations at Prometric Test Centers Description of Subject Examinations Content Outlines and Sample Items List of Subject Examinations Description of Item Formats NBME Services Portal (NSP) Online Ordering System Online Ordering of Examinations Roster System for Web Examinations Scheduling Web Exams at Prometric Centers Payment Policy and Procedures Administering Subject Examinations Test Administration Support 2 2 2 2 3 3 3 4 4 4 4 4 5 5 6 6 6 6 8 8 9 9 10 Examinees with Disabilities Enlarged Print Examinations Audio Version of a Paper Examination Extra Time Web Examinations Accommodations at Prometric Test Centers Score and Analytical Reports Scoring, Scaling, and Equating of Examinations Score Report Components Score Interpretation Guide USMLE Equivalents for Comprehensive Examinations Norm Tables Grading Guidelines Item Analysis Reports Performance Profiles Year-End Reports for Clinical Science Examinations Accessing Score Reports on NSP Paper Examination Score Reports Web Examination Score Reports Year-End Reports Score Reporting Processing Agreement Analysis for Irregular Behavior Score Recheck Service Research Faculty Review of Subject Examinations Additional Resources Contact Us 11 11 11 11 12 12 12 13 13 13 13 13 13 14 14 15 15 15 15 16 16 16 17 17 17 18
Copyright 2007, 2011, 2012, 2013 National Board of Medical Examiners (NBME). All rights reserved.
PAGE | 1
Background
The NBME offers standardized, objective, disciplinebased exams for use in assessment throughout the medical school curriculum. The exams are designed to provide institutions with effective evaluation tools and useful examinee performance data that can be compared with a large representative group of examinees at the same stage of training. Subject exams are cost effective, available globally, and provide faculty with valuable feedback on the performance of their examinees. Subject exams are developed and reviewed by committees of content experts following the same rigorous protocol used to build Step 1 and Step 2 Clinical Knowledge (CK) of the United States Medical Licensing Examination (USMLE). NBME subject exams have distinct advantages over locally constructed exams in the assessment of student achievement: The exams provide national norms and relevant descriptive information. These norms reflect the performance of examinees from medical schools accredited by the Liaison Committee on Medical Education (LCME). Items are selected only after extensive review and pretesting. Item formats are similar to those used on Step 1 and Step 2 CK. PAGE | 2
Security of Examinations
To ensure the integrity of the NBME subject examination program and the validity of the scores reported, it is essential to maintain the security and confidentiality of test materials at all times. All items used in NBME subject exams are owned and copyrighted by the NBME. Any reproduction of these materials, in whole or in part, by any means including, but not limited to, photocopying, dictation, or memorization, and/or dissemination of these materials is strictly prohibited. Appropriate action, which may include legal proceedings, will be taken to enforce copyright. The NBME retains the right to discontinue subject examination services in the event of a breach or suspected breach in the security of test materials.
It also includes a function designed to detect any recording applications and programs that may be running on workstations or examinees personal laptops prior to the start of the exam.
Clinical Science
Adult Ambulatory Medicine Adult/Pediatric Ambulatory Medicine Clinical Neurology* Family Medicine Family Medicine Modular* - Core only - Core + Chronic - Core + Chronic + Musculoskeletal Medicine* Obstetrics and Gynecology * Pediatrics * Psychiatry* Surgery*
Comprehensive Examinations
Comprehensive Basic Science* Comprehensive Clinical Science* Introduction to Clinical Diagnosis
*Available for Administration at Prometric Test Centers PAGE | 5 Subject Examination Program Information Guide May 2013
PAGE | 6
Paper Administrations
Orders may be placed up to and including 22 calendar days prior to the test date. Orders cannot be placed within 14 calendar days of the test date. All orders lock 21 calendar days before the test date. An expedited order fee is charged for orders placed 1521 calendar days before the exam date. New order requests within 5 calendar days of the test date cannot be honored. A fee will be charged if an order for a paper exam is changed after the lock date.
All exam orders can be revised or cancelled any time prior to the lock date. After the lock date, the NBME must be contacted to make order changes.
PAGE | 7
Master Roster
The master roster is a list of all examinees who will be taking an NBME web-based exam, usually covering all class levels. In addition to name, date of birth and gender, each record must also include a unique, local ID number. Each examinee must enter this ID number into the test delivery interface in order to start an exam. Other optional fields are available to populate (such as program type and graduation month/year), in order to expedite records search. For examinees who will take an exam at a Prometric test center, the master roster must also include their email addresses.
PAGE | 8
Payment Terms
NBME policies for payment are as follows: Prepayment of invoices generated for NBME exam services is due upon receipt. Payment must be received by the NBME prior to the scheduled test date. Payment must be in US currency only. Checks and/or money orders from examinees will not be accepted. No refunds are provided. Score reports will not be released unless payment for an order has been received. If an account accrues more than $1,000 in invoices that remain unpaid for 91 days following the test date, all score reports associated with that account will be held until the account is brought current. This applies even if other orders for that account were prepaid.
Exam Fees
The fee per examinee is the same for both paper and web-based subject exams. However, there is a separate fee structure for the Prometric test center option. Current fees for subject exams are listed on the NBME website under Services for Schools and Residency Programs: Subject Examination Fees at www.nbme.org.
Payment Options
Payment for exam services may be made by: Credit card (Visa or MasterCard only) Check or money order Wire transfer Institution account with a credit balance
PAGE | 9
A variety of test-delivery environments are supported: both wired and wireless networks, PC and Mac operating systems and laptops or fixed workstations. Also, it is possible to schedule multiple separate testing sessions on the same day or to run testing sessions in different buildings or at separate campuses at the same time.
Administration Support
Paper Examinations
NBME staff are available for test administration support for paper subject exams from 8:00 AM to 5:00 PM US Eastern Time, Monday to Friday. If you have any questions during a paper administration, please contact us at SubjectExams@nbme.org or (215) 590-9258.
TEST ACCOMMODATIONS
Web Examinations at Your Institution
NBME staff will be available for test administration support on your test date to respond to technical or procedural issues that may arise. NBME Staff are available 24 hours a day, 7 days a week
(exclusive of NBME holidays).
Extra Testing Time and Text Enlargement for Local Administration of Web Examinations
The NBME has several pacing options (1.25x, 1.5x or 2x) for examinees needing extra testing time. The pacing is set in the examinees record on the test administration roster, which alerts the system to create an extra time form. Examinees with visual impairments may use their own screen magnification software or use the browsers text size feature to enlarge the font.
PAGE | 11
PAGE | 12
Grading Guidelines
The NBME provides guidelines for analyzing examinee performance for the clinical science and pathology subject exams. These guidelines assist clerkship and course directors in determining passing and honor grades for their examinees. Periodically, the NBME facilitates a review of the guidelines with faculty members and updates them to assure their continued appropriateness. Grading guidelines are included with the score reports and can also be accessed separately on NSP.
Norm Tables
Norms are provided to aid in the interpretation of examinee performance. These norms reflect the performance of examinees from LCME-accredited PAGE | 13
Performance Profiles
Individual Performance Profiles
Individual performance profiles are available for many subject examinations. Profiles are intended for distribution to examinees as an aid in self-assessment and are similar to the USMLE Step 1 and Step 2 CK examinee score reports. For each major content area on the exam, examinee performance is displayed graphically with performance bands representing areas of strength and weakness. An examinee version of the Score Interpretation Guide is provided with each profile.
PAGE | 15
New Examinations
When NBME introduces new exams, scaled score reporting will be delayed for an indeterminate period of time until sufficient data have been collected. If deemed appropriate, percent correct scores and summary statistics will be reported on interim rosters until the process of scaling, equating, and quality control can be completed. After scaled score reports from initial administrations have been posted, scaled scores will be reported within the usual time frame for web-based exams.
Additional Resources
The resources listed below are available online at www.nbme.org:
Administration of NBME Examinations at
Web-based Exam
Best Practices for Web-based Testing on
Wireless Networks
Fees, payment options and policies Sample score reports Subject Examination Timing Chart Subject Examination Content Outlines and
Sample Items
Test Administration Handbook
PAGE | 17
CONTACT LIST
Contact Us
Please feel free to contact us if you have any questions. Various NBME staff can provide the information you need or help solve a problem.
PAGE | 18