Académique Documents
Professionnel Documents
Culture Documents
IN NURSING
Introduction
Clinical instructors have always been concerned with measuring and evaluating
the progress of their students. As the goals of nursing education have become more
complex and as the number of students has increased enormously, this task has
become much more difficult.
Clinical instructors have an obligation to provide their students with the best
evaluation. This implies that they must have some procedures whereby they can reliably
and validity evaluate how effectively their students have been taught. The classroom
achievement is one such tool.
After completing this seminar workshop the participants are expected to:
Is a devise for describing test items in terms of the content and the process
dimensions. That is, what a student is expected to know and what he or she
is expected to do with the knowledge. It is described by combination of
content and process in the table of specification.
A two-way chart which describes the topics to be covered by a test and the
number of items or points which will be associated with each topic.
TOS typically are designed based on the list of course objectives, the topics
covered in class, the amount of time spent on those topics, textbook chapter topics and
the emphasis and space provided in the text. In some cases a great weight will be
assigned to a concept that is extremely important, even if relatively little class time was
spent on the topic.
V. How Can the Use of a TOS Benefit Your Students, including Special Need?
VI. How do you prepare a TOS for different types of test for a teacher made test?
You have to determine what content you want to cover and what percent of the
test items should there be for each content. You need to decide what depth of
understanding you want for your test items, like what percent of the questions should be
synthesis etc.
TABLE 1
TABLE 2
Skill in
Observing Comparing, Making Total
Knowledge Understanding and classifying inferences number Item Percent
Behavior of of basic describing objects from of items
Contents Specific concepts and placement of items
objects based on observation
Facts principles observable
character-
istics
Disturbance in
oxygenation
10 7 3 4 24 1-24 24%
Disturbance in
metabolic and
endocrine
17 10 7 5 3 42 25-65 42%
functioning
Disturbances
in Elimination
7 14 7 4 2 34 66-100 34%
Number of
Items
34 31 17 13 5 100 100
Percent of
Items
34 31 17 13 5 100%
TABLE 4
Table of Specifications
Learning Outcome
Instructional Objectives Motor Declarative Procedural Strategic
Attitude Total
Skills Knowledge Knowledge Knowledge
I. Safe and Quality Nursing Care Pencil paper test:
A. Demonstrates knowledge base on the Selection Type
status of the individual and the Multiple Choice
emergency situation. (5pts)
1. Identifies emergency situation
5
prompting to implementation of
basic life support procedure.
2. Identifies individual subject to
basic life support during
emergency situations.
B. Provides sound decision making in Pencil paper test: Pencil paper test: Pencil paper
the emergency care f the individual/ Selection Type Selection Type test: Selection
group in the emergency situation. Multiple Choice Multiple Choice Type Multiple
1. Identifies the problem (1pt) (3pts) Choice (1pt) 5
2. Gathers Primary Survey data
related to the individual in the
emergency situation
Formats:
1.
Levels of Learning
Topics Remembering Understanding Applying Analyzing Evaluating Creating Total Percent
Covered
TP IP TP IP TP IP TP IP TP IP TP IP
ITEM ANALYSIS
Item Analysis refers to the process of examining the student’s response to each
item in test According to Abubakar S. Asaad and William M. Hailaya (Measurement and
Evaluation Concepts & Principles) Rex Bookstore (2004 Edition), there are two
characteristics of an item. These are desirable and undesirable characteristics. An item
that has desirable characteristics can be retained for subsequent use and that with
undesirable characteristics is either be revised or rejected.
a. difficulty of an item
b. discriminating power of an item
c. measures of attractiveness
Difficulty Index (DF) refers to the proportion of the number of students in the
upper and lower groups who answered an item correctly. In a classroom achievement
test, the desired indices of difficulty not lower, than 0.20 nor higher than 0.80. The
average index of difficulty from 0.30 or 0.40 to a maximum of 0.60.
DF = PUG + PLG
2
PUG = proportion of the upper group who got an item right
PLG = proportion of the lower group who got an item right
Maximum Discrimination is the sum of the proportion of the upper and lower
groups who answered the item correctly. Possible maximum discrimination will occur if
the half or less of the sum of the upper and lower groups answered an item correctly.
Notations:
Formula:
Di = PUG – PLG
DE = Di / DM
DM = PUG +PLG
Example: Eighty students took an examination in Algebra, 6 students in the
upper group got the correct answer and 4 students in the lower group got the correct
answer for item number 6. Find the Discriminating efficiency.
Given:
Sample item data and the resulting indices derived from the procedures
described in this chapter are presented below.
Answers Total No.
of Difficulty Discrimination
Item Group H-L
A B C D Correct Index Index
Answers
1 H 20 3 14 2 1
21 52.5 7 0.35
L 20 10 7 3 0
2 H 20 0 0 18 2
27 67.5 9 0.45
L 20 0 3 9 8
3 H 20 4 8 4 4
10 25.0 6 0.30
L 20 10 2 4 4
4 H 20 3 3 4 10
14 35.0 6 0.30
L 20 2 4 10 4
5 H 20 15 2 2 1
16 40.0 14 0.70
L 20 1 10 4 5
* Italicized numbers indicate correct answers Number of Students Tested = 60
Using Information About Index of Difficulty
The difficulty index of a test item is important because it tells a teacher something
meaningful about the comprehension of or performance on, material or task contained
in an item. A closer look at the sample item data presented above reveals that item 2 is
easy as its difficulty index is 67.5%. The same is true with item 1, with an estimated
difficulty index of 52.5%.
The foregoing points to one thing – that the higher the value of the difficulty
index, the easier is the item. This is because difficulty index represents the percentage
of the total number of students answering an item correctly. Thus, there is an inverse
relationship between the magnitude of the index and what it purports to represent. For
an item to be considered a good item, its difficulty index should be 50%. An item with
50% difficulty index is neither easy not difficult. If an item has a difficulty index of 67.5%,
this means that it is 67.5% easy and 32.5% difficult. Information on the index of difficulty
of an item can help a teacher decide whether a test item should be revised, retained, or
modified.
Exercises:
Analyze the summarized results of a hypothetical test item analysis. Supply the
necessary details to complete the table. Decide whether to retain; reject; or modify each
item. Write your answer on the column for decision a teacher should make.
Do an item analysis with the scores using the procedures cited in this chapter.
Instructional objectives play a very important role in the instructional process and
the evaluation process. It serves as a guides for teaching and learning., communicate
the intent of the instruction to others and it provide a guidelines for assessing the
learning of the students. Instructional objectives also known as behavioral objectives or
learning objectives are statement which clearly describe an anticipated learning
outcome.
Bloom identified six levels within the cognitive domain from simple recall of facts
as the lowest level through increasingly more complex and abstract mental level, to the
highest level that can be classified as evaluation. Verb samples for stating specific
learning outcomes that represent intellectual activity on each level are presented here.
Psychomotor Domain
A. VALIDITY is the degree to which the test measures what is intended to measure.
It is the usefulness of the test for a given purpose. A valid test is always reliable.
B. RELIABILITY refers to the consistency of score obtained by the same person
when retested using the same instrument or one that is parallel to it.
C. ADMINISTRABILITY the test should be administered uniformly to all students so
that the scores obtained will not vary due to factors other than differences of the
students’ knowledge and skills. There should be a clear provision for instruction
for the student, proctors and even the one who will check the test or the scorer.
D. SCORRABILITY the test should be easy to score; directions for scoring is clear,
provide the answer sheet and the answer key.
E. APPROPRIATENESS the test item that the teacher constructed must assess the
exact performances called for in the learning objectives. The test item should
require the same performance of the student as specified in the learning
objectives.
F. ADEQUACY the test should contain a wide sampling of items to determine the
educational outcomes or abilities so that the resulting scores are representatives
of the total performance in the areas measured.
G. FAIRNESS the test should be biased to the examinees. It should not be
offensive to any examinee subgroups. A test can only be good if it is also fair to
all test takers.
H. OBJECTIVITY represents the agreement of two or more raters or test
administrators concerning the score of a student. If the two raters who assess the
same student on the judge is valid, thus lack of objectivity reduces test validity in
the same way that lack reliability influence validity.
Reliability of a Test
Reliability refers to the consistency of measurement, that is, how consistent test
results or other assessment results from one measure to another. We can say that a
test is reliable when it can be determined by means of Pearson Product Correlation
Coefficient, Spearman-Brown Formula and Kuder-Richardson Formula .
Statistics play a very important role in describing the test scores of students.
Teachers should have a background on the statistical techniques in order for them to
analyze and describe the results of measurement obtained in their own classroom;
understand the statistics used in the test and research reports; interpret the types of
scores used in testing.
Changes in terminology between two versions are perhaps the most obvious
differences and can also cause the most confusion. Basically, Bloom’s six major
categories were changed from noun to verb forms. Additionally, the lowest level of the
original, knowledge was renamed and became remembering. Finally, comprehension
and synthesis were retitled to understanding and creating. In an effort to minimize the
confusion, comparison images appear below.
Old taxonomy – evaluation was the highest level, higher than synthesis. In the past,
educators have accepted that critical thinking was higher than creative thinking.
BLOOM’S TAXONOMY
Knowledge Level
Objective : The student will be able to identify various types of schizophrenia
Test Item : Which of the following is not a type of schizophrenia?
Comprehension
Objective : The student will be able to provide examples of several psychological
concepts.
Test Item : Which of the following would be an instance of compliance?
a. moving away from the group norm regardless of prior opinions
b. maintaining one’s belief in the face of group pressure to change those
beliefs.
c. following group norms in overt behavior but not cognitively
d. seeking group consensus without carefully considering all possible
arguments.
Application Level
Objective : The student will be able to calculate the expected date of delivery.
Test Item : If Cathy’s cycle is regular and her last menstrual period is April 20, 2010,
when is the expected date of delivery?
a. January 20, 2011
b. January 27, 2011
c. January 13, 2011
d. January 30, 2011
Analysis Level
Objective : The student will be able to make generalizations about the research
results.
Test Item : Nurse Bryan has carried out a number of experiments on the bargaining
process. Generalizing from his results, we can conclude that
a. The more threatening the weapons that bargainers acquire, the more
likely they care to compete.
b. The more threatening the weapons that bargainers have, the more
likely they are to cooperate.
c. Threatening weapons do not influence bargaining as much as saving
face does.
d. We cannot accurately conclude any of the above
Evaluation Level
Objective : The student can recognize the values and points of view used in a
particular judgment of a work.
Test Item : Which of the statements can correctly be made about Organization and
Management.