Académique Documents
Professionnel Documents
Culture Documents
Table of Contents
Name
List of Leahy Finalists
Pages
Alsardary, Salar
Jonnalagadda, Sriramakamal
40
Maritz, Carol A.
57
Moelter, Stephen T.
63
Tietze, Karen J.
87
Featured Innovators
Alphabetical List by
1st Author
Title of Innovation
Pages
Alsardary, Salar
Aurora,Tarlok Singh
Benau, Danny A.
Blumberg, Phyllis
10
Blumberg, Phyllis,
Cunningham, BJ,
Acton, Patricia,
Byrne, Barbara
Kerr, Buzz, Lyons, Janet
Siarzynski,Kristina,
Yudel, Rachel
12
14
Brunner, Bernard J.
16
18
Crispin, Ruth K.
First Impressions
20
Diaz-Gilbert, Miriam
22
DeSipio, Janet
Student Facilitation
24
Earl, Grace
26
Earl, Grace
28
ii
Featured Innovators
Alphabetical List by
1st Author (continued)
Title of Innovation
30
Flanagan, Christine
32
Gehrman, Philip
34
Harvison, Peter,
Morel, Diane, Tchao, Ruy,
Tejani-Butt, Shanaz
Kirifides, Michael,
Tarloff, Joan
36
Hope, Warren
38
Jonnalagadda,
Sriramakamal
40
Kearney, Pamalyn,
Kramer, Paula
44
Kramer, Paula
47
Mahalingam, Madhu,
Morlino Elisabeth
48
Mahalingam Madhu,
Schaefer Fred,
Morlino Elisabeth
52
55
Maritz, Carol A.
57
McVeigh, Jeanette
61
Moelter, Stephen T.
63
Pages
iii
Featured Innovators
Alphabetical List by 1st
Author
1st Author (continued)
Title of Innovation
Pages
Mostrom, Alison M.
65
Nassir, Mohamed H.
68
Oates, Melanie
World Caf
70
Packel, Lora,
Blumberg, Phyllis
72
Pauley, David
Huddles
74
Peck, Lois H.
76
Peterson, Andrew
78
Pophristic, Vojislava
80
Rosenthal, Bruce
83
Schemm, Ruth
85
Tietze, Karen J.
87
iv
Featured Innovators by
Departments
Title of Innovation
Pages
BIOLOGICAL SCIENCES
Mostrom, Alison M.
65
Peck, Lois H.
76
Mahalingam, Madhu,
Morlino Elisabeth
48
Mahalingam Madhu,
Schaefer, Fred,
Morlino, Elisabeth
52
Pophristic, Vojislava
80
Crispin, Ruth K.
First Impressions
20
Diaz-Gilbert, Miriam
22
30
Flanagan, Christine
32
Hope, Warren
38
BIOMEDICAL WRITING
Benau, Danny A.
CHEMISTRY & BIOCHEMISTRY
HUMANITIES
Featured Innovators by
Departments (continued)
Title of Innovation
Pages
INFORMATION SCIENCE
Bowman, Leslie Ann
14
McVeigh, Jeanette
61
Aurora,Tarlok Singh
Brunner, Bernard J.
16
Nassir, Mohamed H.
68
Kearney, Pamalyn,
Kramer, Paula
44
Kramer, Paula
47
Schemm, Ruth
85
Oates, Melanie
World Caf
70
Rosenthal, Bruce B.
83
OCCUPATIONAL THERAPY
PHARMACEUTICAL AND
HEALTHCARE BUSINESS
vi
Featured Innovators by
Departments (continued)
Title of Innovation
Pages
PHARMACEUTICAL SCIENCES
DEPARTMENT
Harvison, Peter,
36
40
12
18
Earl, Grace
26
Earl, Grace
28
55
Peterson, Andrews
78
PHARMACY PRACTICE/
PHARMACY ADMINISTRATION
Blumberg, Phyllis, Cunningham,
BJ,
Acton, Patricia, Byrne, Barbara
Kerr, Buzz, Lyons, Janet
Siarzynski,Kristina, Yudel, Rachel
Tietze, Karen J.
83
vii
Featured Innovators by
Departments (continued)
Title of Innovation
Pages
Student Facilitation
24
Huddles
74
Maritz, Carol A.
57
72
Gehrman, Philip
34
Moelter, Stephen T.
63
10
PHYSICIAN ASSISTANT
DeSiptio, Janet
PHYSICAL EDUCATION
Pauley, David
PHYSICAL THERAPY
SOCIAL SCIENCES
viii
ix
Leahy Finalist
Title of Innovation: Interactive, Learning- Centered Methods of Teaching Upper Level
Mathematics Courses
Name of Innovator: Salar Alsardary
Telephone Number: 215-596-8761 Email Address: s.alsard@usip.edu
Department: Mathematics/Physics/Computer Science
Type of Students: Intended for Computer Science majors, minors and Mathematics minors
Type of course or activity where implemented: Required, Elective
Leahy Innovation Submission: Yes
Course or activity where implemented: Discrete Mathematics, MA 314
Describe rationale or goals of innovative educational activity:
The instructor distributes the test to the students and gives them few days to return the test
The instructor grades the tests and schedules some time with each student to go over the
test in his office
During the meeting, the instructor asks conceptual questions about each problem in the test
to see the level of understanding of each student
If there is a problem in understanding any point in the test, the instructor explains the
concept thoroughly for the student
At the end of the meeting, the instructor adjusts the grade for each student according to the
explanation that student gives for his test
Sharpen the students mathematical communication skills because of the in class and at the
EPADEL meeting presentations
Instills pride, self-confidence in the students after a successful presentation
Gain experience doing a professional presentation related to mathematics
Help students understand the material better.
Learn connection between Discrete Mathematics and their discipline.
Help students understand Mathematical reasoning in order to read, comprehend, and
construct Mathematical arguments.
I used to assign the sections that the students present randomly but if I teach the course
next time, I will assign hard sections of the course to strong students and easy sections to
weak student
I use to give students the option to meet with me individually to ask any question about the
section that they are presenting before presenting it to the class, but if I teach the course
next time, I will make it mandatory to meet with me.
I will assign long sections in the course to two different students to present in the class
because it will be too much work for one student to present.
What advice would you give to other people adapting this innovation?
Easy for instructor to take over, say too much when students are struggling
When students struggle, instructor thinks this is not efficient and this is very time consuming,
but allowing students to figure things out on their own is an excellent way for them to learn
better
Plan in advance what topics instructor should cover, what topics students should cover
Assign students to topics depending on their strengths
Importance of pre-presentation 1:1 meeting
The instructor spends about four hours/week outside of class meeting with the students in
this course
Describe any outcomes, especially learning outcomes, and/or the implications of the
practice:
The software allows gradually building a question bank. The question bank can also store
outcomes, reading assignments and quizzes for easy access. The physics question bank is in
progress and has not been used extensively enough to describe learning outcomes at present.
Reflect on what is working and why it is working:
Examview software is useful in generating customized question banks and tests. It is useful in all
courses where different types of questions are asked on tests. The ability to print out multiple
versions of one test is very helpful in preventing cheating on in-class examinations.
In which types of courses would this technique be appropriate?
Reflect on what is working and why it is working:
Describe student reaction to the practice:
Students appreciate multiple versions of the same test because it prevents cheating, while the
material being tested on is the same for all students.
Will the practice be sustained within the course? Yes
If Yes, will you do anything differently?
The software can be used for online testing. I may use it for online physics quizzes or practice
problems in future.
Will you implement this practice in other courses? Yes
Explain
At present, I am using it to develop question bank for introductory biophysics course.
What advice would you give to other people adapting this practice?
If you like to develop customized question bank gradually, this software is easy to use. You can
use your customized questions bank along with those commercially available to place more
emphasis on what you need, such as health science applications in a physics course or
applications of mathematics in health sciences.
Do you want this abstract to be considered for a Bright Idea Award? Yes
+ liked
neutral
- disliked
comment
10
Describe any changes in the implementation since the first time you used it:
I refined the topics listed
Describe any outcomes, especially learning outcomes, and/or the implications of the
practice:
It was a very efficient way to summarize much student evaluation data. I shared this feedback with
other instructors. They understand the form and the information immediately.
Reflect on what is working and why it is working:
It is easy to do, and conveys much information efficiently. It helps instructors to see the balance in
my teaching. For example about half of the class liked one assignment; the other half did not like it.
The mean was in the middle, which did not show the distribution as well.
Describe student reaction to the practice:
Not shared with students
Will the practice be sustained within the course? Yes
If Yes, will you do anything differently?
Nothing
Will you implement this practice in other courses? Yes
Explain
It can be used in all courses.
What advice would you give to other people adapting this practice?
Try to keep the summary to 1 page. Record comments that are the most helpful for you when you
revise or review the course. For example, I got an insightful comment from a few students to move
a particular assignment to earlier in the semester so it can be more useful.
Do you want this abstract to be considered for a Bright Idea Award? No
11
12
13
15
Title of Practices: Results of Using Personal Response Devices in the Classroom (Keypads
or Clickers)
Name of Implementer: Bernard J. Brunner
Telephone Number: 215-596-8898 Email Address: b.brunne@usip.edu
Department: Mathematics, Physics and Computer Science
Type of Students: All students especially in larger classes.
Level of students for which this practice can work: Any level
Type of Course or activity where implemented: Lecture
Size of class where this practice can be implemented: 31 - 69, 61 - 100, Greater than
Describe the rationale or goals of the educational practice:
The goal of using keypads is to encourage the engagement of students with the subject matter and
in their own learning particularly in the context of larger classes.
Describe the practice:
Conceptual questions with multiple choice responses are presented to students in class. The
questions may be from questions posted the previous evening on a web site (Just -in-Time
Teaching), they may be standard conceptual questions used in the discipline, they may be
questions related to predicting the result of a live or videotaped demonstration to be done in class,
or they could be questions which arise within the class while considering the current topic.
Students respond by using their keypads or clickers. The distribution of responses is displayed
graphically after the polling is stopped. Unless the response is nearly unanimous, the students will
be asked to discuss the question in groups and the class will be polled again to see if a better
understanding has been reached by the class. Additional discussions and polling may follow a hint
from the instructor when the class is overlooking some information or misunderstanding the
concept.
Describe any changes in the implementation since the first time you used it:
I have tried to use the keypads more often and at different times during the class.
Describe any outcomes, especially learning outcomes, and/or the implications of the
practice:
The Force Concept Inventory (FCI), a widely used standardized test in Newtonian mechanics, is
used to measure conceptual learning that occurs in the first semester of a physics course. The FCI
was used to follow changes as teaching practices were introduced or modified. Normalized gain or
G-score, the fraction of the maximum possible change in individual of class average from pre-test
to post-test, was used as a measure of the effectiveness of the implementation of a technique or
change in technique. The normalized gains in my class have varied, but have moved from about
0.33 to 0.42 with the introduction of the use of keypads.
Reflect on what is working and why it is working:
After initial technological problems were overcome and I became more comfortable with using
discussions, class normalized gains showed noticeable improvements.
16
17
Title of Practices: Platform Patients: Jumping Points for Integrated and Applied Learning
Name of Implementer(s): Vicky Chan, Karen Tietze
Telephone Numbers: 215-596-8738, 215-596-8854 Email Addresses: v.chan@usip.edu,
k.tietze@usip.edu
Department: Department of Pharmacy Practice and Administration
Type of Students: First professional year-Doctor of Pharmacy
Level of students for which this practice can work: Graduate/professional
Type of Course or activity where implemented: Lecture
Size of class where this practice can be implemented: Any size
Describe the rationale or goals of the educational practice:
To apply integrated patient cases that illustrated and applied all major course concepts. The cases
were used to initiate in class discussions, active learning and out-of-classroom self study and
application. The three patient cases were incorporated into all lecture topics for the semester.
Describe the practice:
Three comprehensive and detailed platform patient cases were incorporated into the course to
serve as starting points and for illustration and application of all course concepts throughout the
semester. The platform patient cases were developed to demonstrate major course concepts
including course-related medical terminology, physical assessment and laboratory concepts,
medication history and patient case content and organization. Platform patient cases were
provided on colored card stock and distributed to all students at the beginning of the semester.
Platform patient cases were used individually or together to introduce, illustrate, and apply
concepts discussed during lectures. Students were responsible for learning all the medical
terminology related to each platform patient cases on their own outside of class. Students also
utilized the platform patient cases as templates for organizing their own medication history
homework assignments. Platform patient cases were developed specifically to provide courserelated content. Platform patient #1 was a typical primary care patient with diabetes, dyslipidemia,
and hypertension. Platform patient #2 was an ambulatory patient with chronic obstructive
pulmonary disease, hypertension, and arterial fibrillation. Platform patient #3 was an end stage
liver disease patient awaiting a liver transplant. We were able to take these patients forward and
backwards in time to illustrate a variety of course concepts throughout the semester.
Describe any changes in the implementation since the first time you used it:
N/A
Describe any outcomes, especially learning outcomes, and/or the implications of the
practice:
The learning outcomes included self learning outside of the classroom as the students used the
cases to learn the medical terminology. An unexpected outcome of the platform patients was how
avidly the students adopted the templates for their own medication history homework
documentation. The expectation was that the platform patient cases would enhance the ability of
the students to integrate major course concepts and skills (communication, physical assessment
skills, laboratory diagnostic skills, and pharmaceutical case organizational skills).
18
19
21
22
23
25
27
Title of Practices: The March of the Clickers: Using the Audience Response System in
Lecture
Name of Implementer: Grace Earl
Telephone Number: 215-596-8940 Email Address: g.earl@usip.edu
Department: Department of Pharmacy Practice
Type of Students: Doctor of Pharmacy students
Level of students for which this practice can work: Any level
Type of Course or activity where implemented: Lecture
Size of class where this practice can be implemented: Any size
Describe the rationale or goals of the educational practice:
a. Provide multiple choice questions during lecture to enhance the understanding of the
therapeutic management of peripheral artery disease
b. Promote the use of technology with the audience response system to engage students in
the classroom
c. Provide an opportunity for formative feedback to the students
d. Engage the students in problem-solving in the classroom
Describe the practice:
-
Audience response system software allows you to develop multiple choice questions to
poll the audience.
The audience uses keypads (synonyms are clickers, response card, remote) to transmit
their response via radiofrequency or infrared.
The system is compatible with PowerPoint, and the polling questions are placed within
the PowerPoint slide.
The answers can be formatted so the summative responses appear as vertical or
horizontal bar graphs or pie charts.
The audience can see the percentage of responses per question and also can view the
correct answer
The class responses can be saved in a file and used for assessment (graded or nongraded.)
Describe any changes in the implementation since the first time you used it:
This audience response system can also be used to assess prior knowledge of a topic before the
beginning of a lecture.
Describe any outcomes, especially learning outcomes, and/or the implications of the
practice:
This tool can be used to increase student participation, and the participation can be registered and
accounted for in their grade. You can also use this tool to promote paired-problem solving. During
my class, the students were engaged in discussion of the answers with their classmates. The total
number of students that responded to the questions using the keypads was high. When the class
did not answer a question correctly, it gave me an opportunity to re-direct and repeat explanations
of concepts.
28
29
30
31
3. Understand and explain how writers use various elements of literature (such as plot, setting,
character, point of view, theme, symbolism, irony) and what each element contributes to a
work as a whole;
4. Demonstrate critical thinking skills in well-reasoned and logically developed essays of
analysis and argumentation; in classroom discussions of the literature in the textbook; and
in written responses to the readings;
5. Understand what plagiarism is and how to avoid it.
Reflect on what is working and why it is working:
The Living Legacy Project works because it allows students to see there is more than one way to
gain knowledge. Everyone loves a good story. And whether the story is great literature or an oral
history, students begin to see the relevance of literature to life. The same themes we've discussed
in poetry, fiction, and drama emerge from the oral histories. Also, it is a fun project. As students
meet community members, they feel more a part of the community of Southwest Philadelphia.
Describe student reaction to the practice:
Initially, there is slight resistance. Students are comfortable with sitting in a classroom, reading
assignments, and studying for exams. This project introduces the concept of experiential texts, and
students need to be trained in how experiential learning is an academic exercise. Once the project
begins (and students see how experience underlies ALL texts they read), they are able to see how
they, too, might produce a text similar to the ones they read in their courses.
Will the practice be sustained within the course? Yes
Every year I try to organize our time so we can accomplish more with less inconvenience. The
scheduling and planning always changes to fit community members' needs. Also, we are
incorporating stories from USP staff and faculty.
Will you implement this practice in other courses? Yes
Creative writing courses (Playwriting, Creative Nonfiction) would be wonderful places to incorporate the
Living Legacy Project.
What advice would you give to other people adapting this practice?
Plan ahead. When those plans don't work, be flexible. Don't be afraid to cancel when you see
disaster ahead.
Do you want this abstract to be considered for a Bright Idea Award? Yes
33
35
37
39
Leahy Finalist
Title of Innovation: Enhancing quality of instruction in large classes
Name of Innovator: Sriramakamal Jonnalagadda
Telephone Number: 215-596-8942 Email Address: s.jonnal@usip.edu
Department: Pharmaceutical Sciences Department
Type of Students: Pharm.D. and BS Pharmaceutical Sciences
Type of course or activity where implemented: Required, Professional or Advanced
Leahy Innovation Submission: Yes
Course or activity where implemented: Pharmaceutics and Biopharmaceutics I (PH 316)
Describe rationale or goals of innovative educational activity:
PH 316 (formerly PH 306) is a large class consisting of about 260 students. Instruction for PH 306
consisted of 30-40 PowerPoint slides per lecture, all of which were placed on blackboard for
continuous student access. There was no assigned text for the course. Instead, a list of 5-6
references were included in the syllabus. Assessment consisted of three examinations with about
50 multiple choice questions per exam. Student attendance in the class was low (about 10-40%),
and student evaluations were rated at generally > 2.00. As the course coordinator and an instructor
for two-thirds of the course, it was my perception that students lacked interest in the course, and
practically never used the references, which in turn compromised student learning.
My overall goal was to reorganize my portion of PH 316 (formerly PH 306) with the following
specific goals:
(1) To improve the quality of instruction through student-centered delivery of instructional
material
(2) To improve student interest and learning using correlations of science with real-life
examples
(3) To provide formative and summative assessment to students during examinations.
Describe the innovation and its innovation:
All innovations apply only for two-thirds of the course. (1) To improve the quality of instruction
through student-centered delivery of instructional material: Clarity of expectations: A specific onepage handout was designed for each examination. The handout had the title, "You should
know/understand the following material for Exam 2". The page consisted of very clear, measurable
questions. (Example: What is viscosity and fluidity? what is their mathematical expression and
units?)
Describe any changes in the implementation:
1. To improve the quality of instruction through student-centered delivery of instructional
material:
a) Clear communication of instructor expectations to students: A specific one-page
Objectives handout was provided to students for each examination. The handout had
the title, "You should know/understand the following material for Exam --". The page
consisted of very clear, measurable questions, that the student was required to ask
himself/herself prior to that examination. For instance, "What is the mathematical
expression for viscosity and fluidity? What are their units?
40
b) Assigning a textbook: A specific text book was assigned to the course. Specific page
numbers were provided as reading material to fulfill each of the objectives stated in
the handout provided in class.
c) (c) Instructional material: Powerpoint slides were removed as the instructional
material for the course. Instead, the instructor used a writing pad placed on the
document camera, and began by writing out a question listed in the Objectives
handout. This was then addressed in detail, with several examples from real life (see
innovation 2). Students were assured that the instructor would not move ahead with
the material until all questions were answered. In return, the students were required
not to talk or discuss among themselves.
d) A discussion forum was set up where students were encouraged to post an
interesting article relating to the pharmaceutics. All articles that were recent and had
content related to the course would qualify for additional bonus points. These articles
served as additional instructional material for the course (student understanding of
this material was not assessed).
2. To improve student interest and learning using correlations of science with real-life
examples.
Although several examples were used in class, only three examples will be discussed here.
Example 1: A surfactant is used to mix water and oil together to make emulsions. The
surfactant can be water loving, or oil loving, and can therefore result in an O/W or W/O
emulsion. A surfactant is comparable to a Chinese-English language interpreter, who can
help facilitate communication between monolingual Chinese and English speakers. The
Interpreter can be of Chinese descent that learned English, or of English descent that
learned Chinese.
Example 2: Molecules can diffuse through a hydrophobic membrane by passive diffusion,
active transport, or through aqueous channels. Similarly, we can cross the Delaware River
by swimming, using a boat, or a Bridge.
Example 3: Separation of molecules in a HPLC column is comparable to about 10,000
people who start together to run the Boston marathon, and then separate out based on
speed.
3. To provide formative and summative assessment to students during examinations.
The mid-term examination was split into the following four sections: Memory and retention,
Analysis and Comprehension, Numerical Ability, and Application/Case studies. Although all
questions were multiple-choice, they were weighted differently based which section they
belonged to. For example, a question in the Memory and retention section was worth 1.5
points each, whereas a question in the Application/Case studies was valued at 3 points
each. While reporting results at the end of the examination, the means and standard
deviations for each individual section was reported to each student to ensure formative
assessment. For instance, students who claimed to have read the material over and over
again but performed poorly on the exam, were found to have high scores in the memory
section, but did poorly on the Analysis and Applications sections. In this manner, students
can have access to specific feedback regarding their performance. Specific
recommendations were made by the instructor on that performance on each sections
means, and what may be done to achieve excellence in each section. The final exam was
also split into sections similar to that of the mid-term, and results reported to individual
students to enable summative assessment.
41
Describe outcomes, especially learning outcomes, and the implications of the innovation:
(1) The initial reaction to taking off power-point slides was mixed. Students seemed to want that
method of instruction, as it was easier on their part. The instructor asked the students to
give this a chance and promised that if this method did not seem effective, he would revert
back to slides. After about two weeks of instruction without power-point slides, students
were polled (by paper ballot) their preference for a method of instruction. There was
overwhelming support for the new method (without power-point slides).
(2) Students appeared to like the examples
(3) Students also appreciated the new exam format. Student dissatisfaction was minimal The
outcomes for each section of the examination was along expected lines. For instance, the
Memory and Numerical Ability section had the highest mean with minimal standard
deviation, followed by the Analysis and Comprehensive section. The Applications/Case
studies section had the lowest mean and highest standard deviation.
Reflect on what is working and why it is working:
The new approach taken by the instructor seems to be working.
Describe student reaction to the innovation:
The Student evaluations for the instructor have increased considerably (a grand mean of 1.56 for
the fall 2006 PH 316 class in STC 145). Student attendance has been relatively high (40-80%).
The instructor receives several appreciative e-mails from students, and practically no emails
suggesting dissatisfaction. Student participation in the optional discussion forum has also been
reasonable (20-40%). Finally, it is the instructor's perspective that students enjoy and improved
educational experience as well as learning in this course as a result of these changes.
Will the innovation be sustained within the course? Yes
The Instructor is open to ideas from the Teaching and Learning Center regarding how to further
improve the quality of instruction in his class.
Will you implement this innovation in other courses? Yes
Describe the other courses:
Other graduate courses taught by the instructor.
What advice would you give to other people adapting this innovation?
There were three aspects of teaching covered in this submission.
(1) Instructional Material and delivery: The instructor believes that individual faculty have to use
whatever makes them feel most comfortable. However, they should be open to the fact that
better methods will always exist.
(2) The use of examples: The instructor has seen several faculty who seem to imply that it is
primarily the student's responsibility to comprehend the material by reading references prior
to class. While this may be true, the instructor believes that it is also the instructor's
responsibility to present the material interesting and comprehensible, to ensure that lecture
hour is of value to students.
42
(3) The instructor believes that formative and summative assessments are no longer an option,
and need to be implemented in some manner in all courses.
43
44
Describe any changes in the implementation since the first time you used it:
Over the past several years we have incorporated more structure into the first few client visits
through a semi-structured interview and guiding questions for students to consider. This has
allowed students to feel supported as they begin the process of developing a relationship with their
client. We have also added more formal orientation sessions to the fieldwork experience that
addresses the needs of our referring community agencies to orient the students to the mission and
objectives of the agency. This has strengthened the connection between the student and the
community agency and provided the students with another level of support and resources when
working with challenging clients.
Describe any outcomes, especially learning outcomes, and/or the implications of the
practice:
This experience provides students with an opportunity to apply constructs from the current and
prior courses to a real context, working with a real individual rather than using case scenarios or
simulations. The students have an opportunity to gain experience in navigating the unpredictability
of actual client interactions in a way that is difficult to achieve in the classroom. Students develop
skills in interpersonal interactions and clinical reasoning as well as in application and integration of
knowledge in a practice context.
Reflect on what is working and why it is working:
We believe this project works because of the support that students are given initially and the
independence they experience through the process. It builds upon prior experiences where the
students are working with community organizations in small groups or with a partner. Close
partnerships with community agencies also helps to identify clients who will provide good learning
experiences for our students while benefiting from the experience themselves. This experience
helps students to see the "big picture" and understand their intervention within a broader
community/world context.
Describe student reaction to the practice:
For many students this experience becomes a defining moment in their education when they begin
to be able to see themselves as a competent occupational therapist and are able to integrate
knowledge from several courses into a coherent understanding of an actual clinical problem.
Will the practice be sustained within the course? Yes
This experience is seen as being integral to this course and there is no plan to remove it from the
curriculum. We increased the structure provided to the students (as described previously) a couple
of years ago and have no plans for significantly changing the project this year.
Will you implement this practice in other courses? No
Although this particular experience is not implemented in other courses, we do have several
service learning experiences throughout our curriculum. In addition, our curriculum also
incorporates several other pedagogies designed to increase student responsibility for their
learning.
45
What advice would you give to other people adapting this practice?
There is a need to be sensitive to student concerns about going into the community alone. We
have responded to this via training sessions with campus security, discussions of best times of day
to make visits, recommending a "trial run" so students know exactly where they are going and how
to get there, and offers to travel with the students on the first visit if they are very uncomfortable.
Developing strong community connections takes time but is well worth the effort. This type of
service learning experience is dependent upon the community collaboration and upon the
community members seeing it as a project that is mutually beneficial and not just a learning
experience for the students. Students need to be prepared for the first visit with a plan they can fall
back on if they are struggling to establish rapport and gather relevant information. For this project,
orientation prior to the first visit and the semi-structured interview help to provide this preparation.
Faculty must be available to help students to deal with issues and concerns as they arise. This is
particularly important for this type of experience since students are out in the community, working
in individual homes, without direct supervision. One of the reasons this practice works is because
of the precepting that occurs. We limit each precepting group to 7-10 students in order to facilitate
participation in the weekly meetings and to keep the workload manageable for the faculty member.
Although the project can be used with a course with a large number of students, the practical
limitations are in precepting workload and availability of clients.
Do you want this abstract to be considered for a Bright Idea Award? No
46
48
provide students with a tool to evaluate their own contribution as well as that of their group
members to the problem solving effort
assure that the individual student's effort towards the group work is accurately reflected in
the recitation grade.
Describe the practice:
1. Student groups are assigned based on Math SAT scores in the fall semester, and the
General Chemistry 101 grades received from fall in the spring semester. When students
meet team members for the first time, they are provided with an article "Coping with
Hitchhikers and Couch Potatoes on Teams" J. Student Centered Learning, 2004,Vol. 2,
No.1, 9-34. They are expected to read the article and come up with a group agreement as
to what is expected from each member throughout the semester. The group agreements are
then placed in the group folder as a reminder for each member's responsibility towards their
group as well as a reference source for the instructor in case a disagreement within that
group develops during the semester.
2. Students fill out a Peer Evaluation form twice each semester (after the completion of half of
the problem sets for the semester and the end of the semester) to evaluate their team
members and themselves.
3. The ratings provided by the team members are then entered into a Microsoft Excel
spreadsheet by the TAs where the ratings are converted to an adjustment factor for each
student to be applied to their recitation grade. The adjustment factor can range from 0.75 to
1.05. The actual recitation score for each student is then the raw score the group received
for the problem sets multiplied by their individual adjustment factor.
4. Adjustment factors are arrived at as follows Individual average: Average of ratings received
for the individual student Team average: Average of the individual averages of the team
Adjustment Factor: multipliers obtained by dividing the individual's average by the team's
average
49
Describe any changes in the implementation since the first time you used it:
None.
Describe any outcomes, especially learning outcomes, and/or the implications of the
practice:
Student interaction within the group has improved. Students are more actively engaged in the
problem solving process. Students feel that their contributions matter. Usually the students that
lead the group discussions and help move the group towards the solution are rated highly and end
up with higher adjustment factors. Students who slack off or miss recitation without informing their
peers get rated lower than more responsible group members.
Reflect on what is working and why it is working:
The peer evaluation empowers the students and provides them with a tool to evaluate their
contributions and the contributions of their group members. It makes them feel that students
cannot get away with not contributing to the group activity.
Describe student reaction to the practice:
Survey administered in spring 2007 in both sections, revealed similar student sentiments.
Mahalingam
77.4 %
Morlino
68.5%
Yes 46.67%
Maybe 26.7 %
Yes- 39.72 %
Maybe 31.5 %
Yes 44 %
Somewhat 21.3 %
Yes 45.2%
Somewhat 19.2%
50
51
recitation grading based on student effort. (Barbara Oakley, Richard M. Felder, Rebecca
Brent, and Imad Elhajj, J. Student Centered Learning, Vol. 2, No.1, 2004, pg.29-31)
Describe any outcomes, especially learning outcomes, and/or the implications of the
practice:
Before the innovation, exams were the only assessment used to determine the course grade. After
the innovation the group work in recitation was also included in the course grade. In order to
compare the impact of the innovation, only exam scores are used to compare before and after
grades. Our data shows that the innovation has improved student learning in the classroom
significantly. The percentage of students receiving A, B and C grades increased on average by
about 5 % points after the innovation was implemented. The percentage of students receiving F
grades decreased on an average by about 6-10 % points after the innovation was implemented.
Introducing WebAssign and Peer evaluations have improved student participation based on our
observations.
Reflect on what is working and why it is working:
Group problem solving emphasizes the best approach to learning Chemistry. Students learn that
Chemistry problems need to be worked out through logical thinking and that simply reading a
chapter or memorizing its contents does not result in problem solving ability. They come to
understand that working collectively to solve problems benefits all in the group. They feel less
intimidated about asking questions in the company of their peers. As a result, the interaction
between students and instructors is increased, thereby, creating a more engaged classroom.
WebAssign homework ensures that students attempt problems before coming to recitation
(increased quality time on task). This enables students to participate more effectively in the group
activity. For the faculty, observation of thought processes and the discussions between students
provides a basis for addressing misconceptions. Peer evaluation does send notice to slackers.
Students are less likely not to show up for recitation without informing their peers.
Describe student reaction to the practice:
Some student comments - I learn more in recitation than in lecture. I do not think this is because of
size alone but also because students seem more willing to ask specific question and learn to solve
certain problems. I really enjoy this class. It is very well organized, and the recitation really
supplements and solidifies what we have covered in class. I also feel that the homework can be a
challenge at times, but the recitation is a good way to work out those questions in a smaller
classroom setting making what seems to be homework really a good preparation for the next
recitation. The group work is also a good enhancement for understanding the topic material
because we get to question and answer each other as students about certain problems. The group
work has improved my problem-solving skills because the group members often have alternative
ways to solve problems, so instead of having to rely on my own methods, I have other alternatives.
Will the practice be sustained within the course? Yes
We will continue to monitor the effectiveness of WebAssign homework and the implementation of
Peer evaluations of the group work to ensure maximum student participation.
53
54
Title of Practices: Use of Peer Review for Exam Questions in a Capstone Course
Name of Implementer(s): Laura A. Mandos, Jean Scholtz, Cynthia Sanoski
Telephone Number(s): 215.596.8585, 215.596.8524, 215.596.8933
Email Addresses: l.mandos@usip.edu, j.scholt@usip.edu; c.sanosk@usip.edu
Department: Pharmacy Practice/Pharmacy Administration
Type of Students: Fifth year pharmacy students
Level of students for which this practice can work: Any level
Type of Course or activity where implemented: Lecture
Size of class where this practice can be implemented: Any size,
Describe the rationale or goals of the educational practice:
The goals of the Peer Exam Review Process:
1. Improve the consistency of the exams given in the Pharmacotherapeutics course sequence
in terms of difficulty and language.
2. Improve the quality of the exam questions written
3. Decrease the frustration of the students by giving consistent challenging exams.
Describe the practice:
All questions for Pharmacotherapeutics Exams are reviewed by a three member faculty panel
consisting of the course coordinator as well as two senior faculty members. The members of the
panel were chosen by the course coordinator and had to agree to serve for a whole year. When a
faculty member submits their exam questions, they must submit what teaching/learning objective
the exam question corresponds to as well as where on Bloom's taxonomy does the question fall.
The reviewers then read the questions and submit feedback to the faculty writer. Each exam
contains the same percentage of application/analysis/synthesis questions and knowledge
questions. The faculty writer then submits a final draft of their questions. The writer has the option
to take as little or as much feedback from panel as they wish. The panel comments on grammar,
language, clarity, and content of the questions. We also standardized the format for the K-type
questions. The faculty members are allowed to use a three answers or four answer formats. The
three answer format is the same format used on the NAPLEX exam (Pharmacy Board).
Describe any changes in the implementation since the first time you used it:
The faculty writers were given more time to submit the final draft after they received the peer
review feedback.
Describe any outcomes, especially learning outcomes, and/or the implications of the
practice:
The statistics of the exams, especially the point biserials, and the number of questions dropped
has decreased. The students are satisfied that a group of faculty members are ensuring that some
type of quality control is being used
Reflect on what is working and why it is working:
For the most part, faculty members are appreciative of the feedback and like the idea of someone
else looking at their questions.
55
56
Leahy Finalist
Name of Practices: Making the move to an Aligned Curriculum: The Revision of
Physical Therapy Issues I
Name of Innovator: Carol A. Maritz
Telephone Number: 215-596-8683 Email Address: c.maritz@usip.edu
Department: Physical Therapy
Type of Students: First Professional Year
Type of course or activity where implemented: Required
Leahy Innovation Submission: Yes
Course or activity where implemented: Physical Therapy Issues I: Communication and
Documentation
Describe rationale or goals of innovative educational activity:
Prior to the fall 2006, PT Issues I was a lecture-based course. While the students did have two
hands-on opportunities in the pro bono clinic, the course itself was primarily teacher driven.
Lecture was used to convey new learning material and attempts were made for active breakout
sessions for students to apply this new information. Sometimes case studies or guided questions
were used. One of the noticeable problems was that the students were not prepared for the active
learning portions. Although readings were assigned prior to class it was evident that few had read
the material. Student assessment of learning followed the lecture-based design in that 40% of the
course grade was from multiple choice examinations. Additionally, the students were required to
complete and write up a patient interview, 2 note writing assignments, a patient evaluation and a
discharge summary which made up 55% of the course grade. There were no opportunities for
formative feedback prior to the summative feedback.
Overall the course was rated by the students as 1.62/5.
I felt that the students were not engaged, the lectures were boring, the
examinations did not accurately assess skills, and affective domain was
not fun to teach.
It was apparent that the objectives were not aligned with the learning activities and therefore the
assessments were not a true measure of learning. Based on the feedback from the students and
my own assessment of the course, I determined that this course needed to be revised to more
effectively align with the Mission of the DPT Curriculum as well as to meet both the students' goals
as well as the instructor's needs. Hence, PT Issues I in fall of 2006 was transformed.
A. rationale or goals of innovation,
Goals
1) To create a course that actively engages students in learning the content of communication
and documentation
2) To align this course with the Mission of the DPT Curriculum and its Program Outcomes
Describe the innovation and its innovation:
1. Course objectives were revised to be in line with the Department's Learning Outcomes and
the General Education Skills.
57
2. Learning activities were changed to reflect the move from lecture to case-based format. The
activities selected required active learning opportunities for the students that simulated "real
life". Case studies were developed from real patient scenarios from the Pro Bono Clinic.
Experiential learning opportunities were created such that students interacted with patients
and other health care providers at the Pro Bono Clinic.
3. Assessments reflected the active and experiential learning activities. Formative feedback
was employed to help the students improve the depth of their learning.
I started by developing cases based on "real-life" patient scenarios from the pro bono clinic.
The cases reflected the content of the course.. While the questions that the students had to
answer about the cases from week to week were similar, additional more complex questions were
added as the course progressed. The cases allowed for more than one solution to the problems
which was done to generate deeper discussions among the groups.
Students were assigned into groups of 5 and remained in these same groups for the entire
semester. Groups were responsible for their own leadership and monitoring. Readings were
assigned to help provide the students with background content that would help them work through
the cases. Cases were distributed to the students the day of class. Groups had the first hour of
class to work through the issues in the case. They had to answer a series of questions that helped
them identify the problems and come up with solutions. Some cases would ask the students to role
play and while others involved more problem solving. Following the small group activity, the class
as a whole went through a debriefing process. This debriefing process allowed for different
solutions to be discussed and debated. During this time the instructor would bring up larger policy
issues for the students to try to tackle. Students were assigned to write a brief that summarized
their group activity and asked them to identify 2 things that they learned in that class session
Based on previous classes, I knew that the students needed additional practice opportunities to
refine their patient interview skills. I arranged for USP employees to serve as mock patients for the
students to practice their interview skills.
Learning Activities
1. Case study interviews with mock patients and real patients at the Pro Bono Clinic.
Assessment - 1. Student groups presented their information and wrote a brief that identified
learning and questions.
2. Students wrote up their patient interview and received formative feedback from the
instructor. Students also answered guiding reflective questions about the experience. USP
volunteers also completed a feedback form.
3. Students wrote up their patient interview from the Pro Bono Clinic and received a grade for
this assignment.
Describe outcomes, especially learning outcomes, and the implications of the innovation:
I have multiple data sources to measure learning outcomes:
1. USP volunteers completed a feedback form related to the practice interview session 14/25
forms were returned. They felt the students demonstrated professional behavior and were
well prepared for the interview.
2. Students completed 3 reflection papers related to course activities that capture their
assessment of learning
learned how to interact with patients
58
3.
4.
5.
6.
59
60
62
Leahy Finalist
Title of Innovation: Student Impressions of Self-Correcting Multiple Choice Exams in
Cognitive Psychology
Name of Innovator: Stephen T. Moelter
Telephone Number: 215-596-7534 Email Address: s.moelte@usip.edu
Department: Social Sciences
Type of Students: Psychology
Type of course or activity where implemented: Required
Leahy Innovation Submission: Yes
Course or activity where implemented: Cognitive Psychology
Describe rationale or goals of innovative educational activity:
Student performance on closed-book multiple-choice examinations is thought to reflect learning
through memorization of concepts and exemplars. The addition of an "open-book" period may also
hold significant value by encouraging the student to organize test-relevant material, select areas
for further analysis, and check accuracy. In applied settings, supervisors may value these goals
ahead of content knowledge. Self-Correcting Multiple Choice (SCMC) exams (Montepare, 2005,
18-10, APS Observer) were implemented in a Cognitive Psychology course in order to provide a
testing situation that demanded learning of important concepts and exemplars yet also encouraged
content organization before the exam and fact checking during the exam.
Describe the innovation and its innovation:
Briefly, students were allowed one hour to finish a 45-item, closed book, multiple choice exam,
followed by a minimum 20-minute open book and open notes fact checking period. Students
earned full credit only for correct responses provided during the initial 60-minute session. Half
credit was assigned to items improved during the fact-checking period. One week after the second
of three exams, students (n =19) were surveyed about their experience with the SCMC exams in
comparison to other multiple-choice exams.
Describe any changes in the implementation:
N/A
Describe outcomes, especially learning outcomes, and the implications of the innovation:
Across all three exams a significant four percent mean gain between the closed notes and open
notes period was observed, t (23) = 11.3, p < .005. A trend level negative correlation between test
gain and exam performance, suggested that students who performed at lower levels tended to
show larger gains, r (23) = -.36, p = .08. Results of the SCMC survey following the second exam
indicated that students were generally satisfied with this experience and reported notable effects
on learning and studying relative to other multiple-choice exams. For instance, only 26% of
students reported studying more for SCMC exams but 63% reported improved learning and test
performance relative to other test types. SCMC exams were rated as less anxiety provoking by
68% of students. Perhaps the most compelling result was that 79% of students reported that they
prepared specifically for the SCMC exam by taking notes to use during the fact-checking part of
the exam. Furthermore, 32% of students reported that they changed their approach to non-SCMC
exams (in other courses) as a result of the SCMC exam experience.
63
64
Describe any changes in the implementation since the first time you used it:
This is the first time I have implemented this learning centered activity. This learning activity is a
modification to an earlier "exam-less, lecture-less" format that I used in which students read the
textbook and secondary and primary articles and discussed these in class. I implemented this
change because I felt that having students construct Conceptual Diagrams / Maps promoted
deeper, more meaningful learning, than class discussions. The construction of Conceptual
Diagrams / Maps requires students have to visually and verbally articulate their understanding of a
topic / article by identifying its major components, sub-components, and the relationship between
these factors.
Describe any outcomes, especially learning outcomes, and/or the implications of the
practice:
Outcomes: Students in both settings (General Biology in recitations and juniors / seniors in upper
level seminar / discussion courses) were able to generate Conceptual Diagrams / Maps that
showed they were organizing a relatively complex topic into an appropriate hierarchical structure
with appropriate linkages between components and subcomponents. Students in my upper level
courses successfully integrated the visual map with a verbal summary with formative assessment
from me as the "learning facilitator" and from peers in the class. After these formative
assessments, students revised their Conceptual Diagrams. Two of the Conceptual Diagrams
constructed by students in my Animal Behavior class summarized 2006 Animal Behavior primary
literatures. These were sent to the primary authors for review. Both received very favorable
responses with some suggestions for improvement. The students revised their Conceptual
Diagrams with these authors' suggestions in mind.
Reflect on what is working and why it is working:
1. "Deep and meaningful learning". Students are constructing their own visual summary of a topic
with hierarchical structure and linkages. This is a very "personal" representation of a topic.
Personalization occurs because students have spent time thinking, constructing, often debating
with others, and thereby revising their original thinking about the relationships among
components and subcomponents of a topic. The product is their "intellectual property", and
there are often very proud of it.
2. Teamwork: students are working either as an entire "recitation team" (General Biology I) or in
small groups of 2-3 (Animal Behavior, and Ecology). Students initially chose their teams in my
upper level courses. After each topic, I took an anonymous poll in which students stated
whether they wanted to "stay" in their team or "switch" teams. Students elected to stay in their
teams throughout. I think because they were given power of team membership and the
potential to change that membership they worked well together.
Describe student reaction to the practice:
Student reactions: In General Biology the student reaction was both positive and negative. The
students were much more positive in the upper level classes including,I thought that the format for
this class was new and exciting and made me eager to come to class since I knew I was not going
to be bored by a long lecture"
66
67
68
What advice would you give to other people adapting this practice?
It is very important to use this technique and there will be good opportunity even to develop and
improve this technique.
Do you want this abstract to be considered for a Bright Idea Award? Yes
69
71
72
Describe any changes in the implementation since the first time you used it:
The next time I run this class, I would change around the order of the cases to help facilitate
student learning.
Describe any outcomes, especially learning outcomes, and/or the implications of the
practice:
Student course reviews were very positive. Over this summer I plan on taking a qualitative
assessment of the student briefs and case summaries to determine learning over the course of the
semester.
Reflect on what is working and why it is working:
Developing communication skills was an important part of the PBL format. Students needed to
communicate with classmates who had varied styles and levels of confidence. In addition, problem
solving skills were enhanced through real life cases and student driven discussions.
Describe student reaction to the practice:
Course evaluations were very favorable. Students enjoyed the case studies and were able to see
how the material will impact their practice as physical therapists. Some students suggested that
their personal briefs should be weighed more in the final grade compared to the group case
studies to reflect their personal effort and problem solving skills.
Will the practice be sustained within the course? Yes
If Yes, will you do anything differently?
I may try to create shorter cases so that we can cover two different patient presentations per
module. This would allow us to cover more material, although I am concerned about the depth of
the material covered.
Will you implement this practice in other courses? Yes
Explain
I am considering making PBL a component of two courses in the upper level physical therapy
curriculum to help students relate material to their practice of physical therapy. I believe this will
also enhance their decision making capabilities in the clinical setting.
What advice would you give to other people adapting this practice?
Have an adequate number of professors who help facilitate the process so that each group gets
individualized attention.
Do you want this abstract to be considered for a Bright Idea Award? Yes
73
What advice would you give to other people adapting this practice?
Try it - you like it!
Do you want this abstract to be considered for a Bright Idea Award? Yes
75
76
77
groups to enhance learning. The quality of the work turned-in by students improved as the
semester progressed.
Will the innovation be sustained within the course? Yes
I will continually monitor the student reactions to the group activities and adjust each semester. I
will also look for ways to incorporate new information and attempt new activities.
Will you implement this innovation in other courses? No
What advice would you give to other people adapting this innovation?
Structure the group activities so that individuals must complete work before coming to class to
make a better contribution. Consider requiring this aspect of the work to be handed in with the
group work. This will minimize the potential for students relying on others to accomplish the work.
Also, in the beginning of the semester, have each group develop rules by which it will run and then
have the group assess how well they are abiding by the rules.
79
chemistry and physics courses. The experiments are chosen to illustrate physical characteristics of
compounds/materials used outside traditional chemical applications. Each experiment consists of
two related components: a) a synthesis of a material and b) a characterization or physical
chemistry type experiment performed on the material synthesized by the students in part a). Thus,
students get to integrate their synthetic skills with physical chemistry and analytical skills, and to
follow a material from its synthetic components to its final form in which it performs a certain task,
previously dealt with theoretically. In some cases, students were able to make operational devices
that they encounter in everyday life, such as Light Emitting Diodes (LEDs), and demonstrate their
function, by producing bright light in the case of the LED experiment. Currently, the course
consists of six topics. Experiments are both modified/combined from the literature ones and newly
developed. The first half of the semester focuses on conductivity properties of semiconductors and
superconductors. Students synthesize a bulk and a doped semiconductor, quantum dots and a
superconductor. Students then experiment with the synthesized materials to for example
determine band gap energies, quantum dots sizes, conductivities and kinetics of luminescence.
Through synthesis and characterization, the second half of the semester illustrates mainly
magnetic and nano properties of several materials, and deals extensively with zeolites. I have
developed handouts that cover both the theoretical concepts and experimental instructions, due to
the lack of appropriate textbooks. The experiments are presented in such a way that a certain
degree of independent thinking and experimental reasoning is expected of students, as the course
is taught in their last semesters of undergraduate studies. I have found that students are ready for
and actually appreciate this departure from the traditional "instructional/cook book" approach to
laboratory courses.
Describe any changes in the implementation since the first time you used it:
In the first two semesters of teaching the course, my students have performed a number of
experiments. Several experiments turned out to be more fitting to other courses or, in one case,
too simple for the fourth-year students. At this point, we are running six experiments which are
appropriate for the skill and knowledge level of senior students in Chemistry.
Describe any outcomes, especially learning outcomes, and/or the implications of the
practice:
The main outcome is that students get to integrate skills and knowledge obtained in various
courses, including this course, by working on one project that leads them through major steps in
producing a device or an application. Although researcher responsibilities in industrial settings are
usually limited to one type of chemistry, appreciation of all steps leading to a product is crucial for
researchers to become effective team members. Students taking this course get hands-on
experience on a sequence of steps needed to solve a real problem, of a type that they are likely to
encounter as graduated chemists. Thus, an additional outcome of the course is that the students
are trained to be good team members.
Reflect on what is working and why it is working:
The course in its current format is an effective tool for introducing interdisciplinary problems in an
experimental setting. The choice of topics used in the course illustrates several major subfields of
Materials Science and Solid State Chemistry. The choice of experimental tools leads students
through a number of synthesis and characterization techniques.
81
82
thinks about possible strategies he will always think: "But could this get Bruce to marry Princess
Stephanie"
Describe student reaction to the practice:
Enthusiastic, interested and intrigued. One student has a friend who teaches strategy in Drexel
and he was very intrigued by the way I was going about teaching the fundamentals of strategy.
Will the practice be sustained within the course? Yes
Possibly: I might have the students develop an overall strategy for marrying P.S. using an
integrated version of all the strategies we cover in class.
Will you implement this practice in other courses? No
Probably not - it works for strategy, not leadership or international business.
What advice would you give to other people adapting this practice?
Make it fun, yet stress that the purpose is to get the students to understand how complex strategy
is to create and implement.
Do you want this abstract to be considered for a Bright Idea Award? Yes
84
85
86
Leahy Finalist
Title of Innovation: Bingo Motivates Students to Interact with Course Material
Name of Innovator: Karen J. Tietze
Telephone Number: 215-596-8854 Email Address: k.tietze@usip.edu
Department: Pharmacy Practice/Pharmacy Administration
Type of Students: First professional year Doctor of Pharmacy students
Type of course or activity where implemented: Required, Professional or Advanced
Leahy Innovation Submission: Winner 2007 Leahy Award
Course or activity where implemented: PP305 Introduction to Clinical Pharmacy Skills
Describe rationale or goals of innovative educational activity:
Students in the first professional year of the pharmacy curriculum tend to spend most of their time
on "high-stake" courses (higher credit courses with more frequent exams). Students typically wait
to study for the clinical skills course until just before the practical, midterm and final exams and
often cut classes, especially before and after exams in high-stakes courses. This "test-to-test"
culture has a negative impact on class attendance and long-term retention of course content.
The objectives of the bingo game are to create an extra-credit activity to:
1) increase student interaction with course material throughout the semester
2) provide students with options for demonstrating learning.
Describe the innovation and its innovation:
A twenty-five square bingo game card (five rows and five columns) was developed for students in
the fall and spring semester Introduction to Clinical Pharmacy Skills courses (one-half the students
take the course each semester). Extra credit was earned for achieving bingo defined as earning
five squares in a row vertically, horizontally or corner-to-corner. Students who achieved bingo
earned a five-percentage point bonus added to the final course grade. An anonymous survey was
distributed to students at the end of the fall semester; some bingo activities were added or deleted
for the spring semester based on student feedback.
The bingo activities were chosen to encourage students to review course material at least every
two weeks (on-line self-assessment quizzes), to motivate students to perform better on the
required graded activities (exams and competencies performance), to appeal to students with
different learning styles (create posters, computer animations, 3-dimensional objects, poems,
videos, crossword puzzles), and to encourage close attention to required readings and lecture
material (identify errors). The game card was designed to disperse the more convenient and timeconsuming activities. Participation was voluntary and students were free to choose if and how they
wanted to achieve bingo. Students submitted all bingo materials towards the end of the semester.
Describe any changes in the implementation:
Two new activities were added for the spring 2007 course (create Jeopardy-style
questions/answers; write, perform and record a song about a major course concept).
87
Describe outcomes, especially learning outcomes, and the implications of the innovation:
A total of 2506 bingo squares were earned. All students enrolled in both semesters of the course
completed at least one voluntary bingo activity. The majority of students achieved bingo (74.6% in
the fall and 81.9% in the spring). The bingo extra-credit changed the letter grade (e.g., C+ to B-) for
39% of the students. Students who achieved bingo in the fall and spring semesters had an
average course grade seven points and ten points, respectfully, higher than the average course
grade for the prior six semesters. Students who did not achieve bingo in either semester had an
average course grade 12 points lower than the average course grade from the prior six semesters.
These results suggest that achieving bingo may have had a beneficial effect on student learning
beyond the extra-credit points. The mean number of squares earned by students who achieved
bingo was significantly higher than the mean number of squares earned by students who did not
achieve bingo in the fall semester (11.6+/-1.8; range 8-17 vs. 6.5 +/-2.2; range 2-11; p<0.001) and
the spring semester (9.5+/- 1.6; range 5-13 vs. 5.1+/- 2.8; range 1-11; p<0.001).
Reflect on what is working and why it is working:
The extra-credit bingo game was well-received by students. Large numbers of students
demonstrated learning in nontraditional ways, including creative visual/graphic and performance
arts. Achieving bingo may have had a beneficial effect on overall student learning. The bingo game
accomplished the objectives of increasing student interaction with course material throughout the
semester and providing students with choices and flexibility for demonstrating their learning in the
course.
Describe student reaction to the innovation:
Fifty six (43%) of the fall semester students completed an anonymous survey about the bingo
game. Ninety-six percent agreed that bingo should be continued. The majority felt that bingo
helped the review (58.9%) and keep up (55.4%) with the course material. More than a third felt that
bingo took some of the pressure off the written exams (46.4%), made the course more interesting
(33.9%), and allowed them to demonstrate their knowledge and skills (33.9%).
Will the innovation be sustained within the course? Yes
If Yes, will you do anything differently?
Bingo activities will be added or deleted based on student participation and feedback.
Will you implement this innovation in other courses? Yes
Describe the other courses:
I would consider implementing the bingo game in any course with a "test-to-test" culture.
What advice would you give to other people adapting this innovation?
For courses with large numbers of students, an electronic course management system such as
Blackboard or Angel is necessary to automate the on-line quiz access and timing and posting of
grades.
88
Telephone Number(s) *
Email Address(es) *
Department(s) *
89
Online class
Seminar/discussion
Size of class where this practice can be implemented: *
Any size
Less than 30
31 - 69
61 - 100
Greater than
Describe the rationale or goals of the educational practice: *
Describe any changes in the implementation since the first time you used it: *
Describe any outcomes, especially learning outcomes, and/or the implications of the practice: *
90
No
What advice would you give to other people adapting this practice? *
Do you want this abstract to be considered for a Bright Idea Award? (for a description of the Bright
Idea Award see http://www.usip.edu/teaching/award.shtml *
Yes
No
Submit Practice
91