Académique Documents
Professionnel Documents
Culture Documents
November/December 2002 69
connections to liberal education tradi- outcomes, these outcomes must be potential to transform our society.
tions (Decker, 1999); higher-order, clearly defined: Are they the sets of Boyer (1990) is usually given credit for
paradoxical thinking (De Witt, 2000); knowledge and skills that may be more introducing the concept of the scholar-
and dialogues to help students become directly or simply measured or aspects ship of teaching. He proposes four types
more critical, analytical, and flexible of student learning, confidence, and cre- of scholarship: discovery, integration,
(Meyer, 2000). ativity that have less objective or quan- application, and teaching. Many authors
Much of the continuing discussion titative measures? have tried to apply this concept of a
related to capstone business courses has Student outcomes could also be scholarship of teaching (Benjamin,
involved the review and evaluation of assessed in terms of “value added” 2000; Cross & Steadman, 1996; Edger-
potential methods and tools used in knowledge or skills gained between a ton, Hutchings, & Quinlan, 1991;
these courses. Common approaches student’s entry into a program or course Healey, 2000; Kreber & Cranton, 1997;
include more traditional lectures based and its completion. Subsequently, this Menges & Weimer, 1996; Neary, 2001;
on textbook chapter assignments, writ- “value added” learning might be com- Richlin, 1993; Schon, 1995).
ten or oral discussions of business cases, pared with that gained by students in Hutchings and Shulman (1999, p. 13)
analyses of specific corporations or benchmarked programs or courses at stated that the scholarship of teaching
industries as term projects, and simula- other institutions. For example, Jacobi, involves “practices of classroom assess-
tions and/or role-playing exercises that Astin, and Ayala (1987) recommended ment, evidence gathering, current ideas
are computer-based and completed by that institutions consider taking a “tal- involvement and peer collaboration and
teams of students. Many articles have ent development” approach encompass- review” as well as features of being
appeared in the last decade on just the ing the period from student entry to exit public or community property, openness
topic of introducing and comparing var- rather than relying on more common to critique and evaluation, construction
ious computerized games or simulations reputational and resource-based assess- that others can contribute and build on,
for these courses (e.g., Wolfe, 1997). ments. Redmond (1998) urged that the and concern with inquiry on issues of
number and types of assessment ques- student learning. Others have extended
Capstone Course Assessment tions be dependent on the mission and the concept of “scholarship of teaching”
Challenges goals of the institution, college, depart- to focus more on actual learning and the
ment, and program. Student outcomes role of students in the learning process.
It seems obvious that excellence in might also be assessed through a wide Menges et al. (1996) explored faculty
teaching and learning should be a major variety of measures including final and student roles in a learning process
objective in institutions of higher educa- exams, course grades, scores on the in which dialogues about experiences
tion. Assessment of teaching effective- graduate admission tests, competency and views among students and faculty
ness is a common process for examining assessment, performance evaluations, members occur naturally. Neary (2001)
gaps between objectives and results as capstone course performance, senior echoed this concern, advocating a shift
well as for generating plans for theses, employer surveys, alumni sur- in emphasis from the teacher’s efforts or
improvements. However, persistent veys, external reviews, student exit even the student’s response to the quali-
problems arise in evaluating college interviews/surveys, and employment ty of the developing relationship
teaching (McKeachie & Kaplan, 1996). and graduate school placement rates. between the teacher and student.
For example, researchers such as Panici Assessment of the capstone business Course-based approaches for devel-
(1999) used adjectives such as “simplis- course is a complex process that must oping SOTL have been advocated (Kre-
tic,” “primitive,” “sporadic,” and “inad- be viewed from a multidimensional per- ber, 1999), as have discipline-based
equate” to characterize the assessment spective. Critical concerns include the approaches, such as Healey’s (2000)
of undergraduate teaching. purposes, scope, and stages for under- work in his discipline of geography.
Although assessment is critical for taking assessment. However, Kraft (2000) questioned fac-
teaching excellence, Kraft (2000) traced ulty attentiveness to teaching and learn-
many assessment deficiencies to deeper The Scholarship of Teaching and ing issues at the department or disci-
cognitive and relational characteristics Learning pline levels in many institutions of
found in academic cultures. One of the higher learning. Though faculty com-
more significant issues associated with Over the last decade, a powerful munication does involve curricular
assessment is determining precisely approach called “the scholarship of issues, it rarely includes issues of teach-
what is being assessed. Is it a program, teaching and learning” has emerged in ing and learning. Kraft contended that,
a course or course component, the the education literature for reconsider- within our own departments and disci-
teaching of a course, or student out- ing excellence in teaching and learning. plines, we have barriers to honest and
comes in a course? The issue is com- A review of this literature proved useful open exchanges about learning and
pounded further with the complexity of for us in developing a framework for therefore often find it easier to establish
applying such levels of assessment. assessing the business capstone course. university-wide or crossdisciplinary
Let us take, for example, the issue of The “scholarship of teaching and forums on such issues to overcome
assessing “student learning outcomes.” learning” (SOTL) reform movement, some of these barriers within depart-
First, because there can be a variety of according to Atkinson (2001), has the ments and disciplines.
November/December 2002 71
chaired a caucus on assessing the busi- quences, so students did not study for tion and the course activities specific to
ness capstone course at the national the exam; nor did many students appear our capstone experience. In addition to
Academy of Management meeting in to take it seriously. Thus, the exam was questions about general levels of satis-
Washington, D.C. in August 2001. Ten of very little value for assessing the faction with certain aspects of the
or more faculty members attending the knowledge that students retained from course, this instrument also focused on
session described their individual core business courses. students’ perceptions of the level of
instructional and assessment methods In cooperation with the undergradu- CBK background knowledge and skills
for capstone courses. Though anecdo- ate curriculum committee, we devel- that they brought into the capstone
tal, this session provided useful inputs oped a new senior exit exam to identi- experience. The survey also explored
on capstone course assessment fy key knowledge that a student in core student views regarding the extent of
approaches that were not described in courses might be expected to retain and application of that CBK knowledge and
our literature review. apply in the capstone course. Seniors skills in capstone course activities and
will be required to take the test prior to offered comparisons of such CBK
Phase 2. Institutional Faculty scheduling the capstone course and to applications and amount of overall stu-
Perceptions and Curricular Concerns pass it eventually in order to receive a dent study and preparation for individ-
degree from the school of business. ual capstone course instructors.
If, as Redmond (1998) stated, suc- The revised exam with its significant
cessful completion of the business cap- consequences should serve as a partial Phase 4. Business Community
stone course should demonstrate stu- means of assessment for core business Stakeholders
dent acquisition of the knowledge, courses and better assure that students
skills, and appreciations stated in objec- have the foundation to succeed in the Continuing with the stakeholder
tives of earlier required business cours- capstone course. approach, we queried area business
es, then any assessment of the capstone executives and professionals who had
course must consider these earlier class- Phase 3. Student Perceptions hired or might be likely to hire our grad-
es. To help address this issue of assess- uates to provide a “downstream” assess-
ing the cumulative and integrative Students are obvious stakeholders in ment of our students. Our business
nature of the capstone course, we turned any capstone course assessment process. school dean has a business advisory
to faculty members in our undergradu- Feedback on student satisfaction with council whose purpose is to provide
ate business program who teach courses the business capstone course was avail- support and advise or counsel faculty
in what many business schools call the able from several sources, beyond con- members and administrators. Using a
“common body of knowledge” (CBK). ventional student evaluations of teach- computerized decision support system,
All students take these CBK courses. ing. In an earlier program assessment this group of over 30 business and pro-
Faculty members teaching these CBK effort in 1997, our institution established fessional people formulated and priori-
courses determined key knowledge and a benchmarking partnership that eventu- tized a list of knowledge areas and work
skills, which they expected students to ally included as many as 10 other busi- skills deemed critical to the success of a
retain from their courses and apply. ness schools in Georgia. Student satis- new business school graduate.
The purpose of this “upstream analy- faction surveys from graduating seniors In reviewing this list, we learned that
sis” was twofold. First, we wanted to were part of this overall benchmarking a vast majority of the professionals’
learn, beyond our initial assumptions, effort. These student surveys provided expectations were skill- or values-based
what other business faculty members relative comparisons of courses com- rather than focused on disciplinary
considered core business knowledge monly taught in participating business knowledge. In a subsequent meeting for
and skills in their respective CBK schools. This feedback, however, told us initial data gathering, while working
courses. Second, this information little about the effectiveness of our cap- with faculty members who taught CBK
helped us develop a clearer set of expec- stone course or about satisfaction levels courses, we developed a matrix to com-
tations as to what knowledge and skills that student experienced with specific pare the knowledge-, skill-, and values-
might reasonably be expected from stu- aspects of teaching and learning in this based expectations desired by these
dents entering the capstone course. capstone course. business leaders with those expectations
This analysis coincided with another As an adjunct to these broad-based that were currently being addressed in
assessment measure being developed in student satisfaction data, we developed each CBK course. We shared this matrix
our business school. For many years, an instrument that focused on assessing with the business and professional advi-
graduating seniors had been expected student views of actual teaching and sors and received further comments and
to take a senior exit exam. The purpose learning outcomes in the capstone suggestions from them.
of this exam was to provide feedback course. Capstone business course facul-
on how well students grasped the ty members at several other institutions Continuing Assessment
knowledge that they were supposed to shared assessment instruments used to Challenges
retain over their 4-year program. evaluate capstone course learning.
Though required of graduating stu- These instruments were adapted to fit A primary assessment challenge has
dents, the exam carried no conse- the liberal arts interests of our institu- been to determine the shifting focal
November/December 2002 73
Neary, B. U. (2001). The scholarship of teaching Peattie, K. (1990). Pretending to understand busi- tions for Teaching and Learning, No. 54. San
sociology: Process versus content focus. Paper ness policy. Management Education and Devel- Francisco: Jossey-Bass.
presented at the Southern Sociological Society. opment, 21, 287–300. Schon, D.A. (1995). The new scholarship requires
Sociological Abstracts Accession Number Prince, W. W., Helms, M. M., & Haynes, P. L. a new epistemology. Change, 27(6), 26–34.
2001S40135. (1993). Project-focused library instruction in Thomas, A. S. (1998). The business policy course:
Nelson, R. E., Bass, K. C., & Vance, C. (1994). business strategy courses. Journal of Education Multiple methods for multiple goals. Journal of
Managed group formation: An approach to for Business, 68, 179–183. Management Education, 22, 484–497.
team formation in policy courses. Journal of Redmond, M.V. (1998). Outcomes assessment Wiener, N. (1948). Cybernetics: Control and com-
Education for Business, 70, 25–29. and the capstone course in communication. munication in the animal and the machine. New
Panici, D. A. (1999). Methods of assessing teach- Southern Communication Journal, 64(1), York: Wiley.
ing: Investigating the how and why. Journalism 68–75. Wolfe, J. (1997). The effectiveness of business
& Mass Communication Educator, 54(2), Richlin, L. (Ed.). (1993). Preparing faculty for the games in strategic management course work.
61–72. new conceptions of scholarship. New Direc- Simulation & Gaming, 28, 360–376.