Abrami, P.C., & dApollonia, S. (1999). Current concerns are past concerns.

American Psychologist, 54 (7), 519-520.

Abrami, P.C., Theall, M., & Mets, L.A. (Eds.). (2001). The student ratings
debate: Are they valid? How can we best use them? New Directions for
Institutional Research, no.109, (pp. 1-6). San Francisco: Jossey-Bass.
American Association of Community Colleges (n.d.). Community college fact
sheet. Retrieved December 13, 2004, from http://www.aacc.nche.edu
Armstrong, J.S. (1998). Are student ratings of instruction useful? [Electronic
version]. American Psychologist, 53 (11), 1223-1224.
Braskamp, L.A. & Ory, J.C. (1994). Assessing faculty work. San Francisco, CA:
Jossey-Bass.
Cashin, W.E. (1999). Student ratings of teaching: Uses and misuses. In
P.Selden (Ed.), Changing practices in evaluating teaching. Bolton, MA:
Anker.
Centra, J.A. (1979). Determining faculty effectiveness. San Francisco, CA: JosseyBass.
Centra, J.A. (1993). Reflective faculty evaluation. San Francisco, CA: Jossey-Bass.
Centra, J.A. (2003). Will teachers receive higher student evaluations by giving
higher grades and less course work? Research in Higher Education, 44
(5), 495-518.

Creswell, J. W. (1998). Qualitative inquiry and research design: Choosing

among five traditions. Thousand Oaks, CA: Sage.
dApollonia, S., & Abrami, P.C. (1997). Navigating student ratings of
instruction. American Psychologist, 52 (11), 1198-1208.
Dielmam, T. (2004). Applied regression analysis: A second course in business
and economic statistics. Belmont, CA: Thomson.
Dillman, D.A. (1999). Mail and internet surveys: The tailored design method. New
York, NY: Wiley.

Downey, J.A. (2003). Emotional awareness as a mediator of community college

student satisfaction ratings. Community College Journal of Research and
Practice, 27, 711-720.
Dunegan, K.J., & Hrivnak, M.W. (2003). Characteristics of mindless teaching
evaluations and the moderating effects of image compatibility. Journal
of Management Education, 27 (3), 280-303.
Edwards, C.H. (2000). Grade inflation: The effects on educational quality and
personal well being. [Electronic version]. Education, 120 (3), 538-547.
Franklin, J. (2001). Interpreting the numbers: Using a narrative to help others read
student evaluations of your teaching accurately. In K.G. Lewis (Ed.),
Techniques and strategies for interpreting student evaluations. New
Directions for Teaching and Learning, no. 87, (pp. 85-99). San Francisco:
Jossey-Bass.
Forsyth, D. R. (2003). The professors guide to teaching: Psychological
principles and practices. Washington, DC: American Psychological
Association.
Gillmore, G.M., & Greenwald, A.G. (1999). Using statistical adjustment to reduce
biases in student ratings. American Psychologist, 54 (7), 518-519.

Green, S.B., & Salkind, N.J. (2005). Using spss for windows and macintosh:
Analyzing and understanding data (4th ed.). Upper Saddle River, New
Jersey: Pearson.
Greenwald, A. G. (1997). Validity concerns and usefulness of student ratings
of instruction. [Electronic version]. American Psychologist, 52 (11),
1182-1186.
Greenwald, A.G., & Gillmore, G.M. (1997). Grading leniency is a removable
contaminant of student ratings. [Electronic version]. American
Psychologist, 52 (11), 1209-1217.
Heppner, P.P., & Heppner, M.J. (2004). Writing and Publishing your thesis,
dissertation research: A guide for students in the helping professions.
Belmont, CA: Thomson.
Kulik, J.A. (2001). Student ratings: Validity, utility, and controversy. In M.
Theall, P. Abrami, & L. Mets (Eds.), The student ratings debate: Are
they valid? How can we best use them? New Directions for Institutional
Research, no.109, (pp.9-25). San Francisco: Jossey-Bass.
Lesser, D., & Ferrand, J. (2000). Effect of class size, grades given, and academic
field on student opinion of instruction. Community College Journal of
Research and Practice, 24, 269-277.

Lomax, R. G. (2001). An introduction to statistical concepts for education and

behavioral sciences. Mahwah, New Jersey: Lawrence Erlbaum
Associates.

Marsh, H. W. (1987). Students evaluations of university teaching: Research

findings, methodological issues, and directions for future research.
International Journal of Educational Research, 11 (3), 253-388.
Marsh, H. W. & Roche, L. A. (1993). The use of students evaluations and an
individually structured intervention to enhance university teaching
effectiveness. American Educational Research Journal, 30 (1), 217-251.
Marsh, H. W. & Roche, L.A. (1997). Making students evaluations of teaching
effectiveness effective: The critical issues of validity, bias, and utility.
[Electronic version]. American Psychologist, 52 (11), 1187-1197.
Marsh, H.W., & Roche, L.A. (1999). Rely upon set research. American Psychologist,
54 (7), 517-518.
McKeachie, W.J. (1997). Student ratings: The validity of use. [Electronic
version]. American Psychologist, 52 (11), 1218-1225.
Merriam-Websters collegiate dictionary (10th ed.). (1993). Springfield, MA:
Merriam-Webster.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences
from persons responses and performances as scientific inquiry into score
meaning. American Psychologist, 50 (9), 741-749.

Miller, R.I., Finley, C., & Vancko, C.S. (2000). Evaluating, improving, and
judging faculty performance in two-year colleges. Westport, CT:
Greenwood.
Moustakas, C. (1994). Phenomenological research methods. Thousand Oaks,
CA:Sage.
Naftulin, D.H., Ware, J.E., & Donnelly, F.A. (1973). The doctor fox lecture: A
paradigm of educational seduction. Journal of Medical Education, 48, 630635.
Olivares, O.J. (2003). A conceptual and analytic critique of student ratings of
teachers in the USA with implications for teacher effectiveness and student
learning. Teaching in Higher Education, 8 (2), 233-245.
Ory, J. C. (2001). Faculty thoughts and concerns about student ratings. In K.G.
Lewis (Ed.), Techniques and strategies for interpreting student evaluations.
New Directions for Teaching and Learning, No. 87, (pp. 3-15). San Francisco:
Jossey Bass.
Ory, J.C., & Ryan, K. (2001). How do student ratings measure up to a new
validity framework? In M. Theall, P. Abrami, & L. Mets (Eds.), The
student ratings debate: Are they valid? How can we best use them?
New Directions for Institutional Research, no.109, (pp. 27-44). San
Francisco: Jossey-Bass.

Paulsen, M.B. (2002). Evaluating teaching performance. New Directions for

Institutional Research, no.114, (pp. 5-18). San Francisco: Jossey-Bass.
Penny, A.R. (2003). Changing the agenda for research into students views
about university teaching: Four shortcomings of SRT research.
Teaching in Higher Education, 8 (3), 399-411.
Seldin, P. (1984). Changing practices in faculty evaluation: A critical
assessment and recommendations for improvement. San Francisco,
CA: Jossey-Bass.
Seldin, P. (1999). Changing practices in evaluating teaching: A practical
guide to improved faculty performance and promotion/tenure
decisions. Bolton, MA: Anker.
SPSS, Version 11.5 (2002). SPSS for windows. Chicago, IL: SPSS Inc.
Theall, M. & Franklin, J. (2001). Looking for bias in all the wrong places: A search for
truth or a witch hunt in student ratings of instruction. In M. Theall, P. Abrami,
& L. Mets (Eds.), The student ratings debate: Are they valid? How can we
best use them? New Directions for Institutional Research, no.109, (pp. 4556). San Francisco: Jossey-Bass.
Trout, P. (2000). Flunking the test: The dismal record of student evaluations.
[Electronic version]. Academe, 86(4), 58-61.

U.S. Department of Education, National Center for Education Statistics.

Integrated Postsecondary Education Data System. 2004 [Data file].
Available from IPEDS College Opportunities Web site,
http://nces.ed.gov/ipeds/cool
Van Dalen, D.B. (1966). Understanding educational research. New York: McGrawHill.

Angelo, T. A. (1993). Teacher's Dozen": Fourteen general, research-based

principles for
improving higher learning in our classrooms. AAHE Bulletin, 45, 3-13.
Bain, K. (2004). What Makes Great Teachers Great? Chronicle of Higher
Education, 50, B7.
Baiocco, S.A., & DeWalter, J.N. (1998) Successful College Teaching. New
Jersey:
Pearson Education.
Basow, S. & Montgomery, S. (2005). Student ratings and professor selfratings of college
teaching: Effects of gender and divisional affiliation. Personnel Evaluation in
Education, 18,
91-106.
Brookfield, S. (1995). Becoming a Critically Reflective Teacher. San Francisco:
Jossey-Bass.
Cahn, S.M. (1986). Saints and Scamps: Ethics in Academia, Revised Edition.
New Jersey:
Littlefield Adams.
Cashin, W. (1990). Students do rate different academic fields differently. New
Directions
for Teaching and Learning, 43, 113-121.
dApollonia, S. & Abrami, P.C. (1997). Navigating student ratings of
instruction.

American Psychologist, 52, 1198-1208.

El Hassan, K. (2009). Investigating substantive and consequential validity of
student
ratings of instruction. Higher Education Research and Development, 28 (3),
319-333.
Entwistle, N. & Tait, H. (1990). Approaches to learning, evaluations of
teaching, and
preferences for contrasting academic environments. Higher Education, 19,
169-194.
Gallaher, T. (2000). Embracing student evaluations of teaching: a case study.
Teaching
Sociology, 28, 140-147.
Gibbs, G. (1995). Assessing Student-Centered Courses. UK: Oxford Brookes
University.
Halpern, D. F. (1999). Teaching for critical thinking: Helping college students
develop
the skills and dispositions of a critical thinker. New Directions for Teaching
and
Learning, 80, 69-74.
Huemer, M. (2005). Student Evaluations: A Critical Review.
http://home.sprynet.com/~owl1/sef.htm#_14

Developing a Statistically Valid AND Practically Useful Student

http://digitalcommons.georgiasouthern.edu/ij-sotl/vol5/iss1/11
Kember, D., Leung, D. Y. P. & Kwan, K. P. (2002) Does the use of student
feedback
questionnaires improve the overall quality of teaching? Assessment and
Evaluation in Higher
Education, 27, 411425.
Lowman, J. (1995) Mastering the techniques of teaching, 2nd edition. San
Francisco:
Jossey-Bass.
Marsh, H. W. (1982). SEEQ: a reliable, valid and useful instrument for
collecting students
evaluations of university teaching, British Journal of Educational Psychology,
52, 7795.
Marsh, H. W. (1983). Multidimensional ratings of teaching effectiveness by
students from
different academic settings and their relation to student/course/instructor
characteristics,
Journal of Educational Psychology, 75, 150166.
Marsh, H. W. (1987). Students evaluations of university teaching: research
findings,
methodological issues, and directions for future research, International
Journal of
Educational Research, 11, 253388.

Marsh, H. W. (1991). Multidimensional students evaluations of teaching

effectiveness: a
test of alternative higher-order structures, Journal of Educational Psychology,
83, 285296.
Marsh, H.W. & Roche, L.A. (1997). Making students evaluations of teaching
effectiveness
effective; The critical issues of validity, bias, and utility. American
Psychologist, 52, 11871197.
Mauer, T.W., Beasley, J.J., Long Dilworth, J.E, Hall, A.H., Kropp, J.J., RouseArnett,
M., & Taulbee, J.C. (2006). Child and family development students polled:
Study examines
student course evaluations. Journal of Family and Consumer Sciences, 98,
39-48.
McKeachie, W.J. (1997). Student ratings: The validity of use. American
Psychologist, 52,
1218-1225.
McKeachie, W.J. & Hofer, B.K. (2001). McKeachie's Teaching Tips: Strategies,
Research, and
Theory for College and University Teachers, 11th edition. Houghton Mifflin.
Messick, S. (1989). Validity. In R. L. Lynn (ed.), Educational Measurement, 3rd
ed. Old

Tapan, NJ: Macmillan.

Ory, J.C., & Ryan, K. (2001). How do student ratings measure up to a new
validity
framework? In M. Theal, P. Abrami, & L. Mets (Eds.), The student ratings
debate: Are they
valid? How can we best use them? (New Directions for Institutional research,
#109), 2744.
San Francisco: Jossey-Bass.
Perry, W.G. (1970). Intellectual and Ethical Development in the College Years:
A Scheme.
New York: Holt, Rinehart, and Winston.
Pounder, J.S. (2007). Is student evaluation of teaching worthwhile?: An
analytical
framework for answering the question. Quality Assurance in Education, 15,
178-191.
Ramsden, P. (1991). A performance indicator of teaching quality in higher
education: the
Course Experience Questionnaire, Studies in Higher Education, 16, 129150.

IJ-SoTL, Vol. 5 [2011], No. 1, Art. 11

Ramsden, P. & Entwistle, N. J. (1981). Effects of academic departments on
students

approaches to studying, British Journal of Educational Psychology, 51, 368

383.
Richardson, J. T. (2005). Instruments for obtaining student feedback: a review
of the
literature. Assessment & Evaluation in Higher Education, 30 ( 4), 387415
Shuman, H. & Presser, S. (1979). The assessment of 'no opinion' in attitude
surveys.
Sociological Methodology, 10, 241 275.
Teverow, P. (2006). Another metaphor for teaching excellence: Machiavellis
The Prince. The
Teaching Professor, Jan., 3.
Titus, J. (2008). Student ratings in a consumerist academy: leveraging
pedagogical
control and authority. Sociological Perspectives, 51, 397-422.
Trout, P. (2000). Flunking the Test: The Dismal Record of Student Evaluations.
Academe
Online, the Bulletin of the American Association of University Professors,
http://aaup.org/AAUP/pubsres/academe/2000/JA/Feat/trou.htm. Accessed
11/10/2010.UC
Regents (2000). Assessment of Student Learning Gains.
http://mc2.cchem.berkeley.edu/Evaluation/class_ev.html
Voss, R. & Gruber, T. (2006). The desired teaching qualities of lecturers in
higher

education: a means end analysis. Quality Assurance in Education, 14, 217242.

Ware, J.E., & Williams, R.J. (1975). The Dr. Fox effect: a study of lecturer
effectiveness
and ratings of instruction. Journal of Medical Education, 50, 149-156.