Running head: Evaluation Plan

Program Evaluation:
High School Databases
Katie Alexander
Cheri Gogo

ETR 531 Program Evaluation in Education

Fall 2014
Stephanie Richter

Evaluation Plan
2
Executive Summary
The purpose of this evaluation plan is to examine the leading database providers in order
to determine which databases provide the best information for the needs of Township High
School District 214 students. The evaluation is necessary in order to ensure that databases that
are selected as part of the library resource offerings provide students with access to information
that meets their needs in a manner that is easy to access and use as well as to ensure that the
databases selected are financially feasible. The evaluation will focus on two main questions.
The first question is: Do the resources support the curriculum in a cost effective manner? The
second question is: Do the resources provide access to wide range of high quality information
that may be easily accessed and used by staff and students? To accomplish this, the evaluation
will use student surveys, teacher focus groups, data reviews, a database checklist, and an
administrative interview.
Description
Background and History
Over the last decade there has been shift in education away from print reference materials
to digital reference materials accessed through electronic databases. Electronic databases are
available as a subscription services and provide access to information from various types of
sources including reference materials, magazines, newspapers, and academic journals. Databases
have not been used to their full potential by staff and students. With the movement to a 1:1
environment that is driven by the Common Core State Standards, having databases that provide a
breadth of coverage is critical to support the curriculum. Librarians have been tasked with
determining resource needs for the entire school population and making decisions without a
systematic process in place.

Evaluation Plan
3
Township High School District 214 librarians meet yearly to determine which database
subscriptions to continue to use, discontinue using or to begin using. Historically they have met
in the spring armed only with usage statistics and no objectives, assessments, or stakeholder
input. Therefore we are creating a program evaluation that will consider how the databases have
been used, the subscription features, and the effectiveness of the database use in order to meet
the needs of the entire population of the District.
District 214 is located in the northwest suburbs of Chicago and is comprised of six high
schools with over 12,000 students and staff. Databases are shared by the entire District and
housed on a District webpage for access by staff and students. Program evaluation will be carried
out by the six District 214 Head Librarians. The program is subject to approval by the business
manager during the District budget process.
Evaluation needs
The six librarians meet monthly with the District Director of Curriculum and Instruction.
During the database evaluation, the Director expressed the need to have a suite of databases that
more closely meet the district curricular needs. Teachers have expressed a need for digital
resources to support what they are teaching in the classroom. Teachers feel the current collection
of databases has holes in subject area coverage. The focus of the evaluation will be formative.
The Director would like the subscription renewals, due in May 2015, to reflect these changes.
Some resources available to support the evaluation are trial subscriptions to new databases,
current usage statistics, stakeholder interviews, an examination of the curriculum, and additional
collaborative time dedicated to the evaluation process.
Evaluation Purpose

Evaluation Plan
4
The purpose of the database evaluation is to satisfy curricular information needs of
District 214 staff and students. The information gathered will determine subscription renewals
and additions to the suite of databases offered in the 2015/2016 school year.

Program Goals and Outcomes

Logic Model

Resources

Activities

Outputs

Outcomes

Impacts

Staff librarians, IT,

Administrators

Students
conduct
research using
the databases

Students will
produce
research
projects
utilizing
databases

Increased quality
of research by
District 214
students

District 214
students are
recognized for
their skill with
using quality
information in
research

Technology Network,
Computer, EZ
Proxy

Librarians
conduct
information
literacy
instruction

All freshman
students attend
information
literacy
instruction

Students are
competent in
database usage

Staff will find

the databases
invaluable
resources and
alter course
syllabi to
include
database use

School Board

Librarians
conduct
professional
development
opportunities
for staff

Professional
development
attended by
staff

Staff will
integrate
databases into
their project
requirements

Databases Vendors,
Subscriptions,
Support

Librarians will
create
screencast
tutorials of

Screencasts
will be
available for
24/7 support

Staff and
students will find
it easier to use
databases

Evaluation Plan
5
databases

because of the
training materials

Stakeholders
To Make
Policy
Librarians

To Make
Operational
Decision

Teachers
Students
Administrators

To
React

For
Interest
Only

X
X

School Board
Community

Stakeholder Order of Importance

1) Administrators
2) School Board
3) Librarian
4) Teachers
5) Students
6) Community

To Provide
Input to
Evaluation

X
X
X

Evaluation Plan
6

Evaluation Design

Focus

Stakeholders Questions

Uses

Administrators

Do the resources support the

curriculum?

-Determine if
databases support
District goals

Does the current budget cover the

proposed expense?

-Determine if
additional budgetary
funds are needed

Do you feel that the database

program is cost effective?

-Determine if District
funds are being used
responsibly

Is the proposed expense sustainable?

-Determine whether
the program can be
supported over time

U
T
P

School Board

U
T

Librarian

Do the databases meet the needs of

staff and students?

-Materials evaluation

-Determine whether
Do the databases provide high quality the database materials
and diverse information?
encompass a wide
range of information
Teachers

Do the databases meet your curricular -Decide if the

resources enhance
needs?
teaching and learning
-Ensure usage

Students

Are the databases easily accessible

and easy to navigate?

-Determine usability

Evaluation Plan
7
Community

Are the databases on par with

resources available at other high
quality districts?

-Perception

Consolidated Evaluation Questions

Evaluation Question

Rationale

Do the resources support the curriculum in a

cost effective manner?

Addresses questions from the administration,

school board, and librarians
Will be of interest to the faculty and
community

Do the resources provide access to wide range Addresses questions from librarians, teachers,
of high quality information that may be easily and students
accessed and used by staff and students?
Will be of interest to the administrators and
the school board

Evaluation Plan
8

Evaluation Plan Matrix

Evaluation Question

Do the resources support the curriculum in a

cost effective manner?

Information Required

Curricular content, content included in the

databases, subscription costs

Information Source

Curriculum map, database access to survey

the content, quotes from vendors

Method

Documentation review, interview

Sampling

Review curriculum map, review database

content and information sources. Review
previous budgets and expenditures. Interview
administrators
Survey vendors

Information Collection Procedures

Documentation Review: weekly librarian

meeting to align database resources with the
curriculum map. Each meeting should be 45 60 minutes long
Interview: meet with Division Chairs to
discuss departmental needs
Survey: request trials and quotes

Schedule

Documentation Review: Ongoing throughout

the academic year
Interview: November
Survey: March

Analysis Procedures

Documentation Review: Analyze curriculum

map/resources alignment, determine areas of
curriculum that are covered and identify gaps
in resource coverage
Interview: Transcribe information collected
from the interview and organizing information

Evaluation Plan
9
based on content area needs
Survey: Compare coverage from quotes
received from vendors

Evaluation Question

Do the resources provide access to wide range

of high quality information that may be easily
accessed and used by staff and students?

Information Required

Faculty opinion about databases, librarian

analysis, student input on usability

Information Source

Faculty, students, librarians

Method

Faculty focus group, student survey, checklist

of best practices by librarians

Sampling

Focus group (1 group of 8 participants across

the disciplines), survey sent to all students,
checklist developed and used by librarians

Information Collection Procedures

Focus group: open-ended with a list of

guiding questions conducted by librarians,
each group meeting should be 30 minutes
long
Survey: written by librarians emailed to all
students
Checklist: developed and used by librarians

Schedule

Focus groups - November

Survey - January
Checklist - November, December

Analysis Procedures

Transcribe information collected from focus

groups and align information with curriculum
map and resource offerings
Surveys reviewed for student opinions on ease
of use
Checklist developed to assure quality and
coverage of resources

Instruments
1. Student Surveys

Evaluation Plan
10
2. Teacher Focus Groups with directed questions
3. Interview with Curriculum Director with directed questions
4. Checklist for Databases

Evaluation Management Plan

Evaluation Budget
Personnel
Lead Evaluator

45 hours

Assistant Evaluator 1

36 hours

Assistant Evaluator 2

36 hours

Focus Group Facilitator

3 hours

Data Analysis

32 hours
Total Personnel Time

152 hours

Direct Costs
Materials and Supplies

$50.00

Catering for Focus Group

$75.00

Online survey fee (free through Google Apps for Education)

Total amount of this request

$0.00
$125.00

Evaluation Plan
11

Evaluation Timeline

Activity

Resources/
People

Docum
ent
Review

Evaluation
Team/
Librarians

Focus
Group

Teachers

Checkli
st

Librarians

Survey

Students

Analyz
e
Data

Librarians

Prepar
e

Evaluation
Team

Present Evaluation
Team
Deliver
Final
Report

Evaluation
Team

Sept
.

Oct.

Nov.

Dec.

Jan.

Feb.

Mar.

Apr.

May

Evaluation Plan
12

Appendices
Appendix A: Evaluation Instruments
Appendix B: Evaluation Staff Resumes
Appendix C: Human Subject Certificates

Evaluation Plan
13

Appendix A Evaluation Measures

Superintendent of Curriculum Interview Questions
1. As we explore ways to align resources to research projects in District 214, would you
share with us the areas of study for which research may be conducted?
2. As we continue to align with the Common Core State Standards (CCSS), what areas of
the curriculum do you see as needing additional support?
3. Many databases are now offering resources aligned to curriculum and CCSS, as we move
to 1:1 implementation for all students how can these resources support, extend or replace
textbooks?
4. With the many District needs and the costs associated with them, do you anticipate
allocating additional funds to support the expansion of digital resources?
5. Are there any additional factors that we should consider as we investigate diversifying
digital resources?

Evaluation Plan
14

Focus Group Questions

1. Tell us about the classes that you teach and any research project that you have conducted. If
you have not conducted any research projects, what are some areas within your content that you
might be interested in introducing a research project?

2. At this point wed like to hear about the ways that you have used the schools databases in
your research or with your classes.
a. In what ways were the resources helpful to you?
b. In what ways do you feel that the resources fell short in helping you reach your goals?

3. Now imagine that you are part of a professional learning community tasked with redesigning
the research project to align with the Common Core State Standards.
a. What are the types of information that you will your students use in their research?
(Reference, news, magazines, journals, primary sources, multimedia)
b. How important is leveled content to the research project?

4. Now consider the databases that you have used:

a. What has been the greatest benefit?
b. What has been the biggest challenge with using them?
c. If you prefer to conduct Internet only research, tell us why.
d. What features would make databases more attractive/usable?

Evaluation Plan
15
5. Is there anything else that we havent discussed that you think is important for us to know
about as we consider changing the suite of databases that District 214 provides?

Student Survey

Evaluation Plan
16

Evaluation Plan
17

Evaluation Plan
18

https://niu.az1.qualtrics.com/SE/?SID=SV_0Nk8MZnJ9bIoESN

Evaluation Plan
19
Librarian best practices checklist
NAME OF DATABASE:__________________________________
COST EVALUATION
TYPE OF Subscription (Single School/District)

COST of Subscription (per student or per building)

TOTAL COST

TECHNICAL EVALUATION
DATABASE ACCESS
Simultaneous Log-in (Y/N)

Page loading rate (poor/fair/good)

Is the page visually appealing? (Y/N)

Does the database support EZ Proxy? (Y/N)

Refresh Rate? (how often is the database updated)

TECHNICAL SUPPORT
Update Newsletter?
Live Help Desk Hours (24/7?)

Evaluation Plan
20
Toll Free Phone Number?
Email address?

FUNCTIONALITY EVALUATION
CONTENT EVALUATION
Publisher/Provider?

Are the original sources listed? (Y/N)

How many sources are used?

Are periodicals indexed cover to cover? (Y/N)

What type of information is included? (Bibliographic, referral, full

text, other)

What time period is covered? (year range)

Is content aligned with Common Core State Standards? (Y/N)

RECORD ACCESS
Methods? (natural language, keywords, subject)
Is there an Advanced Search Function? (Y/N)

Natural language spelling support? (Y/N)

Evaluation Plan
21
Can different fields be searched individually (author, publication,
date)

NAVIGATION
Are links clearly marked? (Y/N)

Are there alternative navigation aids? (visual, topic, type, date, etc)

Are there links to information beyond each record? (other

documents, Internet sites, etc)

TRAINING
Is there an introduction or description on the opening page? (Y/N)
Is there an online tutorial? (Y/N)

Does each page have a link to a help file? (Y/N)

Is there printable supporting documentation for support? (Y/N)

Is a live tutorial available? (Y/N) (If yes, is there a charge?)

SORTING
Can results be sorted by date? (Y/N)
Can results be sorted by geographic area? (Y/N)

Evaluation Plan
22
Can results be sorted by author/publication? (Y/N)

RESULT ACCESS
Can search results be saved? (Y/N)
Can individual results be emailed? (Y/N)

What is the method for gaining future access? (bookmarks, persistent

links, other)
Is there a Print this link, or is whole screen printed?

DESIGN
Are the graphics that are used appropriate? (Y/N)

Is page layout clear? (Y/N)

Notable features of database. (annotation, highlighting, internal links,

etc)

Additional Comments:

Recommendations:

Evaluation Plan
23
Appendix B: Evaluation Staff Resumes

Cheri Gogo
68 Bassford Avenue
La Grange, IL 60525
708.482.7376
cherigogo@yahoo.com

______________________________________________________________________________
EDUCATION

Northern Illinois University, DeKalb, IL

Instructional Technology Student, Presently

Dominican University, River Forest, IL

Master of Library and Information Science, December 2010

University of West Florida, Pensacola, FL

Bachelor of Science, Business Administration & Management Information Systems, April 2000

SKILLS SUMMARY
Web 2.0 Technologies
AV Setup
Assessment, TRAILS
Research Instruction

Computer Programming

Troubles
Systems Integration
Multimedia Project Instruction

TEACHING EXPERIENCE
Lyons Township High School
Library Media Specialist

August 2013 - Present

Readers

Evaluation Plan
24

Manage the daily operations of the library including supervising staff, instructing students,
purchasing materials, scheduling classes, and providing support for students visiting the library
for various needs
Provide research instruction and facilitate students and teachers in the research process
Provide students with readers advisory services through class book talks and drop-in visits
Purchase materials including books, databases, periodicals, and technology needs
Develop library procedures including the re-writing of the current collection development
policy, mission statements, and vision statement
Planning for the upcoming facility changes by adapting space to serve as a flexible learning
environment

Downers Grove North High School

Library Media Specialist

August 2012 June, 2013

Provide students with instructions in a variety of disciplines including information literacy,

research skills, literature selection and instructional technologies
Partner with classroom teachers and the Instructional Technology Coordinator to design and
implement innovative lessons that transforms student learning
Plan library programming including author visits, reading programs and digital programming
Head partnership with area librarians from feeder districts and the public library, enhancing
community relations
Perform library management duties including collection development and ordering and
cataloging of materials
Participate in professional growth workshops in CCSS, instructional technology and 21st century
learning initiatives
Sponsor DGN Book Club, member of Universal Team for PBIS, member of Communications
Committee, Detention Supervisor

Hinsdale Central High School

Library Media Specialist

August 2011 June 2012

*Applied for and won the National School Library Media Program of the Year award for 2012 from the
American Association of School Librarians

Provided students with instructions in a variety of disciplines including information literacy,

research skills, literature selection and instructional technologies
Perform assessments of student information literacy competencies utilizing the TRAILS
knowledge assessment online tool
Participated in the creation and adaptation of library programming including reading initiatives
and author visits
Contributed to departmental documentation including the application for the School Library
Media Program award
Contributed to collection development by recommending and ordering new materials

Evaluation Plan
25

Substitute - Hinsdale High School District 86

Librarian Substitute

Dec 2010 - May 2011

Performed AV duties including setups, maintenance and inventory

Instructed students on the use of print and digital sources for research projects
Evaluated student presentations and assigned grades based on presentation rubric
Provided class and individual instruction and support to students during information literacy
lessons in the library
Assisted students and staff with the use of technology in accordance with library practices

PRACTICUM EXPERIENCE
Hinsdale South High School - Darien, Illinois

Created podcasts of daily announcements with students

Instructed students on the use of library databases and tools including Noodle Tools and
TurnItIn
Presented book talks to students including multimedia book talks using Prezi
Participated in intense instruction of Advanced Communication which included research and
multimedia instruction
Evaluated student work and assigned grades to students based on their ability to complete tasks

Spring Avenue Elementary, LaGrange, IL

Collaborated with teachers to develop lesson that linked classroom learning to computer literacy
instruction

Assisted students and faculty with technology related issues including instruction and
troubleshooting
Provided readers advisory to students in grades K-6
Instructed students daily in computer literacy lessons, information literacy lessons, and
literature appreciation

WORK EXPERIENCE
Dominican University, River Forest, IL
Student Assistant to Director of the School Library Media Program
Jan 2010 - Dec 2010

Developed and maintained a classroom management system using the Ning platform
Trained and assisted students in using the classroom management system

Evaluation Plan
26

Organized classroom information for use in the LIS 773 School Libraries class

Arthur Andersen, Chicago, IL

Business Systems Analyst
Nov 2000 April 2002

Systems integration work, customizing company-wide computer systems working with Microsoft
Registry and internal files
Analyzed, designed, developed and provided quality assurance for systems/programs of the
Andersen Desktop
Provided high-level support and systems administration to worldwide internal support analysts
utilizing working relationships with corporate vendors
Generated documentation including pseudo code, data flow diagrams and program mapping

Tybrin Corporation, Fort Walton Beach, FL

Programmer/Analyst
Nov 2000

Analyzed, designed and developed projects in accordance with company standard software
process
Provided quality assurance for company produced utilities utilizing in house testing tools
Created detailed test plans for projects in accordance with the Software Engineering Institutes
CMM (Level 3)

PROFESSIONAL AFFILIATIONS

Illinois School Library Media Association

Illinois Computer Educator
American Library Association and American Association of School Librarians

ADDITIONAL INFORMATION

May 2000

Winner of the National School Library Media Program of the Year award 2012
Attended ALA 2012, ISLMA 2010 & 2012, ICE 2012, 2013 & 2014
Submitted to present for upcoming conferences
Presented at Illinois School Library Association 2010 Conference
Spoke at Dominican University School Library Information Session 2011

Evaluation Plan
27

Catherine (Katie) Alexander

812 S. Maple Street
Mount Prospect, IL 60056
847-249-7916
Katie.alexander2@gmail.com
EDUCATION
Northern Illinois University, DeKalb, Illinois
Masters of Technology in Education, expected December 2014
Dominican University, River Forest, Illinois
Master of Library and Information Science, 2012
Concentration: School Library Media Certification (Type 10)
DePaul University, Chicago, Illinois
Bachelor of Science, February 1982
Major: Finance
SKILLS SUMMARY

Web 2.0 Technologies

Literacy Support

Customer Service

Storytelling

Library Management

PROFESSIONAL EXPERIENCE
John Hersey High School
Head Librarian

September 2012-Present

Collaborate lessons with teachers across the disciplines

Assist with planning Interdisciplinary forums
Instruct information literacy for students
Conduct professional development for staff

Evaluation Plan
28
Facilitate the John Hersey High School Book Club
Lines Elementary School, Barrington
Substitute School Librarian
April 2012-June 2012
Collaboration on lessons with kindergarten -5th grade teachers
Integrate information literacy skills
Implementation of technology in lessons
Promote a love of reading
Foster guided inquiry
Lions Park School, Mount Prospect
Reading Support Instructional Aide
September 2007-May 2010
Worked with two cooperating reading specialists
Literacy and fluency support for struggling readers
Guided reading for grades 2-5
Assessed students reading level
Northwest Community Hospital, Arlington Heights
Unit Secretary, Ambulatory Infusion
May 2005 September 2007
Scheduled patient procedures
Entered Billing information
Coordinated charts for nursing staff
Lions Park School, Mount Prospect
December 1995 June 1997
Computer Lab Instructional Aide
Taught keyboarding
Maintained equipment
Collaborated with teachers on information literacy lessons
PROFESSIONAL ORGANIZATIONS/PRSENTATIONS
Member of ALA, YALSA, AASL
IDEAxCHANGE Presentation AASL 2013 Annual Conference,
Hartford CT "Libraries at the Core of Learning: How an Academic
Resource Center supported an increase in student academic success
rate"

Member Illinois School LIbrary Media Association

Member of I-SAIL (Illinois Standards Aligned Instruction for Libraries) Revision Task Force
Aligned the I-SAIL document to the newly adopted Common Core
Standards
Collaborated and created a strategic direction for the internet safety
standard

Evaluation Plan
29
Presenter at ISLMA Annual Conference October 2012 Integrating
Digital Citizenship

LISSA, Dominican University

Member of Library and Information Science Student Organization
Participated in providing information and promotion of the Graduate
School of Library and Information Science
VOLUNTEER EXPERIENCE
Lions Park School PTA, 1990-1996 (Market Day chair, Hospitality, and
various other committees)
Daisy, Brownie and Girl Scout leader, Mount Prospect, 1994-2000.
Cub Scout leader, Mount Prospect, 1990-1996
Prospect High School Parent Advisory Board (Class Representative,
Athletic Booster Representative)

Small group leader, St. Paul Lutheran Church, 2002-present.

Book-a-mania volunteer, Chicago Public Library, 2011. 2012
Butler Childrens Literature Center, Kinship Project Volunteer,
September 11, 2011
Chicago Metro History Fair, Volunteer Research Coach, 2011-2012
Once Upon a time.. Storytelling, West Belmont Branch, Chicago Public
Library, 2011.

REFERENCES AVAILABLE UPON REQUEST

Evaluation Plan
30

Appendix C: Human Subject Certificates

Evaluation Plan
31