Académique Documents
Professionnel Documents
Culture Documents
Table of Contents
Introduction ............................................................................................................................... 3
AdvancED Standards Diagnostic Results .................................................................................... 4
Leadership Capacity Domain............................................................................................................... 4
Learning Capacity Domain .................................................................................................................. 5
Resource Capacity Domain ................................................................................................................. 6
Effective Learning Environments Observation Tool® (eleot®) Results ....................................... 7
eleot Narrative.................................................................................................................................. 11
Findings .................................................................................................................................... 13
Improvement Priorities ..................................................................................................................... 13
Insights from the Review .................................................................................................................. 19
Next Steps......................................................................................................................................... 20
Team Roster ............................................................................................................................. 22
Addenda................................................................................................................................... 24
Student Performance Data ............................................................................................................... 24
Schedule ........................................................................................................................................... 27
Introduction
The AdvancED Diagnostic Review is carried out by a team of highly qualified evaluators who examine the
institution’s adherence and commitment to the research aligned to AdvancED Standards. The Diagnostic Review
Process is designed to energize and equip the leadership and stakeholders of an institution to achieve higher levels
of performance and address those areas that may be hindering efforts to reach desired performance levels. The
Diagnostic Review is a rigorous process that includes the in-depth examination of evidence and relevant
performance data, interviews with stakeholders, and observations of instruction, learning, and operations.
Standards help delineate what matters. They provide a common language through which an education community
can engage in conversations about educational improvement, institution effectiveness, and achievement. They
serve as a foundation for planning and implementing improvement strategies and activities and for measuring
success. AdvancED Standards were developed by a committee composed of educators from the fields of practice,
research, and policy. These talented leaders applied professional wisdom, deep knowledge of effective practice,
and the best available research to craft a set of robust standards that define institutional quality and guide
continuous improvement.
The Diagnostic Review Team used the AdvancED Standards and related criteria to guide its evaluation, looking not
only for adherence to standards, but also for how the institution functioned as a whole and embodied the
practices and characteristics of quality. Using the evidence they gathered, the Diagnostic Review Team arrived at a
set of findings contained in this report.
As a part of the Diagnostic Review, stakeholders were interviewed by members of the Diagnostic Review Team
about their perspectives on topics relevant to the institution's learning environment and organizational
effectiveness. The feedback gained through the stakeholder interviews was considered with other evidence and
data to support the findings of the Diagnostic Review. The following table lists the numbers of interviewed
representatives of various stakeholder groups.
1.1 The institution commits to a purpose statement that defines beliefs about teaching Needs
and learning, including the expectations for learners. Improvement
1.3 The institution engages in a continuous improvement process that produces Needs
evidence, including measurable results of improving student learning and Improvement
professional practice.
1.6 Leaders implement staff supervision and evaluation processes to improve Needs
professional practice and organizational effectiveness. Improvement
1.7 Leaders implement operational process and procedures to ensure organizational Needs
effectiveness in support of teaching and learning. Improvement
1.8 Leaders engage stakeholders to support the achievement of the institution’s Needs
purpose and direction. Improvement
1.9 The institution provides experiences that cultivate and improve leadership Needs
effectiveness. Improvement
1.10 Leaders collect and analyze a range of feedback data from multiple stakeholder Needs
groups to inform decision-making that results in improvement. Improvement
2.1 Learners have equitable opportunities to develop skills and achieve the content Needs
and learning priorities established by the institution. Improvement
2.2 The learning culture promotes creativity, innovation and collaborative problem- Needs
solving. Improvement
2.5 Educators implement a curriculum that is based on high expectations and prepares Needs
learners for their next levels. Improvement
2.7 Instruction is monitored and adjusted to meet individual learners’ needs and the Needs
institution’s learning expectations. Improvement
2.9 The institution implements, evaluates, and monitors processes to identify and Needs
address the specialized social, emotional, developmental, and academic needs of Improvement
students.
2.10 Learning progress is reliably assessed and consistently and clearly communicated. Needs
Improvement
2.11 Educators gather, analyze, and use formative and summative data that lead to Needs
demonstrable improvement of student learning. Improvement
2.12 The institution implements a process to continuously assess its programs and Needs
organizational conditions to improve student learning. Improvement
3.1 The institution plans and delivers professional learning to improve the learning Needs
environment, learner achievement, and the institution’s effectiveness. Improvement
3.2 The institution’s professional learning structure and expectations promote Needs
collaboration and collegiality to improve learner performance and organizational Improvement
effectiveness.
3.4 The institution attracts and retains qualified personnel who support the institution’s Needs
purpose and direction. Improvement
3.7 The institution demonstrates strategic resource management that includes long- Needs
range planning and use of resources in support of the institution’s purpose and Improvement
direction.
3.8 The institution allocates human, material, and fiscal resources in alignment with the Needs
institution’s identified needs and priorities to improve student performance and Improvement
organizational effectiveness.
Every member of the Diagnostic Review Team was eleot certified and passed a certification exam that established
inter-rater reliability. Team members conducted 27 observations during the Diagnostic Review process, including
all core content learning environments. The following charts provide aggregate data across multiple observations
for each of the seven learning environments.
1.9 1.8
1.8 1.7
1.5 1.5
1.3
Environment Averages
Not Observed
Very Evident
Somewhat
Indicators Average Description
Evident
Evident
Learners engage in differentiated learning opportunities
A1 1.3 74% 26% 0% 0%
and/or activities that meet their needs.
A3 2.6 Learners are treated in a fair, clear, and consistent manner. 7% 41% 41% 11%
Not Observed
Very Evident
Somewhat
Indicators Average Description
Evident
Evident
Learners strive to meet or are able to articulate the high
B1 1.5 63% 26% 11% 0%
expectations established by themselves and/or the teacher.
Overall rating on a 4
point scale:
1.5
Not Observed
Very Evident
Somewhat
Indicators Average Description
Evident
Evident
Learners demonstrate a sense of community that is positive,
C1 1.5 63% 26% 11% 0%
cohesive, engaged, and purposeful.
Overall rating on a 4
point scale:
1.8
Not Observed
Very Evident
Somewhat
Indicators Average Description
Evident
Evident
Learners' discussions/dialogues/exchanges with each other
D1 1.7 48% 30% 22% 0%
and teacher predominate.
D3 2.0 Learners are actively engaged in the learning activities. 30% 44% 26% 0%
Not Observed
Very Evident
Somewhat
Indicators Average Description
Evident
Evident
Learners monitor their own progress or have mechanisms
E1 1.5 59% 33% 7% 0%
whereby their learning progress is monitored.
Overall rating on a 4
point scale:
1.5
Not Observed
Very Evident
Somewhat
Indicators Average Description
Evident
Evident
Learners speak and interact respectfully with teacher(s) and
F1 2.0 33% 41% 22% 4%
each other.
Overall rating on a 4
point scale:
1.8
Not Observed
Very Evident
Somewhat
Indicators Average Description
Evident
Evident
Learners use digital tools/technology to gather, evaluate,
G1 1.5 70% 15% 11% 4%
and/or use information for learning.
Overall rating on a 4
point scale:
1.3
eleot Narrative
The Diagnostic Review Team conducted 27 core content classroom observations that provided insight into
instructional practices and student learning across the seven learning environments. Rating averages on a four-
point scale ranged from a high of 1.9 in the Equitable Learning Environment to a low of 1.3 in the Digital Learning
Environment. All data points were below 2.0, which confirmed the urgent need for improvement in all seven
learning environments.
The Diagnostic Review Team noted that staff members expended great effort on managing student behavior. The
Well-Managed Learning Environment, however, emerged as an area of concern for the team, as a well-managed
classroom is the foundation needed for teaching and learning. It was evident/very evident that students “are
treated in a fair, clear, and consistent manner” (A3) in 52 percent of classrooms, which suggests that observers
could not confirm this important practice in about half of the classrooms. Also related to student and teacher
relationships was that students who “speak and interact respectfully with teacher(s) and each other” (F1) and who
“demonstrate knowledge of and/or follow classroom rules and behavioral expectations and work well with others”
(F2) were evident/very evident in 26 percent of classrooms. These findings indicated that classroom management
and relationships between staff and students require immediate attention in order to focus on needed
instructional improvements. Finally, it was evident/very evident in 34 percent of classrooms that learners had
“equal access to classroom discussion, activities, resources, technology, and support” (A2), indicating that equity in
the learning environment was not consistently present.
In addition to behavioral expectations, another major concern to the team related to high academic expectations.
It was evident/very evident in seven percent of classrooms, for example, that assignments and classwork were
“challenging but attainable” (B2) and learners were able to “demonstrate and/or . . . describe high quality work”
(B3). Moreover, it was evident/very evident in zero percent of classrooms that students “engage in differentiated
learning opportunities and/or activities that meet their needs” (A1).
Inconsistent progress monitoring and a lack of students understanding the lesson content also troubled the
Diagnostic Review Team. Students who were able to “verbalize understanding of the lesson/content” (E3) were
evident/very evident in 15 percent of classrooms. One student stated, “If we fill out the worksheet, we get five
points for participation.”
Also of note was the overall average rating of 1.3 for the Digital Learning Environment. In the principal overview
presentation, stakeholders shared that the school had a one-to-one technology initiative through the use of
Chromebooks. However, the team found little evidence that students used “digital tools/technology to gather,
evaluate, and/or use information for learning” (G1), as that practice was evident/very evident in 15 percent of
classrooms. In addition, it was evident/very evident in four percent of classrooms that learners used digital
tools/technology “to communicate and work collaboratively for learning” (G3) or “conduct research, solve
problems, and/or create original works for learning” (G2).
Findings
Improvement Priorities
Improvement priorities are developed to enhance the capacity of the institution to reach a higher level of
performance and reflect the areas identified by the Diagnostic Review Team to have the greatest impact on
improving student performance and organizational effectiveness.
Improvement Priority #1
Establish, implement, monitor, and clearly communicate a systematic continuous improvement process that
provides clear direction for improving conditions that support learning and organizational effectiveness. This
process should include the following documented steps: 1) procedures for analyzing and disaggregating data to
identify both the academic and non-academic needs of students, 2) assessment of high-yield instructional
strategies that lead to best practice instruction, and 3) the development and implementation of an evidence-based
walkthrough evaluation process that ensures that adjustments in instruction occur to meet individual student
needs and improve professional practice. (Standard 1.3)
Evidence
Team members who observed daily Teacher Learning Groups (TLG), otherwise known as professional learning
community (PLC) meetings, surmised that this allotted time was essentially an additional daily planning period for
teachers, since no team members observed these groups following an agenda or taking minutes. The Diagnostic
Review Team was provided copies of the “PLC Agenda and Minutes” and “Stuart Academy Protocol for Looking at
Student Work: Quality Work Lens,” but the team could not confirm that either document was used. In addition,
the team could not confirm that student work was being examined or that teachers discussed content standards
during PLC time.
Teachers stated that no behavior program was ever fully implemented. Several teachers new to Stuart Academy
reported that they received no feedback from evaluations or classroom walkthrough observations.
Improvement Priority #2
Develop and monitor a systematic process to implement the district-adopted curriculum in all subject areas and
grade levels to ensure rigor, high expectations, and alignment with the Kentucky Academic Standards (KAS). Ensure
all educators understand, follow, and protect the curriculum and instructional time. Establish a consistent process
to collect and analyze data to monitor the quality and effectiveness of curriculum implementation to inform
instructional decisions. (Standard 2.5)
Evidence:
In the Stuart Academy School Quality Factors (SQF) document the school provided to the team, the first statement
was that “Stuart Academy has been an underachieving school for many years.” One of the team’s concerns was
that the percentage of African American students who scored Proficient/Distinguished in reading in 2017-2018 was
16.6 compared to the All Students group at 25.7 percent. This was especially troubling as the African American
student population was approximately 41.5 percent of the total student population, according to data provided in
the presentation to the team (source, JCPS Data Management Center, Feb. 2019). Also, 6.8 percent of African
American students scored Proficient/Distinguished in math compared to the All Students group that scored 13
percent. Finally, four percent of African American students scored Proficient/Distinguished in science compared to
5.8 percent for All Students.
provided to the review team, staff members reported few occasions when resource staff and administrators were
in their classrooms. The team found minimal evidence of instructional coaching and feedback from observations
that could improve standards-based instruction and increase the use of high-yield instructional strategies. As
previously stated, several teachers new to Stuart Academy reported that they received no feedback from
evaluations, particularly from walkthrough observations.
The 2018 SQF contradicted the classroom observation and interview data. In the SQF, it was noted that “many of
leadership’s actions, words and attitudes demonstrate their belief that all learners can meet standards.” Additional
SQF responses included some “instructional staff’s actions, words and attitudes demonstrate their belief that all
learners can meet high standards.” However, the classroom observation data indicated that engagement in
“rigorous coursework, discussions, and/or tasks that require the use of higher order thinking” (B4) was
evident/very evident in 11 percent of classrooms. In seven percent of classrooms, it was evident/very evident that
students engage in “challenging but attainable” learning activities (B2).
The SQF narrative outlined the use of many protocols for walkthrough instruments, review of assessment data,
and analysis of student work. However, no evidence was found to suggest consistent and impactful use of these
protocols during Teacher Learning Group (TLG) meetings or in interviews with instructional staff.
Improvement Priority #3
Collaborate with Jefferson County Public School District (JCPS) to restore confidence in the school community by
ensuring that Stuart Academy is a safe and secure place to learn and work. Coordinate and implement programs
with fidelity and consistency and provide services and resources that align to learners’ needs in all areas (social,
emotional, developmental, and academic) with an intense focus on safety. Establish a systematic process to
continuously collect and analyze data to monitor and adjust services. Demonstrate a consistent commitment and
align support for students’ social, emotional, developmental, and academic needs by developing and implementing
a process to evaluate the effectiveness of programs and services in meeting the varied needs of all learners.
(Primary Standard 2.9, Secondary Standard 2.12)
Evidence:
All stakeholder groups reported inconsistent implementation of programs and policies designed to support student
needs. The team frequently heard phrases such as “No systems and no accountability” during interviews, making it
a common theme expressed by many stakeholders. Students generally reported that the rules were not enforced
and that disruptions in their classrooms and the common areas made it difficult to learn and feel safe. Teachers
reported inconsistency in how behavior referrals for students were handled by administrators. Teachers and
support staff reported that no formal, systematic process existed to identify or progress-monitor behavioral
interventions and social emotional supports to ascertain their impact on students. While some staff mentioned
that they participated in trainings about Trauma Informed Care and Restorative Practices, evidence of these
practices was not observed by the Diagnostic Review Team.
Teachers and administrators reported that adjustments to the Tiers of Intervention in the school’s Response to
Intervention model were made once this school year. Ongoing evaluation of student progress in this academic
program did not happen, according to parent, teacher, and administrator interview data. Additionally, students
and parents reported that students who were academically gifted were rarely challenged or given specially
designed instruction. The Gifted/Talented student group did not perform as well as their peers school-wide. Only
23.5 percent were Proficient/Distinguished in reading compared to 25.7 percent of All Students. In math, the gap
was not quite as large, 12.8 percent as compared to 13 percent. Instances of low expectations of students were
observed many times by the team. In one classroom, a teacher stated, “Hold your book open and pretend to read
for five participation points.”
An additional concern was the perception by students, parents, and staff that students were not supported and
meaningful instruction had not been designed to meet their individual needs, which was illustrated by the 34
percent of students who agreed/strongly agreed that “All of my teachers change their teaching to meet my
learning needs” (E9). In addition, 46 percent of students agreed/strongly agreed that “My school provides learning
services for me according to my needs” (E7). Thirty-nine percent of parents agreed/strongly agreed with the
statement, “My child's teachers meet his/her learning needs by individualizing instruction” (E4). Fifty percent of
staff members agreed/strongly agreed that “In our school, all staff use student data to address the unique learning
needs of all students” (E14).
Engagement is the level of involvement and frequency with which stakeholders are engaged in the desired
practices, processes, or programs within the institution. Implementation is the degree to which the desired
practices, processes, or programs are monitored and adjusted for quality and fidelity of implementation. Results
represent the collection, analysis, and use of data and evidence to demonstrate attaining the desired result(s).
Sustainability is results achieved consistently to demonstrate growth and improvement over time (minimum of
three years). Embeddedness is the degree to which the desired practices, processes, or programs are deeply
ingrained in the culture and operation of the institution.
Strengths:
Stuart Academy has an abundance of resources and personnel to help students succeed. Additional resources
include, but are not limited to, the use of five master teachers who model good instructional techniques for
classroom teachers. Teachers meet daily in Teacher Learning Groups in addition to their planning period, which
gives teachers and administrators ample time to systemically implement goals and collect and interpret data.
The team found pockets of good teaching and student engagement. In addition, parents reported that Stuart
Academy provides opportunities for students to participate in activities that interest them. Parents also shared
that they were pleased that their children have access to up-to-date computers and that the school communicates
school goals and activities well.
Jefferson County Public Schools has developed a plan for Stuart Academy’s improvement journey. This is
evidenced by the hiring of a new assistant superintendent to oversee improvement efforts and a concrete plan to
move forward in a positive direction. Personnel changes were recently made at the principal level to lead school
improvement efforts. The district does not hesitate to make changes in personnel when changes are needed for
the benefit of student growth.
Students reported that the rules are not enforced. In fact, they reported that the disruptions in their classrooms
and common areas made it hard for them to learn and feel safe. Teachers reported no consistency in how the
administration dealt with behavior referrals. Teachers and support staff reported that no formal, systematic
process existed for identifying or progress-monitoring students for behavioral interventions and social-emotional
supports. While some staff members mentioned participating in trainings about Trauma Informed Care and
Restorative Practices, evidence of these practices were not observed. Coordination with outside agencies for
counseling and therapeutic services to address learner needs was rarely mentioned by staff, students, and parents.
While 44 percent of parents indicated that the school provided a safe learning environment, 27 percent of
students indicated that the building and grounds were safe and clean and provided a healthy place for learning,
The team concurred that a well-managed learning environment was paramount and needed to be addressed
quickly to ensure the safety of all students and staff. Without immediate intervention in this area, a healthy
learning environment may not be possible.
The classroom observation, survey, and stakeholder interview data and a review of documents suggested that
Stuart Academy did not successfully follow through with effective, results-driven continuous improvement
processes. There was evidence that plans were created; however, the team found minimal evidence of follow-
through to implement, monitor, and adjust plan components, which was a major concern. The team observed a
lack of procedures for analyzing and disaggregating data that would allow the school to identify academic and non-
academic needs of students, assess high-yield instructional strategies that lead to best practice instruction, and
develop and implement an evidence-based walkthrough evaluation process that ensures adjustments in
instruction meet individual student needs and improve professional practice. The team also noted that teachers
new to Stuart Academy received no feedback from evaluations or classroom walkthroughs. Stakeholders from all
groups generally reported a lack of consistency in the implementation of programs and policies. “No systems and
no accountability” was a common theme expressed by all stakeholders. Several stakeholders stated that the school
employed additional staff members who did not provide direct support to students or staff members.
Finally, the Diagnostic Review Team found a need for Stuart Academy staff to monitor a systematic process to
implement the existing adopted curriculum in all subject areas and grade levels to ensure rigor, high expectations,
and alignment with the Kentucky Academic Standards. Within the process, all educators are encouraged to follow
and protect the curriculum and instructional time. The school is also encouraged to establish a consistent process
of collecting and analyzing data in order to monitor the quality and effectiveness of curriculum implementation
that inform instructional decisions.
Administration and staff are encouraged to execute the above changes in order to increase building safety and
security, create a systemic plan inclusive of all stakeholder input, and increase curriculum and lesson rigor. Stuart
Academy leadership is urged to consistently put systematic processes in place to ensure the efficacy of
implementing initiatives; monitoring instruction; evaluating programs; coaching, mentoring, and supporting all
staff members; and providing and participating in opportunities that share and build on staff strengths.
Next Steps
The results of the Diagnostic Review provide the next step for guiding the improvement journey of the institution
with their efforts to improve the quality of educational opportunities for all learners. The findings are aligned to
research-based criteria designed to improve student learning and organizational effectiveness. The feedback
provided in the Diagnostic Review Report will assist the institution in reflecting on current improvement efforts
and adapting and adjusting their plans to continuously strive for improvement.
Upon receiving the Diagnostic Review Report, the institution is encouraged to implement the following steps:
• Review and share the findings with stakeholders.
• Develop plans to address the Improvement Priorities identified by the Diagnostic Review Team.
• Use the findings and data from the report to guide and strengthen the institution’s continuous improvement
efforts.
• Celebrate the successes noted in the report.
Team Roster
Diagnostic Review Teams comprise professionals with varied backgrounds and professional experiences. All Lead
Evaluators and Diagnostic Review Team members complete AdvancED training and eleot® certification to provide
knowledge and understanding of the AdvancED tools and processes. The following professionals served on the
Diagnostic Review Team:
Addenda
Student Performance Data
Section I: School and Student Proficiency and Separate Academic Indicator Results
Content Area %P/D School %P/D State %P/D School %P/D State
(16-17) (16-17) (17-18) (17-18)
Plus
• The percentage of students who scored Proficient/Distinguished increased in all content areas from 2016-
2017 to 2017-2018, except in eighth-grade math.
• The largest growth in the percentage of students who scored Proficient/Distinguished was in seventh-grade
math.
• The highest percentage of students who scored Proficient/Distinguished occurred in eighth-grade reading in
both 2016-2017 and 2017-2018.
Delta
• The percentage of students who scored Proficient/Distinguished was below the state average in all content
areas and grade levels in 2016-2017 and 2017-2018.
• The percentage of students who scored Proficient/Distinguished in eighth-grade math declined from 2016-
2017 to 2017-2018.
• The lowest overall performance relative to the state was in eighth-grade social studies, where the difference
in percentages of students who scored Proficient/Distinguished was 42.3 percentage points.
EL 0.0 8.0
Plus
Delta
Gifted/Talented
Disability-With IEP 9.3 4.7 2.0 6.9 1.7
(Total)
Disability-With IEP 5.4 4.3 6.1 0.0
(No Alt)
Disability (no ALT) 6.1 0.0
with Accommodation
Consolidated Student 19.6 9.5 3.5 13.2 9.8
Group
Plus
• The Foster gap group had the highest percentage of students who scored Proficient/Distinguished in reading,
at 40 percent.
• The Hispanic gap group had the second-highest percentage of students who scored Proficient/Distinguished in
reading at 36.9 percent.
• The Female, Foster, White, Hispanic, and Two or More Races gap groups each outscored the All Students
group in reading.
• The highest-scoring gap group in social studies was Two or More Races at 40 percent Proficient/Distinguished.
Delta
• The African American group scored below the White, Hispanic, and Two or More Races groups in all content
areas.
• Zero percent of English Learners and 5.9 percent of English Learners plus Monitored scored
Proficient/Distinguished in math.
• The Gifted/Talented group scored below the All Students group in reading, math, and social studies.
Schedule
Monday, March 4, 2019
Time Event Where Who
4:00 p.m. Brief Team Meeting Hotel Diagnostic
Conference Review Team
Room Members
4:30 p.m. – Principal and Admin Team Presentation Hotel Diagnostic
5:15 p.m. Conference Review Team
Room Members
5:15 p.m. – Team Work Session #1 Hotel Diagnostic
8:30 p.m. Conference Review Team
Room Members
About AdvancED
professionals in the world. Founded on more than 100 years of work in continuous improvement,
AdvancED combines the knowledge and expertise of a research institute, the skills of a management
consulting firm and the passion of a grassroots movement for educational change to empower
Pre-K-12 schools and school systems to ensure that all learners realize their full potential.
©Advance Education, Inc. AdvancED® grants to the Institution, which is the subject of the Engagement Review Report,
and its designees and stakeholders a non-exclusive, perpetual, irrevocable, royalty-free license, and release to
reproduce, reprint, and distribute this report in accordance with and as protected by the Copyright Laws of the United
States of America and all foreign countries. All other rights not expressly conveyed are reserved by AdvancED.