Vous êtes sur la page 1sur 13

Benchmarks for Reading Performance in the

Philippines
were the national averages for performance in
Filipino and English (since benchmarks in these
Results of the benchmarking two languages would be for performance across
workshop held on August 27, 2014 the whole country). In addition, data from the 2014
EGRA survey of reading performance in four
mother tongues were presented for use in the
INTRODUCTION workshop.2 The 2014 survey evaluated student
reading achievement in Ilokano (in Region I),
On August 27, 2014, USAID’s Education Data for
Hiligaynon (in Region VI), Cebuano (in Region VII)
Decision Making (EdData II) project and Basa
and Maguindanaoan (in ARMM). Data on student
Filipinas Project (Basa) jointly supported a
performance in each language were analyzed and
workshop to use the results from early grade
worked with separately so as to develop language-
reading assessments (EGRAs) conducted in the
specific benchmarks.
Philippines to develop benchmarks for reading
performance in the first years of elementary The approach to benchmarking followed a
education. The Philippine Department of Education methodology developed and used by EdData II in
(DepEd) assigned staff from the office of the several other countries. At the heart of this method
Undersecretary for Programs and Projects, the is the goal of having children learn to read well
Bureau of Elementary Education, and six regions to enough and early enough to be able to apply their
attend this workshop. The regions that participated reading skill in school and as lifelong learners.
included Region I, Region IV-A, the National Therefore, the emphasis is not just on the
Capital Region (NCR), Region VI, Region VII, and mechanics of reading, but on developing the ability
the Autonomous Region of Muslim Mindanao to read with understanding. To read with
(ARMM). A total of 49 participants spent the day comprehension, children need to recognize familiar
examining data from the EGRA surveys conducted words with automaticity and decode unfamiliar
in 2013 and 2014 and used those data to propose ones with minimal effort, group words quickly to
benchmarks for reading performance in grades 1 gain meaning from sections of text, and move
through 3 for Filipino and English and for four effortlessly enough through text to retain what they
regional mother tongues: Ilokano, Hiligaynon, have read. These skills are captured in the
Sinubuanong Binisaya (Cebuano), and assessments of students’ oral reading fluency
Maguindanaoan. (ORF). And the relationship between fluency and
comprehension is well established. In fact, based
Data were made available from the national EGRA
on the data from the 2014 survey in the Philippines,
survey conducted in February 2013.1 That study
oral reading fluency explains between 65 and 70
assessed the Filipino and English reading skills of a
percent of the variation in comprehension for all
sample of grade 3 students drawn from six
four languages. The approach for setting
geographic areas so as to show results at the
benchmarks therefore looks closely at the data for
subnational and national levels. The relevant data
each language to identify the specific levels of
for the purposes of the benchmarking workshop
reading fluency (particular to each language) that
1
The 2013 EGRA report can be found on the EdData II
2
website: The 2014 EGRA report can be found at:
https://www.eddataglobal.org/countries/index.cfm?fusea https://www.eddataglobal.org/countries/index.cfm?fusea
ction=pubDetail&ID=513 ction=pubDetail&ID=626

1
correspond to students being more fully able to benchmarks were developed. Following the
comprehend what they read. The types of data methods section are recommendations for reading
used and the process employed by the workshop performance benchmarks from each of the groups
participants are discussed further in the next (i.e., for each of the languages), including
section of this report. comments from the EdData II team regarding the
proposed benchmarks. Then readers will find the
One final introductory comment: At the end of the specific timeline for next steps as proposed by the
workshop, the participants were keenly interested workshop participants. The conclusion of the report
in discussing how the results of their work— discusses some issues worth further consideration.
proposed benchmarks for reading comprehension
and oral reading fluency—could be used in some THE BENCHARMARKING METHODOLOGY
official capacity by DepEd. Participants were AND PROCESS
particularly concerned about being able to engage
a broader cross-section of stakeholders in their As stated above, the workshop was held on August
respective regions in understanding the 27, 2014, and included 49 participants. Among
benchmarks and then building consensus around them were 5 to 7 participants from each of the
them so that the benchmarks could be incorporated regions, 5 people from the DepEd central office, 5
into regional strategies and plans for improving people from the Basa Filipinas project, and 2 from
learning outcomes. At the same time, they EdData II.3 EdData II and Basa collaborated on a
recognized the need to present their recommended presentation that reviewed the data from the 2013
benchmarks to the central leadership within the and 2014 surveys and that mapped out the process
Department of Education. Therefore, the group for developing benchmarks. Almost all the
proposed a process for carrying forward the work participants in the benchmarking workshop had
on benchmarks that included the following also attended the policy dialogue held on July 23,
sequence of next steps: 2014, during which the results of the 2014 EGRA
study of four mother tongues were presented and
 Document the results of the workshop (i.e., discussed in detail. Therefore, only a quick
the writing of this report); overview/review of those findings was necessary.
Following that presentation and questions and
 Share the report with the regional teams, answers related to both the available data and the
which would engage the leadership in each proposed methodology, the step-by-step process
region to validate the results produced in was laid out for each group to follow. The
the workshop; participants were organized into six working groups
 Once validated by the regions, transmit the according to regional/language affiliation, so that:
documentation of the workshop results to
the Bureau of Elementary Education, which  Participants from Region I worked on
will consolidate the regional benchmarking benchmarks for reading in Ilokano
recommendations for submission to the  Participants from Region IV-A worked on
Undersecretary for Programs and Projects; benchmarks for reading in Filipino
 The Office of the Undersecretary for  Participants from Region VI worked on
Programs and Projects will make additional benchmarks for reading in Hiligaynon
inputs and/or comments as deemed
necessary prior to submitting the proposed  Participants from Region VII worked on
benchmarks to Secretary of Education for benchmarks for reading in Sinubuanong
approval; Binisaya

 Have the benchmarks for reading performance  Participants from NCR worked on benchmarks
in Filipino, English, Ilokano, Hiligaynon, Cebu- for reading in English
ano, and Maguindanaoan officially finalized,  Participants from ARMM worked on
approved, and issued as a DepEd order. benchmarks for reading in Maguindanaoan
In the context of wishing to respect and support the The process of setting the benchmarks was
above process, the present report was prepared. recognized to be in part analytical and in part
The methods and data used at the workshop are
presented next so that as the results are 3
communicated, others can see how the A full list of participants and their affiliations is included
in Annex A to this report.
2
common sense. Participants had to combine document. In addition, each group was given
information from the reading assessments with cumulative distribution tables for comprehension
their knowledge of what is possible in Philippine and oral reading fluency for grades 1 and 2 for
classrooms, bearing in mind in particular the mother tongues and for grade 3 for Filipino and
current difficulties administrators, teachers, and English. These tables showed the percentage of
students face in implementing the new mother- students reaching or exceeding different levels of
tongue based multilingual education (MTB-MLE) performance, so that when considering different
curriculum. The objectives of MTB-MLE regarding levels for a benchmark, each group could take into
acquisition of literacy in mother tongue, Filipino, account the percentage of students presently
and English were another important piece of meeting those levels (and thus weigh how
information that participants took into account. In ambitious the benchmark would be).
fact, those curricular objectives served as important
starting points for determining when students Each working group was charged with defining the
should be reading with comprehension in each following for reading comprehension (defined as
language. MTB-MLE stipulates the following the percentage of correct responses students
expectations. Students should: should attain) and for oral reading fluency (defined
as the number of words of grade-level text a child
 Read and write in mother tongue by the end of should read correctly per minute):
grade 1 and continue literacy development
through grade 3.  A long-range goal

 Begin reading Filipino in the latter part of  A benchmark (which might or might not be
grade 1, be reading and writing in Filipino in different from the long-range goal)
grade 2, and continue their literacy  The percentage of students who would meet
development in grade 3. the benchmark by the end of school year (SY)
 Begin reading English in the second semester 2015–2016
of grade 2 and be reading and writing in English  The percentage of students who would score
in grade 3. zero by the end of SY 2015–2016
Each group was charged with developing Groups working on benchmarks for mother tongues
benchmarks for reading comprehension and oral began working on grade 2, then worked backward
reading fluency for the relevant grades for the from grade 2 to set benchmarks for grade 1, and
language on which they were working. Therefore, worked forward from grade 2 to set benchmarks for
workshop participants aimed to establish grade 3. For the mother tongues, the 2014 survey
benchmarks for reading fluency and provided data for grades 1 and 2. For grade 3
comprehension for mother tongues for grades 1 benchmarks, the working groups had to assume an
through 3, for Filipino for grades 2 and 3, and for additional year of “growth” in student performance.
English for grades 2 and 3. For Filipino and English, the groups began working
on grade 3, and then worked backward to set
In addition to the curriculum objectives defined by
benchmarks for grade 2. In this case, the 2013
MTB-MLE, data from the EGRA surveys were the
survey provided data on grade 3 performance, so
most important input to each group’s work. For
groups had to “subtract” from the grade 3
each language, participants were given a graphic
benchmarks to obtain what they assumed to be
summary of the relationship between oral reading
what one year less of reading skill development
fluency and comprehension. Box-and-whisker plots
would equate to.
were used to show the ranges of reading fluencies
associated with different levels of comprehension. THE BENCHMARKING RESULTS
The levels of comprehension were defined by the
number of questions students answered correctly The results of each group’s work are presented in
(from 0 through 5). In addition, tables summarizing the tables included in this section of the report. The
the quartile distributions were provided. The data in information is organized to show the four outputs
the tables corresponded to the 25th, 50th, and 75th defined by each group, for each relevant grade, for
percentiles of the oral reading fluency ranges for the two key indicators: reading comprehension and
each level of comprehension. The box-and-whisker oral reading fluency. The outputs include the long-
plots and accompanying table for Cebuano are range goal, the nearer-term benchmark (assuming
included as an example in Annex B to this a target date of the end of the 2015–2016 school

3
year), the percentage of students who would be Table 1. Proposed benchmarks for Ilokano
meeting that benchmark, and the percentage of Ilokano Grade 1 Grade 2 Grade 3
students who would score zero at the end of 2015– Comp. ORF Comp. ORF Comp. ORF
2016. The tables also include the levels of (% cor.) (cwpm) (% cor.) (cwpm) (% cor.) (cwpm)
performance as measured by either the 2013 or Average – 2014 data 17% 15 45% 30
2014 EGRA survey (in the shaded rows). These
Long-range goal 80% 40 80% 50 80% 60
existing data are presented to allow comparison of
Benchmark – end of 2015-16 60% 30 80% 40 80% 50
the projected benchmarks to current levels of
performance as one means to judge how ambitious
or conservative the groups were being in setting % Meeting Benchmark – 2014 data 16% 21% 29% 35%

their targets. % Meeting Benchmark – by end of 2015-16 75% 72% 86% 86% 97% 100%

In the cases where the groups did provide


% Scoring Zero – 2014 data 65% 33% 29% 13%
justification for their work, the table of benchmarks
% Scoring Zero – by end of 2015-16 28% 20% 14% 10% 0% 0%
is followed by a short summary of what that group
Note that cwpm stands for correct words per minute.
presented as its rationale for the chosen
benchmarks. The reflections, comments, and
recommendations regarding the benchmarks are Regarding the benchmarks for oral reading fluency,
summarized and presented as well. the levels proposed for grades 1 and 2, while also
above the averages from 2014, were less
The group from Region I that set benchmarks for ambitious. One way to evaluate the ORF
Ilokano reading (Table 1) felt they were being benchmarks is to compare what is proposed to
ambitious. They justified benchmarks that far what the existing data show, using the range of
exceeded the existing levels of performance in both reading fluency scores that correspond to the
grade 1 and 2 based on the confidence they placed benchmark levels of comprehension. For grade 1,
in both current and future efforts aimed at most students who achieved 60% comprehension
improving early grade reading. They cited several had ORF scores between 32 and 37 correct words
existing reading programs (Basa Filipinas, Tan- per minute (cwpm). The group proposed a
Yan-Kee, Beginning Reading, Reading Readiness, benchmark below that range. For grade 2, 80%
and Bright Minds Read, to name a few) and comprehension corresponds to ORF of from 35 to
existing strategies for teacher training and 46 cwpm. The proposed benchmark is in fact right
development of instructional materials, as well as at the median of the scores of students who had
future efforts aimed at creating strong advocacy for 80% comprehension in the past school year.
Ilokano literacy, sound monitoring and evaluation of
student outcomes, and provision of technical The group also chose to be ambitious in projecting
assistance to schools on improved reading reductions in zero scores for comprehension,
instruction. cutting the present levels of zero scores by more
than half in each grade. They also proposed a
In comparing the proposed comprehension significant reduction in zero scores for reading
benchmarks to the results from 2014, it is clear that fluency in grade 1, but less so in grade 2. They did
the benchmarks for comprehension, proposed at foresee complete elimination of zero scores and
60% for grade 1 and 80% for grade 2, are more or less 100% achievement of benchmarks by
considerably higher than the average performances grade 3.
of students in the preceding school year (average
percent correct of 17% in grade 1 and 45% in A final comment regarding the proposed Ilokano
grade 2). Also, the projected percentages of benchmarks and targets concerns the grade-to-
students meeting the benchmark by the end of SY grade progression inherent in the group’s output.
2015–2016 represent an impressive improvement The group foresaw a rise in the comprehension
over the current share of students able to achieve standard from 60% to 80% from grade 1 to grade 2,
60% and 80% comprehension in grades 1 and 2. and then maintenance of that level of performance
as the standard for grade 3. This seems
reasonable. Full comprehension (100% correct) is
of course desirable, but the difference between 4
out of 5 correct compared to 5 out of 5 correct
implies a level of precision that the EGRA
instrument probably does not provide. Regarding

4
ORF, the group essentially assumed a grade-to- For grade 2, the Region VI group set higher
grade improvement of 10 cwpm, which is at the expectations for both comprehension and ORF,
lower end of what EGRA studies in many countries and the proposed level of reading fluency did fall
have revealed. In fact, the 2014 data from Region I within the range of scores that corresponded with
showed a difference of 15 cwpm between the 60% comprehension in the 2014 data. But here
grade 1 and grade 2 average reading fluencies. also, the group’s proposed long-range goal may be
a better benchmark. Again, the proposed
The Region VI group chose not to set Hiligaynon percentage of students meeting the comprehension
benchmarks for grade 3 (Table 2), and the issue of benchmark is below the demonstrated existing
whether benchmarks for mother tongue are needed level of performance, and for fluency does not
and would be used beyond grade 2 is one that project very strong improvement.
DepEd should consider (discussed further in the
conclusion to this report). They also expressed that For zero scores, this group was less ambitious than
they were being cautious in setting their targets, as all the others in projecting targets for reducing the
the levels of performance revealed by the 2014 percentage of students at the bottom of the
EGRA were much lower than they would have distribution, especially in grade 1.
expected.
The group from Region VII, like their colleagues
Table 2. Proposed benchmarks for Hiligaynon from Region VI, chose to set lower comprehension
Hiligaynon Grade 1 Grade 2 Grade 3
benchmarks for Cebuano in both grades 1 and 2 –
40% and 60% respectively (Table 3). They did set
Comp. ORF Comp. ORF Comp. ORF

(% cor.) (cwpm) (% cor.) (cwpm) (% cor.) (cwpm)


the long-range goal of 80% comprehension in
those grades, and 100% comprehension in
Average – 2014 data 15% 13 42% 32
grade 3, which would be more reflective of students
Long-range goal 60% 25 80% 50
being able to fully comprehend what they read.
Benchmark – end of 2015-16 40% 20 62% 45

Table 3. Proposed benchmarks for Cebuano


% Meeting Benchmark – 2014 data 24% 31% 44% 34%

% Meeting Benchmark – by end of 2015-16 25% 50% 30% 50% Cebuano Grade 1 Grade 2 Grade 3

Comp. ORF Comp. ORF Comp. ORF

% Scoring Zero – 2014 data 64% 44% 31% 22% (% cor.) (cwpm) (% cor.) (cwpm) (% cor.) (cwpm)

% Scoring Zero – by end of 2015-16 40% 25% 15% 10% Average – 2014 data 26% 21 53% 41 na na

Note that cwpm stands for correct words per minute. Long-range goal 80% 45 80% 50 100% 55

Benchmark – end of 2015-16 40% 32 60% 42 80% 55

A couple of things stand out in this group’s output.


% Meeting Benchmark – 2014 data 38% 33% 54% 54% na na
Regarding grade 1, the benchmark of only 40%
% Meeting Benchmark – by end of 2015-16 20% 40% 25% 50% 30% 50%
comprehension is something worth reconsidering,
as it would mean that children were able to answer
only 2 out of 5 questions correctly. The long-range % Scoring Zero – 2014 data 49% 22% 19% 8% na na

goal may be more appropriate as a benchmark. % Scoring Zero – by end of 2015-16 25% 15% 15% 5% 10% 5%

And the level of oral reading fluency proposed is Note that cwpm stands for correct words per minute.

below the range of scores that corresponded to


even that low level of comprehension (2014 data
The justification offered for setting a lower standard
showed ORF from 25 to 42 cwpm as the middle
for comprehension was the concern the group had
50% of the distribution of scores associated with
for the percentage of students scoring zero on this
40% comprehension). Additionally, the proposed
skill. Also, the group cited the diversity of versions
percentage of students meeting the 40%
of Sinugbuanong Binisaya spoken across the
comprehension level is just below the percentage
region as another concern that tempered their
that did so in the past school year. If the choice is
ambition. And, while they were optimistic about the
to set the benchmark lower (i.e., at 40%
impact that a program like Basa Filipinas can have
comprehension as done here, instead of 60% or
in their region, they were concerned that it was
80%), then it would be recommended to be more
intervening in only 3 of their 19 divisions.
ambitious regarding the proportion of students who
would be able to meet that benchmark. In setting the targets for the percentages of
students meeting the proposed benchmarks by the

5
end of the 2015–2016 school year, this group programs specifically targeted to reducing
proposed some targets below the levels shown in nonreaders, conducting intensive trainings for
the data from the past school year. For this group, teachers focused on mother tongue reading, and
and probably for Region VI as well, it would appear providing coaching and mentoring for teachers and
that the low targets resulted from a misreading of instructional supervision all focused on MTB-MLE
the distribution tables for comprehension. implementation.
Therefore it is suggested that those values be
revisited, taking into account the correct 2014 Table 4. Proposed benchmarks for Maguin-
values shown in the tables included in this report. It dinaoan
is suggested that all groups consider the trade-off Maguindinaoan Grade 1 Grade 2 Grade 3

between a lower benchmark and a higher Comp. ORF Comp. ORF Comp. ORF

percentage projected to meet the benchmark, (% cor.) (cwpm) (% cor.) (cwpm) (% cor.) (cwpm)

versus a higher benchmark with a somewhat lower Average – 2014 data 8% 7 27% 21

percentage projected to meet it. Long-range goal 80% 50 80% 60

Benchmark – end of 2015-16 70% 35 60% 40


The proposed benchmark for ORF for grade 3 also
appears low, when one considers the grade-to-
% Meeting Benchmark – 2014 data 6% 4% 27% 22%
grade progression they imply. From grade 1 to
% Meeting Benchmark – by end of 2015-16 25% 50% 25% 50%
grade 2, average performance in 2014 improved by
20 cwpm. This group proposed benchmarks that
reflect a 10 cwpm increase from grade 1 to grade 2 % Scoring Zero – 2014 data 82% 66% 50% 38%

(and only a 5 cwpm difference in the long-range % Scoring Zero – by end of 2015-16 40% 20% 25% 15%

goals), and a 13 cwpm increase from grade 2 to Note that cwpm stands for correct words per minute.

grade 3 (a difference of only 5 cwpm again in the


long-range goals). Future discussion and revision The ARMM team’s output for grade 2 was less
to these benchmarks may wish to consider a more ambitious. The grade 2 benchmark they proposed
ambitious rate of improvement resulting from each
for comprehension was, in fact, lower than what
additional year of instruction. A similar issue is
they proposed for grade 1, and the author wonders
present when looking at the projected targets for if this was due to a transcription error. Regarding
the percentages of students meeting the the target proportion of students meeting the
benchmarks in grade 3. Little improvement is benchmark of 60% comprehension, the group
assumed in these targets for either comprehension
proposed the same values as for grade 1, which
or fluency, and zero scores are projected to reduce
actually is below the percentage of students who
only slightly for comprehension, and to remain obtained that comprehension score on the 2014
unchanged for ORF. The group was concerned that EGRA. For fluency, the group’s proposed target of
improvement would face many challenges, given in 40 cwpm is within the range of scores associated
particular the diversity of dialects of the language
with 60% comprehension. The long-range ORF
spoken across the region. A strategy to specifically goal would be more aligned with even higher levels
address that challenge might enable the group to of comprehension (100%). The group proposed to
set benchmarks and targets that would be more
double the percentage of students reaching 40
ambitious. cwpm by the end of SY 2015–2016 and proposed
The team from ARMM proposed Maguindinaoan continued, dramatic reductions in zero scores for
benchmarks for grade 1 (Table 4) that are both comprehension and ORF.
ambitious when compared to the levels of The relevant data available for benchmarking in
performance reflected in the data from 2014. The Filipino (Table 5) were only for grade 3, so the
levels of comprehension and fluency would be well group from Region IV-A that worked on these
above the existing averages, and the percentages benchmarks started by setting standards for that
of students meeting the proposed benchmarks grade. The proposed benchmark, and especially
represent substantial gains over existing the long-range goal, is above the average level of
performance, as do the proposed reductions in reading comprehension achieved by students in
zero scores (reducing zeros on comprehension by 2013. This is especially the case when the
more than half and on fluency by more than two benchmark for ORF is compared to the data from
thirds). The group justified its ambition based on
2013.
several strategies they propose: establishing

6
Table 5. Proposed benchmarks for Filipino However, for comprehension, the transition from L1
to L2 is more difficult, as children need to build up
Filipino Grade 1 Grade 2 Grade 3
sufficient working knowledge of Filipino as a
Comp. ORF Comp. ORF Comp. ORF
second language to be able to more fully
(% cor.) (cwpm) (% cor.) (cwpm) (% cor.) (cwpm)
comprehend what they read (and do so with only 2
Average – 2013 data 73% 68
years of instruction in that language).
Long-range goal 80% 75 100% 90

Benchmark – end of 2015-16 65% 60 75% 80 The group did propose eliminating zero scores in
grade 3, and indicated an expectation that 10% of
% Meeting Benchmark – 2013 data 70% 37% students might struggle to make the transition into
% Meeting Benchmark – by end of 2015-16 75% 65% 75% 80% Filipino in grade 2, and hence score at the bottom
of the distribution for both comprehension and
% Scoring Zero – 2013 data 6% 1%
fluency. The proposed benchmarks for grade 2—at
% Scoring Zero – by end of 2015-16 10% 10% 0% 0%
65% comprehension and 60 cwpm—seem
Note that cwpm stands for correct words per minute.
reasonable given all the issues mentioned above.
And a progression from 60 to 80 cwpm from grade
Even though the cohort tested in grade 3 in that 2 to grade 3 implies that performance will increase
year were students who had had three years of dramatically as students gain more practice in
instruction in Filipino, this group felt that current Filipino.
grade 1 students—who would have had only two
years of Filipino instruction when they reached The team from NCR that worked on setting
grade 3—could still demonstrate improved benchmarks and targets for English (Table 6)
performance. The groups reasoned that by the end recognized the challenge the system now faces in
of the 2015–2016 school year, schools, teachers, trying to build sufficient facility in English for
and students would have more experience with students to be able to read with comprehension by
MTB-MLE and the transition to Filipino, and grade 3. Given how low reading comprehension
teachers would have the tools and activities they was in English in 2013, when students would have
needed to provide effective instruction. The group been receiving English instruction starting in
also wanted to establish a strong standard that grade 1, the group was concerned about how
would reflect outstanding performance, and they
Table 6. Proposed benchmarks for English
were confident that teachers could have effective Grade 1 Grade 2 Grade 3
English
strategies, for example, for addressing the needs of
Comp. ORF Comp. ORF Comp. ORF
the few students at the bottom of the distribution
(% cor.) (cwpm) (% cor.) (cwpm) (% cor.) (cwpm)
(zero scores).
Average – 2013 data 32% 67

However, the benchmark proposed for reading Long-range goal 60% 60 80% 75

comprehension in grade 3—at 75%—is not Benchmark – end of 2015-16 40% 40 60% 70

appreciably higher than the average obtained by


students in 2013. One could argue that MTB-MLE % Meeting Benchmark – 2013 data 40% 49%

reduces the amount of instruction in Filipino to % Meeting Benchmark – by end of 2015-16 30% 30% 40% 60%

allow for instruction in mother tongue, and that


therefore grade 3 students will have had less time % Scoring Zero – 2013 data 37% 1%
learning to read in Filipino, and will have had to % Scoring Zero – by end of 2015-16 30% 30% 15% 1%
weather a transition from their first to a second Note that cwpm stands for correct words per minute.
language (L1 to L2). Similarly, for the target
percentage meeting the benchmark, the group
proposed a value only slightly higher than what was realistic their benchmarks were in the context of
achieved in 2013. This was not the case for the MTB-MLE, and English being learned starting only
benchmark and target for ORF, however. Here the in grade 2. Even so, the group proposed
group proposed a benchmark that exceeded the benchmarks that exceeded the grade 3 levels of
average from 2013, and projected a much greater performance achieved in 2013. For comprehension
percentage of students able to meet the higher in particular, the benchmark of 60% is almost
standard. Again, the reasoning here may be that for double what the average percent correct was in
fluency, skills will transfer easily from mother 2013. Perhaps that is why the group envisioned
tongue to Filipino, as the mechanics of reading in only 40% of students being able to meet that
most Philippine languages are very similar. benchmark by the end of SY 2015–2016. For

7
comprehension, the NCR team also projected a Table 7. Next steps and timeline
significant reduction in zero scores in grade 3, Date Activity
targeting having less than half the proportion of
students scoring zero as did so in 2013. 1 Before Sept. 12, 2014 PhilED Data Project/ RTI International will prepare the
report and as suggested will share the benchmarking report
with the regional teams
In working backward to set standards for grade 2,
the group proposed a benchmark of only 40% 2 Before End Sept. 2014 The mother tongue regional teams will review the
benchmarking report with their respective regional
comprehension and only 40 cwpm for fluency. This directors for their information, additional input/support,
latter value actually falls well below the range of leading to finalization and endorsement of the
proposed/recommended benchmarks, which would then
fluency scores that were associated with 40% be officially submitted to the Bureau of Elementary
comprehension in 2013 (from 61 to 92 cwpm). Education at Central Office

Students being able to better comprehend what


3 Before End Oct. 2014 The BEE Central Office will consolidate/compile the regional
they are reading, even at lower levels of fluency, benchmarking recommendations and then submit to Usec.
may be obtainable if the level of text students are Dina Ocampo for their information, additional
inputs/comments as maybe necessary and recommend the
asked to read in grade 2 is considerably lower than same for DepED Secretary’s approval and issuance of
what they were asked to read in grade 3 in 2013. DepED Order

Note that one could even ask, given how late 4 December 2014 Benchmarks for reading performance officially crafted,
English instruction is slated to begin under MTB- approved and issued by DepEd

MLE, whether it makes sense to have English


benchmarks for grade 2.
The participants identified several concerns when
NEXT STEPS considering how best to move forward from the
As mentioned in the introduction to this report, the initial output produced at the workshop to the
participants took time at the end of the workshop to issuance of official benchmarks for reading
discuss the process which they thought could best performance. The group recognized that the DepEd
ensure that the proposed benchmarks would central office would need to be the final arbiter of
receive the appropriate reviews, both in the regions the standards—validating and strengthening them
and by DepEd central, prior to be being put forward where necessary. However, the group of
as official policy. In particular, representatives of participants also recognized the need to enlist the
DepEd central offices and of each of the regions all support and input of regional management
agreed on the importance of establishing a clear committees, as well as of other technical staff at
timeline and process for carrying forward the the regional level. For ARMM, given its
benchmarks being proposed at the workshop. autonomous status, the group was concerned that
the Regional Secretary would also need to review,
The participants took into account several issues comment on, and officially accept any standards.
when outlining such a process. First, the group
agreed that a finalized set of recommended Lastly, the group stressed that if the standards
benchmarks should be put before the Executive were to be applied, then DepEd would need to
Committee of DepEd before the end of October ensure ongoing assessment to evaluate progress
2014. This was suggested so that there would be using those standards. Therefore, the group
ample time to consider the proposed standards recommended that EGRAs be administered
before they would be released late in the 2014 annually, so as to evaluate mother tongue reading
calendar year. Additionally, the regional groups all at the end of grade 1, Filipino by the end of
wanted to solicit feedback and broker the buy-in of grade 2, and English reading in grade 3.
their colleagues back in their respective regions. CONCLUSIONS
Finally, the writing of this report afforded an
opportunity to provide some initial feedback, purely The output from the workshop represented a good
from a technical standpoint, hoping to ensure that first draft of benchmarks and targets for reading
all aspects of the data were considered by the performance in these six languages. In reviewing
teams during the very busy workshop. the work of the participants and reflecting on the
discussions held during the workshop, the author of
With that in mind, the proposed next steps and this report saw several issues worth considering as
timeline are presented in Table 7. DepEd makes use of the work of these groups to
move forward in setting benchmarks.

8
First, one needs to consider which benchmarks are Another issue that arises when considering setting
needed for which grades. From the start, a benchmarks and targets for how many children will
parsimonious approach to benchmarking was meet them is how to manage the trade-off between
pursued. For example, since oral reading fluency these two standards. One can choose to set a high
represents a higher-order skill that encompasses benchmark; but then it is necessary to be realistic
the other important reading skills students are about the percentage of students who would be
developing, it was assumed that a benchmark in able to achieve that level of performance. For
fluency would indicate whether students were also example, the group from Region I set a benchmark
building skills in other areas, such as phonemic for Ilokano grade 2 oral reading fluency of 40
awareness, decoding, familiar word recognition, cwpm. This was higher than the 2014 average, so
and reading accuracy. Therefore it was not may be considered reasonable in terms of
necessary to have benchmarks for these other skill expectations for improvement. However, the group
areas.4 Furthermore, because comprehension and then proposed that 86% of grade 2 students be
fluency are strongly correlated, it is worth asking able to meet or exceed that benchmark in 2 years.
whether benchmarks are needed for both. At the That stands in contrast to only 35% of students
workshop, comprehension benchmarks were used having been able to read at 40 cwpm in the past
to identify the ranges of reading fluency that school year. If one wishes to maintain a relatively
corresponded to the desired level of understanding. high standard, then further discussions could focus
While one could argue that having a fluency on whether it is reasonable to assume that
benchmark therefore would also “indicate” a level teachers could more than double the percentage of
of comprehension, this author recommends their students able to meet that benchmark.5
strongly that comprehension continue to be
measured and monitored separately, to make sure The opposite approach would be to set the
that children are not just becoming mechanical benchmark lower, while being ambitious about how
readers. many students would be able to meet or exceed it.
This may be valid in some circumstances, but when
Continuing to take a parsimonious approach, it is considering whether to take this approach, it is
worth asking in which grades benchmarks should important to bear in mind that the benchmark
be set for the different languages. Here, what is should represent at least a minimally acceptable
important to consider is how best to monitor level of performance. In fact, some would argue
whether the MTB-MLE expectations for literacy that the benchmark should represent the desired
acquisition in all three languages are being met. level of high performance.
Clearly, benchmarks are needed to monitor the
development of reading in mother tongues in Lastly, an issue that came up during the workshop
grades 1 and 2. For Filipino, benchmarks are concerned the level of text that students were
needed to monitor whether literacy skills are being expected to be reading at benchmark levels. This is
transferred from mother tongue in grade 2. And it of concern for two reasons. First, when setting
could be argued that they are also needed for benchmarks, it is recommended that the level of
grade 3 to ensure that students are consolidating text for which the benchmark is set be well-defined.
their skills in a language that will continue to be Are grade 1 benchmarks based on reading grade 1
used as a medium of instruction in upper level material, grade 2 based on reading grade 2
elementary grades and beyond. For English, the level material, etc.? Second, DepEd therefore
issue is whether benchmarks (and hence needs to produce and reinforce standards for what
monitoring of progress) are needed at all in constitutes grade-appropriate text in each
grade 2. Benchmarks for English obviously are language. Participants evinced a fear that unless
needed for grade 3. there are clear standards for grade-level text,
schools could evaluate student performance using
reading material that is below what should be read
4
Of course, not having benchmarks for those skills does in a given grade (e.g., testing grade 3 students on
not mean that teachers have no interest in assessing grade 2 material).
whether their students are developing all the skills
needed to be good readers. The important distinction to
5
make is between benchmarks that could be used for Note, the Ilokano example is used here simply to
monitoring system progress—which is what this work illustrate the point about the trade-off between the
aimed at—versus those teachers would use to evaluate benchmark and the target percentage meeting it. It does
individual student or class progress in building reading not imply that the author is recommending a particular
skills. benchmark or target for Ilokano reading.
9
With appropriate review and additional input and
analysis, it is hoped that these initial benchmarks
can be honed and finalized as foreseen in the
process laid out in the previous section. How
DepEd can conduct such work for the other mother
tongues currently being used both as media of
instruction and as languages of literacy remains an
open question.
CONTACT INFORMATION
For additional information on the progress of
Philippines benchmarks for early grade reading:
Joseph DeStefano, RTI International
jdestefano@rti.org

10
Annex A: List of Workshop Participants
DepEd Central Office Participants
1. Ms. Anne Choi Exec. Assistant (K to 3), Usec. for Programs and Projects
2. Dr. Marilette R. Almayda Director III, Bureau of Elementary Education (BEE)
3. Mr. Efren Dela Cruz Education Program Supervisor 2 (EPS 2), National Education
Testing and Research Center (NETRC)
4. Dr. Rosalina J. Villaneza Focal Person, MTB-MLE Program, BEE
5. Ms. Jocelyn S. Tuguinayo Senior Education Program Specialist, BEE

Region I Participants (EGRA Ilocano)


6. Dr. Vivian Pagatpatan Chief, Elementary Education
7. Dr. Dinah Bonao Regional EGRA Coordinator DepEd-Region I
8. Dr. Alma Ruby C. Torio Schools Division Superintendent, Pangasinan
9. Elsa M. Calado Education Regional Supervisor
10. Ms. Pearl P. Quinto EGRA Assessor/Principal

Region VI Participants (EGRA Hiligaynon)


11. Dr. Novelyn M. Vilchez Chief, Curriculum Learning Management Division (CLMD)
12. Dr. Dominica T. Parcia EPS, Bureau Elementary Education / CLMD
13. Ms. Janalyn B. Navarro EPS I, Bacolod City Region VI
14. Mr. Nerio Benito E. Eseo EGRA Regional Coordinator, Region VI
15. Ms. Dymphna Leizel G. Jocson EGRA Assessor, DepEd-Region VI

Region VII Participants (EGRA Sinugbuanong Binisaya)


16. Dr. Maria Jesusa Despojo Regional EPS
17. Dr. Luz C. Jandayan Officer in Charge (OIC)-Chief, Curriculum & Learning
Management Division
18. Ms. Nena V. Minoza EGRA Regional Coordinator, Region VII
19. Pamela Rodimeo Education Program Supervisor, Cebu Province
20. Dr. Wilfreda D. Bongalos Schools Division Superintendent, Bohol Province
21. Ms. Leilani Cabrera Ed. Program Supervisor, Negros Oriental Division
22. Ms. Jocelyn M. Conta EGRA Assessor, DepEd-Region VII

ARMM Participants (EGRA Maguindanaon)


23. Ms. Hasim P. Pinayongan EPS I, Maguindanao
24. Ms. Saada Tubing EGRA Regional Coordinator, ARMM
25. Ms. Wilma Grace P. Rivero Principal, Maguindanao
26. Ms. Salamat T. Abedin EPS I – DepEd ARMM
27. Ma. Cristina T. Delos Santos EPS I, DepEd ARMM
28. Ms. Armela Bansil EGRA Assessor, DepEd-ARMM
29. Ms. Rowena Kamaarudin EGRA Assessor, DepEd-ARMM

National Capital Region (EGRA English)


30. Ms. Arlene B. Maniquis Education Program Supervisor-Muntinlupa
31. Jeanette Job Coroza Regional Coordinator
32. Ms. Rosella M. Esteban Master Teacher II
33. Mrs. Nerissa R. Lomeda Principal

11
Region IV-A Calabarzon (EGRA Filipino)
34. Dr. Erick M. Jabijan Chief, CLMD, Region IV-A
35. Ms. Agnes Rolle EGRA Regional Coordinator
36. Dr. Lualhati O. Cadavedo City Schools Superintendent/OIC – Imus City
37. Ms. Andrea M. Abrencillo Education Program Supervisor
38. Ms. Lourdes M. Tan Principal III, Guinyangan District, Division of Quezon
39. Ms. Carina P. Jamilano Principal I, Plaridel District, Division of Quezon

Basa Pilipinas
40. Mr. Marcial Salvatierra Chief of Party, Basa Pilipinas, Education Development Centre,
Inc. (EDC)
41. Ms. Karen Cassidy International Project Associate, EDC
42. Ms. Nancy Clark-Chiarelli International Technical Advisor, EDC
43. Dr. Felicitas Pado Senior Consultant/Basa Pilipinas
44. Ilya Son Deputy Chief of Party

USAID Philippines
45. Mr. Mirshariff C. Tillah Program Management Specialist, Office of Education

RTI International
46. Mr. Joseph DeStefano Senior Technical Advisor
47. Mr. Rufino Jamilano In-Country Tasks Coordinator, PhilED Data Project
48. Ms. Rosa Rapanan Accountant, Science, Technology, Research and Innovation
for Development (STRIDE) Program
49. Mr. Julie Mar M. Mendoza Staff, STRIDE Program

12
Annex B: Example of Box-and-Whisker Plots and Accompanying Data
Tables (Cebuano)

Grade 1 Grade 2

50th 50th
# 25th percentile 75th 25th percentile 75th
Correct percentile (median) percentile Count percentile (median) percentile Count

Zero 0 0 6 189 0 3 13 78

1 21 26 29 57 20 28 38 36

2 27 32 36 59 25 35 45 70

3 35 39 45 40 36 40 51 67

4 43 51 57 25 47 54 64 84

5 57 61 67 22 55 65 75 80

13

Vous aimerez peut-être aussi