Académique Documents
Professionnel Documents
Culture Documents
To cite this article: Anat Zohar (2006) The Nature and Development of Teachers'
Metastrategic Knowledge in the Context of Teaching Higher Order Thinking, Journal of
the Learning Sciences, 15:3, 331-377, DOI: 10.1207/s15327809jls1503_2
Taylor & Francis makes every effort to ensure the accuracy of all the
information (the “Content”) contained in the publications on our platform.
However, Taylor & Francis, our agents, and our licensors make no
representations or warranties whatsoever as to the accuracy, completeness,
or suitability for any purpose of the Content. Any opinions and views
expressed in this publication are the opinions and views of the authors, and
are not the views of or endorsed by Taylor & Francis. The accuracy of the
Content should not be relied upon and should be independently verified with
primary sources of information. Taylor and Francis shall not be liable for any
losses, actions, claims, proceedings, demands, costs, expenses, damages,
and other liabilities whatsoever or howsoever caused arising directly or
indirectly in connection with, in relation to or arising out of the use of the
Content.
This article may be used for research, teaching, and private study purposes.
Any substantial or systematic reproduction, redistribution, reselling, loan,
sub-licensing, systematic supply, or distribution in any form to anyone is
expressly forbidden. Terms & Conditions of access and use can be found at
http://www.tandfonline.com/page/terms-and-conditions
Downloaded by [New York University] at 02:29 28 April 2015
THE JOURNAL OF THE LEARNING SCIENCES, 15(3), 331–377
Copyright © 2006, Lawrence Erlbaum Associates, Inc.
Anat Zohar
School of Education
The Hebrew University, Jerusalem, Israel
Current educational reforms often stretch and challenge teachers’ thinking capa-
bilities (Fishman, Marx, Best, & Tal, 2003). To be able to respond to the unex-
pected events that characterize inquiry and thinking lessons, teachers must be able
Correspondence should be addressed to Anat Zohar, School of Education, Hebrew University, Jeru-
salem, Israel 91905. E-mail: msazohar@mscc.huji.ac.il
332 ZOHAR
The ultimate goal of most teacher educators is to affect teachers’ practice. The as-
sumptions behind the design of most professional development courses are that
they can induce changes in teachers’ knowledge and that such changes can indeed
affect practice and eventually students’ achievements. But these assumptions can-
not be accepted without a critical examination. Only if teachers’ knowledge is in-
deed reflected in their practice can educators hope to affect teachers’ practice and
students’ learning by developing teacher thinking. Affecting teachers’ knowledge,
however, is not an easy thing to achieve. It is even more difficult to affect teachers’
knowledge in a way that would induce changes in classroom practice. What fac-
tors, according to previous studies, are involved in this process? Under which con-
ditions can classroom practice and students’ achievements indeed be affected?
HIGHER ORDER THINKING 333
tional way of instruction (e.g., Ball, 1990; Olson, 1981; Wilson, 1990). In a more
recent study, Holt-Reynolds (2001) analyzed the case of a prospective teacher who
adopted superficial elements of the constructivist pedagogies she had been taught
in a teacher education course, without adopting its more profound elements.
Another approach to professional development involves a vision of teachers
changing in ways that provide a basis for continued growth. The idea is that
self-sustaining, generative change will enable teachers to continue to learn and
grow for a long time after the end of the professional development. This entails
teachers making changes in their basic epistemological perspectives, in their
knowing of what it means to learn, and in their conception of classroom practice. A
Downloaded by [New York University] at 02:29 28 April 2015
ment and a professional development course intended to help teachers acquire the
knowledge necessary to successfully enact the curriculum units, attempting to fo-
cus on areas of weakness in students’ performance. Fishman and his colleagues
then engaged in evaluation of that professional development by attending to both
teachers’ and students’ knowledge. They assessed teachers’ knowledge by using a
multitude of assessment means, but the most unique component of their study was
that they reassessed student performance, seeking to attribute changes in student
learning to particular aspects of the professional development activities. When the
workshop was redesigned according to conclusions from an initial stage of their
research, Fishman et al. were able to show a positive impact on teachers’ knowl-
Downloaded by [New York University] at 02:29 28 April 2015
edge and beliefs about their teaching, and also on their classroom enactment. The
researchers suggested that adopting their combined research approach to many dif-
ferent contexts may generate a more refined knowledge base that links teacher and
student learning to professional development.
Taken together, these studies of recent efforts to change teachers’ thinking and
practice to embrace reform theories of learning have indicated that when adequate
teaching methods are used, professional development courses can induce some
changes in teachers’ thinking and practice toward a more sophisticated model of
learning and instruction. However, these studies also have shown a repeated pat-
tern implying that such a change is a difficult and slow process. Only some of the
teachers who undergo a professional development course actually change their
classroom practice following the course.
The study described in the present article also examined teachers’ thinking and
practice following a professional development course. As mentioned in the follow-
ing sections, one of the aims of this study was to explore patterns of change in
teachers’ knowledge and practice regarding MSK following the course.
De Jong et al. noted that numerous studies about primary school science teachers’
subject-matter knowledge have shown that teachers can improve their understand-
ing of science topics with the help of professional development courses. In another
review, Borko and Putnam (1996) noted that knowledge and beliefs about subject
matter seem to be more readily changed as compared to knowledge and beliefs
about other issues such as the nature of learning and teaching or about the desir-
ability of new pedagogies.
The nature of MSK is very different from the nature of the knowledge involved in
specific concepts and science subject matter. Nevertheless, in the context of this
study, being acquainted with elements of MSK is parallel to subject-matter knowl-
Downloaded by [New York University] at 02:29 28 April 2015
edge in other science fields. Although MSK addresses general elements of thinking
skills rather than a specific science topic, teachers cannot address MSK in their prac-
tice if they do not first possess that type of knowledge. MSK is a body of knowledge
with which teachers must be familiar to effectively address it in class. Therefore, in
the present study, I examine what is equivalent to subject-matter knowledge in the
context of MSK and discuss its implications for the nature of teacher knowledge in
this area. To do this, I first need to clarify the concept of MSK, examine its signifi-
cance for instruction, and discuss how it may be expressed in teachers’ thinking.
Only then can I return to a clarification of the type of subject-matter knowledge that
applies in this study and to the description of my research.
the term metastrategic knowledge or MSK, earlier studies that apply to all of these
terms are relevant as background for the present study.
Let us now turn to a definition and explanation of the central concept I am refer-
ring to in the present study. MSK is general, explicit knowledge about the cogni-
tive procedures that are being manipulated. The cognitive procedures are com-
prised of higher order thinking skills and strategies. The pertinent metacognitive
knowledge is an explicit awareness of the type of cognitive procedures being used
in specific instances. It consists of the following abilities (Kuhn, 2000, 2001;
Kuhn, Katz, & Dean, 2004): making generalizations and drawing rules regarding a
thinking strategy; naming the thinking strategy; explaining when, why, and how
Downloaded by [New York University] at 02:29 28 April 2015
such a thinking strategy should be used, when it should not be used, what the disad-
vantages are of not using appropriate strategies, and what task characteristics call
for the use of the strategy.
This type of knowledge seems to have a regulative significance for our thinking
because it may give us regulative advice about how to apply correct cognitive pro-
cesses to specific, contextually rich situations that are often “messy” in terms of their
underlying logical structures. This knowledge may do so by directing our attention
to the general structures that are embedded in specific situations and contexts. There-
fore, an underlying assumption of this study was that although knowledge acquisi-
tion is content and context specific, general aspects of thinking also exist and have
important significance for learning to think (Perkins & Salomon, 1989).
Theoretical considerations suggest that MSK is important for students’thinking.
Therefore, instead of waiting for MSK to develop spontaneously, it makes sense to
try to teach it as an explicit instructional goal with the prediction that such teaching
may affect students’ thinking on the cognitive and metacognitive levels. Empirical
studies have indeed confirmed this prediction. Gains in students’ achievements fol-
lowing metacognitive treatment have been shown in such diverse areas as reading
comprehension (Aldridge, 1989; Brown & Palinscar, 1989; Davey & McBride,
1986; Gourgey, 1998; Koch, 2001; Palinscar & Brown, 1984), mathematical prob-
lem solving (e.g., Kramersky, Mevarech, & Lieberman, 2001; Mevarech, 1999;
Schoenfeld, 1979, 1992; Whimbey & Lockhead, 1986), physics (Basca & Grotzer,
2001; Grotzer & Perkins, 2000; Koch, 2001), foreign language (Carrell, Gajdusek,
& Wise, 1998), writing (Scardamalia & Bereiter, 1985), and lecture comprehension
(King, 1994). Additional empirical studies have supported the more specific claim
that using metacognition mayimprove learning of problem-solving and higher order
thinking skills (Chen & Klahr, 1999; Lin & Lehman, 1999; Ross, 1988; Schoenfeld,
1992; Toth, Klahr, & Chen, 2000; White & Frederiksen, 1998, 2000). In addition,
studies have indicated that the effect of addressing metacognitive knowledge explic-
itly during instruction may be even more important for students with low academic
achievements than for students with high academic achievements (e.g., White &
Frederiksen, 1998; 2000). The explanation for this finding is that students with high
academic achievements often manage to construct elements of metacognitive
338 ZOHAR
As many studies have shown, familiarity with whatever it is that one is supposed to
teach might be a necessary condition, but it is certainly not a sufficient condition
Downloaded by [New York University] at 02:29 28 April 2015
for teaching. Another factor that plays an important role in teachers’ ability to im-
plement the new ideas they study in professional development courses is pedagogi-
cal knowledge.
There is a large body of literature that, following Shulman’s (1986, 1987) work,
has addressed various components of teachers’ knowledge and distinguished
(among other things) between subject-matter knowledge, general pedagogical
knowledge, and pedagogical content knowledge (PCK). PCK is a blend of peda-
gogical knowledge and subject-matter knowledge that is specific to each teaching
topic (e.g., Adams & Krockover, 1997; Cocharn & Jones, 1998; Gess-Newsome &
Lederman, 1999; Kennedy, 1990; Loughran, Gunstone, Berry, Milroy, & Mulhall
2000; Shulman, 1986, 1987; Van Driel, Verloop, & de Voss, 1998; Wilson,
Shulman, & Richert, 1987). However, the distinction made in the literature be-
tween PCK and general pedagogical knowledge is fuzzy and unclear when one
tries to apply it to the context of teaching higher order thinking in general, and
MSK in particular. An elaborate discussion of this topic is beyond the scope of the
present article and can be found elsewhere (Zohar, 2004, chap. 6). In the present
context, it is important to note that part of the difficulty in aligning teachers’
knowledge in the context of teaching thinking with the prevalent concepts used in
the literature is related to the debate among scholars regarding the question of
whether thinking skills are general or content specific. Teaching thinking accord-
ing to the infusion approach assumes that thinking skills have some elements that
are general and other elements that are content specific. This notion presents an in-
nate difficulty in referring to the pedagogical knowledge teachers have in this field
as either PCK (that tends to be embedded in specific subject matters) or as general
pedagogical knowledge (that tends to be independent of specific subject matters).
It seems that because of the special nature of the type of knowledge under consid-
eration none of the existing constructs are appropriate. I therefore suggested to ad-
dress teachers’ pedagogical knowledge in relation to instruction of higher order
thinking by using a special term: pedagogical knowledge in the context of teaching
higher order thinking (Zohar, 2004). This term highlights the fact that pedagogical
knowledge in this field has some unique characteristics. At the same time this term
does not imply a commitment to treat this knowledge as either content specific or
HIGHER ORDER THINKING 339
to be considered. First, MSK has a strong linguistic component that can be put into
words, that is, formulated as statements that may be individually and socially ne-
gotiated. But although this knowledge must have a strong language component, it
does not require a complex, technical language. Professional terms may be re-
placed by a relatively natural, everyday type of language. For instance, the term
control of variables may be replaced by a fair test. The term tautology may be re-
placed by a circular explanation or an explanation that does not tell us anything.
A second point is that MSK must be strongly supported by experience and involve
a constant transition between the level of general, abstract rules and the level of con-
crete experiences. Because this type of knowledge is highly abstract, it is unlikely
that most students will be able to understand it without engaging in a series of practi-
cal experiences that will give them the “gut feeling” for a specific kind of thinking
skill or conceptual structure. The discussion of abstract and general elements of
thinking is thus woven into multiple experiences that consist of specific, content-de-
pendent problems requiring students to use a particular thinking strategy on a proce-
dural level. In this sense, addressing rules, generalizations, and principles of good
thinking is always connected to students’ concrete experience in which they use a
thinking strategy rather than addressing it in an abstract way that is disconnected
from immediate thinking experiences. The idea is to move constantly between two
levels of cognitive activities: a cognitive level that consists of engaging in active
thinking about specific, contextually rich issues and a metacognitive level that ad-
dresses rules and generalizations about thinking patterns. Such a process must be fa-
cilitated by long-term planning of instruction, that is, having the same thinking skills
addressed over and over again through different parts of the curriculum.
The idea is that knowledge of the general structures implied in MSK may be
transformed into powerful pedagogical tools that can be very effective in teaching
higher order thinking. Such pedagogical tools include several elements:
The analysis described in the previous sections carries a very clear and important
practical implication. It implies that MSK must become a permanent component in
HIGHER ORDER THINKING 341
the goals and design of learning in general and in the teaching of thinking strate-
gies in particular. According to this view, students still need to be engaged in solv-
ing context-specific problems. But the more general aspects of the thinking proce-
dures and of the metaconceptual structures they engage in must be addressed in an
explicit way. This would allow teachers to engage students in thinking processes in
a structured and systematic way in both specific lessons and across different units
of instruction. Indeed, this idea is expressed in several recent projects that focused
on teaching goals such as inquiry (White & Frederiksen, 1998), the formal opera-
tions defined by Piaget (Adey, 1999; Adey & Shayer, 1990, 1993, 1994; Adey,
Shayer, & Yates, 1989), and models of causality (Grotzer & Perkins, 2000).
Downloaded by [New York University] at 02:29 28 April 2015
subjects and in everyday life are also made. Thus, the idea behind this project is to
move constantly between two levels of cognitive activities: a strategic level that
consists of engaging in active thinking about specific, contextually rich situations
and a metastrategic level that addresses general aspects of thinking.
The previous section regarding MSK in teachers’ thinking is mostly based on the
literature that does not address directly MSK in teachers’ thinking. Previous stud-
Downloaded by [New York University] at 02:29 28 April 2015
ies have not examined directly issues such as the types of knowledge teachers need
for applying MSK in the course of instruction, the feasibility of developing such
knowledge in professional development courses, the characteristics of such poten-
tial developments, and the nature of professional development courses in this area.
Thus, the goal of the present article is to describe a study that focuses on these is-
sues. The study addresses the following research questions:
1. What types of knowledge do teachers need for applying MSK in the course
of instruction?
2. Is it feasible to help teachers develop the knowledge that is required for ap-
plying MSK in the classroom during a professional development course?
3. How do teachers develop working MSK in a professional development en-
vironment designed for promoting such learning?
4. What can the answers to the first three questions teach us about designing pro-
fessional development that may promote the use of MSK in the classroom?
Method
Background. This was a predominantly qualitative study conducted within
the framework of grounded research (Gibton, 2001; Glaser & Strauss, 1967). The
main theme of the research, that is, the development of teachers’ metacognitive
thinking, evolved from the purpose originally conceived for the research and in
terms of which much of the data was collected (Connelly & Clandinin, 1990;
Schwartzer, 2002). The data was originally collected to assess the development of
teachers’ pedagogical knowledge in the context of teaching higher order thinking.
Data collection took place in the form of individual interviews, classroom observa-
tions, and materials collected as a by-product of teachers’ learning during the
course (transcripts of discussions and selected examples of written work). Only af-
ter I read and reread numerous times the rich materials that were collected did
teachers’ metacognitive thinking indeed emerge as a specific topic of inquiry.
Data analysis is presented in two different forms. First, I present stories of de-
velopment of 2 teachers using a narrative approach (Connelly & Clandinin, 1990).
HIGHER ORDER THINKING 343
Participants
Participants were 14 junior high school and high school science teachers who at-
tended the TSC professional development course. Registration to the course was
voluntary, so most of the teachers who attended chose to take the course because
they wanted to learn more about how to develop students’ thinking. It may thus be
assumed that the teachers who took the course formed a self-selective group that
would be above the level of a randomly selected group of science teachers in terms
of their curiosity, their motivation for professional development, and their motiva-
tion to be up-to-date in educational innovations.
344 ZOHAR
The 14 participants were selected from all those who took the course (n = 43, di-
vided into two cohorts who went through an identical program) on the basis of their
geographical proximity to the researchers’ institution (within a radius of 50 miles).
Participants were contacted by telephone prior to the beginning of the course, and
asked for their consent to participate in this study. Of the 14 teachers, 10 had a bache-
lor of arts degree, and 4 had a master of arts degree in science or in education. Eight
teachers taught in junior high schools, 3 taught in both junior high and high schools,
and 3 taught in high schools. At the beginning of the study, 3 of the teachers had been
teaching for 2 to 3 years, 4 had been teaching for 7 to 14 years, and 7 had been teach-
ing for more than 15 years (M = 13.6 years, SD = 8.2 years).
Downloaded by [New York University] at 02:29 28 April 2015
1. Teachers’ (initial) knowledge and beliefs about teaching and learning were
most notably addressed through the video, activity sheets, and class discussion that
followed the Investigation of Microworld learning activity and through reflective
workshops.
HIGHER ORDER THINKING 345
Course description. The length of the course was 56 academic hours, di-
vided into three phases. Phase 1 lasted 3 consecutive days that took place early in
the school year. Teachers were released from their schools to attend. The main goal
of Phase 1 was to expose teachers to the principles and ideas of the TSC project.
Several types of sessions took place during this phase. Initial acquaintance with
some of the project’s characteristic learning activities began when teachers were
asked to solve the problems presented in the TSC tasks “as if they were students.”
In these sessions, teachers were engaged in active learning that took place both in-
dividually and in small groups. This process included extensive arguments and hot
debates. That activity served three purposes. First, it gave teachers an opportunity
to experience a TSC learning activity firsthand, as learners. Second, by solving the
problems presented in that activity, teachers engaged in the thinking patterns ad-
dressed by the activity, practicing them first on a procedural level and then on a
metacognitive level. This activity thus promoted teachers’ knowledge of thinking
skills on a strategic and metastrategic level. Third, based on their firsthand experi-
ences as learners, teachers were led to uncover the pedagogical principles upon
which the learning tasks were based. After teachers experienced the activity “as if
they were students,” the leaders asked them to review the activity, to contemplate
its goals, and to think about why various elements were designed as they were.
Through active discussions, teachers thus collaboratively constructed some of the
most basic pedagogical elements of a thinking project (e.g., students as active
problem solvers, the value of individual problem solving as a preparation for group
work, teaching for transfer, addressing thinking patterns on a procedural and
metacognitive level). In addition, teachers watched videos of students who en-
346 ZOHAR
gaged the same tasks, analyzed their thinking difficulties, and discussed various
instructional means for treating these difficulties. There were also some formal
lectures about theoretical topics pertaining to instruction of higher order thinking
(e.g., transfer and metacognition).
By the end of the first phase, teachers were asked to try out some of the thinking
tasks in their classrooms and to reflect upon them in writing, according to a set of
leading questions (see Individual Interviews subsection). They were asked to sub-
mit the written reflections approximately 4 weeks before the course met again for
Phase 2.
Phase 2 took place approximately 3 months after Phase 1 during 2 consecutive
Downloaded by [New York University] at 02:29 28 April 2015
days that consisted mainly of two workshops. The first—the reflective work-
shop—centered on the written reflections that teachers sent. The leaders of the
workshops adapted chosen reflections into written cases by adding guiding ques-
tions. These cases were then discussed during the workshops by small groups of
teachers. In the second—the creative workshop—small groups of 2 to 4 teachers
engaged in active design of “thinking” tasks and lessons. The purpose was not so
much the end products, but the process. It was found (through formal and informal
assessment) that the process of designing learning activities to promote students’
thinking was very helpful in consolidating teachers’ understanding regarding the
goals and the pedagogical means for teaching thinking. In addition, some time was
devoted once again to formal lectures about theoretical topics that pertain to in-
struction of higher order thinking. By the end of Phase 2, teachers were once again
asked to try out some “thinking lessons” in their classrooms and to submit written
reflections about their teaching. Phase 3 took place approximately 3 months later.
The plan for Phase 3 was essentially the same as for Phase 2.
MSK was addressed extensively throughout the course. The content of that part
of the course’s curricula was very similar to the ideas presented in the Background
subsection of the Method section of this article. Components of this content were
integrated into all sections of the course rather than addressed by one or two large
units. This was carried out by the use of diverse teaching methods: attending short
lectures regarding theoretical issues pertaining to metacognition and/or MSK;
solving problems with an explicit metacognitive and/or MSK component (pre-
sented as part of the TSC learning activities); reflecting upon and discussing the ra-
tionale of such learning activities; watching video segments of students who en-
gaged in TSC learning activities that had an explicit metacognitive and/or MSK
component and discussing relevant issues in students’ learning; experiencing the
teaching of TSC learning activities that consisted of an explicit metacognitive
and/or MSK component; reflecting (in writing) upon such teaching experiences
and then discussing them with peers and course leaders; analyzing written case
studies (that were based upon real classroom interactions) that addressed pedagog-
ical issues pertaining to the teaching of metacognition and/or MSK; designing new
learning activities that consist of an explicit metacognitive and/or MSK compo-
HIGHER ORDER THINKING 347
nent; and getting feedback from peers and course leaders regarding such learning
activities.
two events—a successful one and an unsuccessful one. The successful event was
defined as an event in which a teacher felt that he or she had made some progress
toward the goal of helping students advance their thinking. An unsuccessful event
was defined as an event in which a teacher felt that he or she had failed to achieve
this goal. Teachers were asked to transcribe the two events they had chosen and to
reflect upon them in light of several leading questions. All teachers agreed that
their work would be analyzed for research purposes.
The second source of examples of written work consisted of detailed lesson
plans that teachers produced, mostly during creative workshops.
Downloaded by [New York University] at 02:29 28 April 2015
Data Analysis
All recordings from both the interviews and the classroom observations were tran-
scribed by a research assistant and checked for accuracy by the researchers. Catego-
ries for analyzing the interviews and classroom observations were established.
These categories were not predetermined but emerged from the data following re-
peated readings, as is often the case in qualitative research (“grounded research”; see
Bogdan & Biklen, 1982; Gibton, 2001; Glaser & Strauss, 1967; Sabar, 1990;
Spradly, 1980). Most of the categories addressed various elements of higher order
thinking, such as the number and quality of thinking skills applied at each lesson, or
pedagogies related to the “culture of thinking” in the classroom. The analysis of
some of the categories was based upon conceptual frameworks that were found in the
literature about teaching higher order thinking (e.g., in the Findings section, see the
detailed description of the category that pertains to the language of thinking). A de-
tailed analysis of these categories is reported elsewhere (Zohar, 2004). The present
article reports only these categories that pertain to metacognition. Inter-rater reli-
ability ranged from 85% to 90%. A case study approach was used to analyze the data
collected from the two teachers whose development was studied in detail.
In the first part of the Findings section, I describe the professional development of
two teachers in detail. To get a broad picture, however, in the second part of the
Findings section, I describe the development of the 14 teachers as a group.
Yael’s Case
Yael’s knowledge before the course. Yael is a woman who has been teach-
ing science in a junior high school for 17 years and reported (in the early interview)
HIGHER ORDER THINKING 349
that she loves her job. The development of Yael’s MSK during the course is not a rep-
resentative case, because she made the most significant progress of all teachers. Her
case therefore portrays an almost ideal rather than a typical model of professional de-
velopment in the sense that her prior knowledge enabled her to take the ideas pre-
sented in the course and implement them in an admirable way. I chose to analyze the
case of Yael for two reasons. First, this case illustrates the type of professional
growth that might be hoped for following a professional development course in this
field. Second, because Yael’s development took place on multiple levels and in-
volved many different issues, a detailed analysis of this process creates a solid foun-
dation for understanding the group analysis that I present afterward.
Downloaded by [New York University] at 02:29 28 April 2015
In the early interview, Yael stated that one of her professional goals is to teach
her students to think. However, beyond this very general statement she was unable
to answer any of the more specific questions that referred to teaching higher order
thinking. She could not describe the means by which she engages her students in
learning to think, and when asked whether she is satisfied by the amount of time
she devotes to teaching thinking, she replied
You are asking me about a concept that I cannot define, so I cannot answer
this question.
When asked which thinking skills she is addressing in her teaching, Yael an-
swered that she does not know of any thinking skills:
I don’t know which thinking skills exist, so I can’t tell you. I am doing many
things by intuition, but I don’t know how to explain what I am doing by using
specific concepts.
The early classroom observation in which Yael was asked to invite the researcher to
attend a thinking lesson confirmed that during her actual teaching, Yael indeed re-
quired her students to think in an active way. The classroom observation confirmed,
however, that at this earlystage Yael lacked appropriate conceptual tools for thinking
and for speaking about thinking skills. The observation of the lesson took place in a
seventh-grade classroom. The goal of the lesson was to solve a problem: Students re-
ceived a copper cylinder and were asked to find out the specific mass of copper. To
solve the problem, students had to first solve a subproblem (how can the volume of
the copper cylinder be measured). Then they needed to measure the volume of the
copper cylinder (by dipping it in a graduated cylinder filled with water), and finally
to compute the specific mass of copper (students learned the formula for computing
specific mass and the mass of copper in a previous lesson).
The teacher seemed to be charismatic, creating an atmosphere of intellectual
challenge in the classroom. Students working in small groups competed with each
other as to which group would be the first to solve the problem, and seemed to be
350 ZOHAR
highly involved with the task, which they eventually solved correctly. However, it
was apparent that in leading her students through the task, the teacher used a wrong
terminology. Task analysis shows that although the task involved a “hands-on”
measurement (of the cylinder’s volume), the lesson involved problem solving
rather than scientific inquiry. Nevertheless, Yael presented the task as an instance
of scientific inquiry. She asked her students to define a research question to plan an
experiment, to record experimental results, and to draw conclusions. Following the
lesson, when the interviewer asked Yael why she thought this lesson was an exam-
ple of a thinking lesson, Yael could not give a clear answer.
In sum, the data shows that before the teachers’ course Yael indeed initiated
Downloaded by [New York University] at 02:29 28 April 2015
thinking activities in her classroom, but she did so intuitively; she lacked the MSK
that pertains to the thinking activities she had initiated.
Yael’s knowledge following the first interval and during the second
interval of the teachers’ course. During the first phase of the teachers’
course, Yael was deeply impressed by the metacognition unit. At the end of this
unit, she shared the following thoughts with one of the course’s leaders:
Immediately after returning home from the first phase of the course, Yael began
to write new “thinking” learning activities in which she applied the principles she
had learned during the course to new science topics. She was so excited by this
work that she felt a need to share her experiences. She called up one of the course’s
leaders to tell her about an invitation-to-inquiry (see Schwab, 1962, 1963) learning
activity that she had designed on the subject of the discovery of radioactivity by
Marie Curie. Yael reported that she had already used this learning activity success-
fully in three of her classrooms, and had also let two other science teachers from
her school (who had also attended the teachers’ course) use it in their classrooms.
She also said that she recorded one of these three lessons for her portfolio assign-
ment (i.e., for the assignment in which she was asked to report on selected events
from a recorded lesson):
I took you very seriously. During my winter vacation, I spent hours writing
an activity in chemistry … . I think the final product is really good consider-
ing it’s my first thinking activity. I am eager to get your feedback … . We al-
HIGHER ORDER THINKING 351
ready used it in five classrooms, and they [i.e., the students] liked it. It was
difficult for them to define a problem. I never before thought that it was a dif-
ficult thing to do. I know for sure that they learned at least one thing—about
conclusions. They confused between experimental results and conclusions
… [and we discussed the difference at length] … but I think it’s a good idea
to repeat this issue in other topics over and over again.
A task analysis of Yael’s learning activity shows that its final part addresses
MSK in an explicit way. This part of the activity provides a list of thinking skills,
requesting students to review their replies to previous questions and asking them to
Downloaded by [New York University] at 02:29 28 April 2015
match between the thinking skills in the list and their thinking while working each
of the previous questions. Yael learned this pattern of activity from one of the TSC
learning materials she had engaged with during Phase 1 of the course. She was able
to transfer this pattern to a new topic, that of her newly designed activity. A de-
tailed analysis indicates that at this stage of her professional development, Yael
identified correctly some of the thinking skills that were involved in the task, but
still failed to acknowledge some additional components that she had overlooked. It
should be noted that in the feedback that the TSC team gave to each of the learning
activities Yael (and the other teachers) designed, Yael always received comments
regarding the correctness of the MSK that had been used.
The data thus shows that following the course’s first phase Yael started to experi-
ment with teaching for thinking in a more focused and explicit way than prior to the
course. Throughout her work she began to apply correct MSK of thinking skills in her
teaching. This can be seen by the way she defined the thinking skills that her students
were engaged in (i.e., the references she made in the previously cited quote to defining
a problem and to differentiating between experimental results and conclusions). Addi-
tional pieces of evidence for the emergence of MSK at this stage is provided by her
correct identification of several of the metastrategies involved in the activity, and by
the design of an item in which Yael had explicitly aimed at engaging her students in
metastrategic thinking. The design of this item also reflects the first steps in the emer-
gence of pedagogical knowledge that pertain to the teaching of MSK.
In the second phase of the course, during a reflective workshop, Yael had an op-
portunity to present to her peers the learning activity she had written. All the partic-
ipating teachers analyzed the activity through a group discussion, made comments,
and discussed the thinking skills that were part of the activity by using explicit
thinking terms. During the rest of the school year, Yael sent the TSC staff three ad-
ditional learning activities that she had written and had used in her classrooms. She
received prompt and detailed feedback regarding each of these activities. She also
reported that she had engaged her students in a number of additional thinking ac-
tivities taken from the TSC books.
Yael’s own account of her professional development at this stage becomes ap-
parent through the way she described her experiences. In the opening session of the
352 ZOHAR
course’s second phase, teachers were asked to share with their peers any experi-
ences that they had with teaching thinking. Yael described her experiences in the
following way:
At the end of the first interval, I was in a state of shock. Since I returned
home, I started to write and to create new materials. I suddenly realized there
were so many issues I had never been aware of. I used to do many things in an
intuitive way, but I could not define them. I can’t tell you whether or not
these changes actually reached my students, but I went through a real
change. It was indeed an illumination.
Downloaded by [New York University] at 02:29 28 April 2015
At a discussion that took place in the closing session of the second phase, however,
Yael expressed a somewhat different view regarding the effects of her own change
process upon her students:
Yael’s knowledge at the end of the year. In the late classroom observation
that took place at the end of the school year, Yael engaged her students in a learning
activity about hormones. Yael had begun to write this learning activity together with
a group of other teachers during a creative workshop session that took place in the
course’s second phase. She completed the activity on her own, after she came back
from the course, and used it in the lesson to which she invited the experimenter for the
late classroom observation. The gist of the activity is that students are first asked to
collect information about several specific hormones and then to use this information
for generating a definition of the concept hormones. An analysis of this lesson
showed that Yael made enormous progress on many dimensions that pertain to
teaching thinking in comparison to the early classroom observation. In what follows,
I present only the dimensions that pertain to strategic knowledge and MSK.
In the lesson I analyzed as part of the late classroom observation, students were
presented with more thinking tasks than in the early classroom observation. Of the
questions that the teacher asked during the late lesson, 82% were classified as higher
order thinking questions, as compared to 50% of the questions during the early ob-
servations. There was also a difference in the nature of the skills that were addressed
during the two lessons. In the early observation, most of the thinking skills that were
addressed during the lesson were scientific inquiry skills. As described earlier, many
of these skills were not used in a proper way. In the late observation, students were re-
HIGHER ORDER THINKING 353
Y: Wait a minute, I need to ask how you had reached this definition.
Downloaded by [New York University] at 02:29 28 April 2015
S: That all hormones … I read everything and looked for things that are com-
mon to all of them.
Y: Is this all that they had in common? Try to see if there are any others.
TABLE 1
The Example Yael Wrote on the Board
Brown feathers Colored feathers (male only) Large body, eggs, and feathers.
Thick beak Lays eggs The beak is medium-size relative to its body.
Lays small eggs Sharp beak
354 ZOHAR
S1: Birds have feathers … [Yael turns to the board and writes: “Birds have
feathers.”]
S1: And a beak, and eggs.
Y: Great. How could you define birds based on these examples? How did you
know how to define a bird when you only had three examples? What did
you do in order to define? You didn’t just tell me “A sparrow, a peacock,
and an ostrich.” What did you do?
S1: I extracted and I summarized.
Y: What do you mean by extracting and summarizing. Let’s look for another
word.
Downloaded by [New York University] at 02:29 28 April 2015
S2: He extracted.
S3: He looked for the things they had in common.
Y: Can you take the things that all hormones have in common and tell me what
is a hormone? [Lesson continues, with different students offering defini-
tions.]
It seems that in this case, Yael ascribed the student’s difficulties in forming a
definition of a specific concept (hormone) to lack of MSK about the general char-
acteristics of a definition. She used the specific examples of birds and the general
definition of bird as an analogy that students were familiar with from their every-
day life. Then, she asked students to articulate what they did to define that concept.
This led to the formulation of a general rule about how to define concepts (i.e.,
MSK). She then led the students to use their newly constructed general rule to
solve the original problem, that is, to define a new concept (hormone) with which
they were not familiar.
Yael’s use of MSK in this lesson was not intuitive (the term she had used in the
early interview and observation for describing her treatment of thinking skills).
There are several pieces of evidence showing that in the late interview she was
highly aware of the thinking skills being taught. In the concluding interview, Yael
discussed several thinking skills in an explicit and correct way, and pointed cor-
rectly to the thinking skills addressed throughout the “hormones” activity. Another
piece of evidence supporting this finding is based upon the transcript of her lesson.
At a certain point during the lesson, Yael encountered a student who wrote a cor-
rect definition for hormone. However, this definition was copied from the textbook
rather than generated through the process of collecting information about several
specific hormones and extracting their common features. Yael responded by ex-
plaining once again how to form a definition and concluded her explanation by
making an explicit reference to the teaching goal underlying that part of the lesson,
which addressed MSK regarding definitions:
My goal here is to teach you how to use specific examples in order to form
definitions. I don’t want you to copy the definition from the book, because
HIGHER ORDER THINKING 355
although you might then have a wonderful definition in your notebook, you
would have missed the main point of the lesson.
Finally, Yael’s progress at the end of the year is reflected by her strive for
long-term planning and methodological teaching of thinking skills. In a written
questionnaire that was given at the end of the course, Yael was asked about any fu-
ture difficulties she might expect in “teaching for thinking.” Her reply included the
following:
Another difficulty [that I predict] is how to plan in a serious way the activi-
Downloaded by [New York University] at 02:29 28 April 2015
ties and the skills that I would like to address in each grade level. I would like
to think about it at the beginning of the year in order to see how to spread the
issues throughout the year, so that there will be an order and logic to what I
would teach rather than just do it by mere convenience as I’ve done this year.
I know that I used to do a lot of these things intuitively, without knowing the
titles or the names. It’s clear to me that now, when I know the titles—i.e., the
metacognition you had taught us—I find it much easier to do it in a con-
scious way. I want to organize our whole science team and tell them we need
to sit down [to plan the curriculum]. Some of the thinking skills are too diffi-
cult for students in Grades 7 or 8.
This excerpt also indicates that being conscious of thinking skills as explicit ed-
ucational goals also opens the door for the possibility of being sensitive to stu-
dents’ initial thinking level while planning a thinking curriculum. In sum, the data
shows that by the end of the school year Yael had a sound MSK of the thinking
skills she addressed in her teaching. She also had an appropriate pedagogical
knowledge that enabled her to engage her students in metastrategic thinking. She
explicitly discussed elements of MSK with her students, using various pedagogi-
cal means. Her solid MSK was reflected in the ways Yael dealt with students’
wrong answers and thinking difficulties. Finally, she was beginning to think about
how she could use the MSK she had acquired for long-term and methodological
planning of her teaching and for considering students’ thinking difficulties.
Sarah’s Case
In the early interview, Sarah reported that although she had never yet attended a
course whose goal is the development of students’ thinking, she had prior knowl-
edge of this topic from courses she had taken in philosophy and in education, and
from courses she had taken during her training as a pedagogical advisor. Indeed,
when asked about her goals with regards to fostering students’ thinking, she ex-
pressed concise and well-formulated goals:
[One of the important goals is] critical thinking so that they will not accept
everything they are told without questioning it. I feel that it is important that
students will be able to think for themselves, and to criticize. It is important
Downloaded by [New York University] at 02:29 28 April 2015
to teach more skills, and less content. Critical and independent thinking are
extremely important … . So that they will be able to find materials on their
own, to analyze them, to decide what is important and what is not so impor-
tant … . To be able to analyze and to synthesize.
When asked about the characteristics of a good teacher, Sarah replied that a
good teacher is one who is capable of teaching the skills she had described earlier.
She also explained that she chose to participate in the teachers’ course because she
felt the need to study how to teach thinking in a systematic and structured way:
These excerpts show that before the course Sarah had significant knowledge re-
garding the teaching of higher order thinking in general and about metalevel ele-
ments of teaching thinking in particular. Her interview shows that she was familiar
with a variety of specific thinking skills, viewing them as explicit, metalevel educa-
tional objectives. However, further probing during the early interview as well as an
analysis of the early classroom observation revealed severe gaps in Sarah’s knowl-
edge. First, the ability to use the language of thinking to describe thinking skills did
not always correspond with correct knowledge regarding the essence of these think-
ing skills. For instance, Sarah often said that she felt that teaching her students to ask
questions is very important, but the interviewer’s probing showed that in using this
term she meant to say that she is the one who is supposed to ask the questions (rather
than her students), whereas her students’ role is limited to finding the answers. Sec-
ond, Sarah did not engage her students in metacognitive thinking. This finding is
HIGHER ORDER THINKING 357
supported by two different pieces of evidence: First, Sarah stated explicitly that she
does not work with her students on a metacognitive level. Second, this statement was
confirmed by the analysis of the early classroom observation.
In addition, the early classroom observation revealed several problems that al-
though not directly related to the issue of metacognition, are nevertheless relevant
for understanding how metacognition was expressed in Sarah’s teaching (a de-
tailed analysis of this classroom observation is presented in Schwartzer, 2002).
Most of these problems pertained to pedagogical knowledge and were related to
the interaction between the teacher and her students. Sarah designed a reasonable
written assignment that indeed required higher order thinking. That assignment,
Downloaded by [New York University] at 02:29 28 April 2015
Sarah’s knowledge during the teachers’ course. The data show devel-
opment in various elements that pertain to Sarah’s metacognitive knowledge dur-
ing the course. After the first phase of the course, Sarah began to use in her teach-
ing elements that pertain to metacognition. Between the first and second phases of
the course, and between the second and third phases, Sarah tried out in her class-
room several of the TSC thinking activities. In the portfolio describing her work,
she noted several times that she discussed the thinking skills applied in these activ-
ities (e.g., controlling variables and differentiating between experimental results
358 ZOHAR
and conclusions) with her students in an explicit way, that is, on a metastrategic
level. By the end of the course’s first phase, she noted that she enjoyed the course
and emphasized what she had learned:
By the end of the second phase, she reported that writing the portfolio assignment
contributed to her metacognitive knowledge because she was required to think on a
metacognitive level when she first planned and then analyzed her teaching:
Downloaded by [New York University] at 02:29 28 April 2015
course, said Sarah, she learned that students’ wrong answers could be used as trig-
gers for meaningful knowledge construction. However, she anticipated that it
would not be easy to change her habits in this area.
Sarah’s knowledge at the end of the course. In the late interview, Sarah
was beginning to think about how she could use the MSK she had acquired for
long-term and methodological planning of her teaching. She noted that she would
like to design numerous thinking activities, because it is important that students be
able to apply the same thinking skills in several different science topics. Following
a question regarding the contribution of the course, Sarah replied
Downloaded by [New York University] at 02:29 28 April 2015
This excerpt shows that Sarah was aware of the fact that the course expanded
her metacognitive knowledge in the sense that she was now consciously thinking
about a larger list of thinking skills when planning her lessons. She was also aware
of the fact that she had acquired new pedagogical knowledge, such as how to treat
students’ wrong answers.
In the lesson I analyzed as part of the late classroom observation (the science
subject of that lesson was a comparison between germination of pea and wheat
seeds), students were presented with more thinking tasks than in the early class-
room observation (45 vs. 18, respectively). An analysis of the late classroom ob-
servation also shows progress in several areas that pertain to metacognition. In
terms of the vocabulary of thinking, Sarah used 30 thinking words in the early les-
son, and 140 words in the late lesson. Some examples of the new words she used in
the late lesson include the following: validity, assumption, identify, hypothesize,
and interpretation. She used the thinking vocabulary in a correct and precise way.
In addition to engaging students with tasks that required thinking on a strategic,
cognitive level, Sarah engaged her students in metacognitive thinking by using two
distinct means: a class discussion and a written activity sheet. In an elaborate class
discussion, Sarah explicitly addressed the issue of how to differentiate between ex-
perimental results and conclusions (Zohar, 1998). This class discussion was too
360 ZOHAR
metacognitive level, she helped students see what was wrong in the initial reply.
Finally, the same student who gave the initial wrong answer eventually constructed
an alternative, correct response. In this instructional sequence, Sarah illustrated the
interrelationships between knowledge of issues that pertain to MSK and issues that
pertain to pedagogical knowledge. Two elements of pedagogical knowledge in the
context of teaching higher order thinking that Sarah had learned in the course,
namely the knowledge of how treat students’ wrong answers regarding thinking
patterns and the knowledge of how to guide students’ thinking, were necessary for
Sarah to be able to lead her students in that metacognitive discussion.
The written activity Sarah used for the late classroom observation was taken
from the TSC book. This activity originally had no metacognitive component. Sa-
rah added several written questions that required metacognitive thinking. Some of
these questions followed a pattern that Sarah had encountered in other TSC tasks
(see Items 1a and 1b in the following list). Other metacognitive questions did not
follow a preknown pattern; that is, Sarah invented them (see Items 2 and 3 in the
following list). The metacognitive component of the activity was assigned after
students had completed the original written task and after difficulties in the origi-
nal task were resolved through class discussion. The task’s metacognitive compo-
nent consisted of the following (written) questions:
1a. Look again at section A questions 2 and 3. Next to each question write the
thinking skill you had used for answering the question. You may consult
the list of thinking skills below.
1b. Look again at section C questions 6, 7 and 8. Next to each question write
the thinking skill you used for answering the question. You may consult the
list of thinking skills below.
A list of thinking skills [These thinking skills were taken from the TSC teacher’s
guide.]:
2. Consider each of the questions in which you made a mistake. Please ex-
plain your mistake.
3. How would you improve your thinking to avoid each of the mistakes you
made?
Downloaded by [New York University] at 02:29 28 April 2015
• “I don’t know which thinking skills exist, so I can’t tell you. I am doing many
things by intuition, but I don’t know how to explain what I am doing by using
specific concepts.”
• “I don’t know what you mean.”
• “What is a thinking skill?”
• “What do you mean? … Look, from your question I understand that there are
various thinking skills, but I don’t … I simply miss … Perhaps I am doing
some things unconsciously. It’s hard for me to answer this question.”
• “I don’t know how to classify them.”
• “A research question … I don’t know how to classify.”
Downloaded by [New York University] at 02:29 28 April 2015
These excerpts show that at the early interview most teachers were not familiar
with the concept thinking skills. The few teachers (n = 3) who did reply to the inter-
view questions by naming specific thinking skills used almost exclusively examples
of scientific inquiry skills such as planning an experiment, controlling variables, for-
mulating research questions, formulating hypotheses, and drawing conclusions.
In the late interviews, teachers’ replies to the same questions were different than
those they gave in the early interviews. Thirteen of the 14 teachers replied that they
engage in developing their students’ thinking. In response to the question regard-
ing the thinking skills addressed in their classrooms, these 13 teachers gave multi-
ple and varied examples. As in the early interviews, most of the thinking skills that
teachers mentioned consisted of scientific inquiry skills. Thus, in the late interview
a larger number of teachers (13 vs. 3) made references to scientific inquiry think-
ing skills than in the early interviews (e.g., formulating a research question, formu-
lating a hypothesis, planning an experiment, differentiating between experimental
results and conclusions, and drawing valid conclusions). In addition, at this stage
teachers also mentioned a variety of other thinking skills that were not mentioned
in the early interviews, such as asking questions, making generalizations, identify-
ing assumptions, differentiating between relevant and irrelevant information, iden-
tifying tautologies, analyzing graphs, making comparisons, constructing concept
maps, identifying problems, and metacognition.
In sum, the comparison between the findings from the early and late interviews
indicates that in the late interviews a larger number of teachers were aware of a
larger variety of thinking skills than was the case in the early interviews.
vocabulary as it was expressed in the observed lessons. The number of times teach-
ers pronounced thinking words at the beginning and at the end of the year was
counted, and the mean number of words was calculated, using a t test to asses the
significance of the difference and to calculate the effect size. The second compo-
nent consisted of a similar analysis that was carried out for the variety of thinking
words (i.e., the number of different thinking words teachers pronounced, ignoring
how many times they pronounced each word).
The results show that the mean number of thinking words that teachers pro-
nounced in their lessons was 50.3 (SD =31.6) in the early classroom observations
and 77.7 (SD = 34.1) in the late classroom observations. This difference was statis-
tically significant, t = 2.66, p <0.05, with a large effect size (ES = 0.8). The median
was 42 words in the early classroom observations and 76 words in the late class-
room observations. It is important to note that the increase in the number of think-
ing words was found in the lessons of 11 teachers. Of the 3 remaining teachers, 1
teacher hardly spoke at all in the late classroom observation because during that
whole lesson students worked in small groups. A second teacher pronounced al-
most the same number of words in the two lessons, with a very slight decrease (79
words in the first lesson vs. 76 words in the second). Only the third teacher had a
considerable decrease in the number of words in the late observation (137 words in
the first lesson vs. 106 words in the second). However, because this teacher had a
high number of thinking words in both lessons, this decrease does not seem to be
significant in terms of this teacher’s ability to use thinking words during her lesson.
The analysis of the variety of thinking words showed that the mean number of dif-
ferent thinking words increased from 14.1 (SD = 3.65) in the early observations to
20.2 (SD = 4.52) in the late observations. This difference was also statistically signif-
icant, t = 5.61, p < 0.001, with a very large effect size (ES = 1.34). An increase in the
number of thinking words was observed in the lessons of 13 teachers. The remaining
teacher (in whose lesson a decrease in the mean number of different thinking words
was observed) was the same teacher mentioned earlier, who hardly spoke during the
late lesson because of students’ group work. In sum, the data shows that almost all
teachers improved their use of the language of thinking as measured by both the
number and the varietyof thinking words that theyhad pronounced in their lessons.
HIGHER ORDER THINKING 365
entific inquiry skills such as description of experimental results and drawing con-
clusions. All the other 10 teachers were either completely unaware of the thinking
strategies addressed in their lesson or aware only of a few of the thinking strategies
that were actually addressed in their lesson. This information is based upon teach-
ers’ explanations and is also confirmed by my analysis of the lessons.
Following the course, however, 12 teachers were aware of the thinking skills ad-
dressed in the observed lesson. The reflective reports of these 12 teachers fully
concurred with my analysis of the lesson. The interview data of 1 teacher was unin-
formative regarding this point, and the interview data of another teacher indicated
that she made a mistake; that is, she indicated different thinking skills than the ones
she had actually addressed as apparent from my analysis of her lesson. It may thus
be concluded that the course helped teachers to develop the ability to identify the
thinking strategies they address in their lessons.
The findings from this study confirm the findings from my earlier study (Zohar,
1999, 2004) that teachers’ initial MSK is lacking and is unsatisfactory for sound
teaching of higher order thinking skills. The present study aimed to refine our un-
derstanding of the knowledge teachers need for using MSK in the course of in-
struction. The study followed the professional development of 14 science teachers
during a whole school year in which they attended a professional development
course. The following findings emerged from our data analysis:
in their classrooms and most teachers were unable to name these thinking skills
correctly. As opposed to that, by the end of the course most teachers were aware of
the thinking skills they had been addressing in their classroom and were able to
name correctly most or all of these thinking skills.
3. MSK that pertains to scientific inquiry skills was more accessible to teachers
than MSK that pertains to other higher order thinking skills that are not related to
scientific inquiry.
4. By the end of the course teachers improved their use of the language of
thinking as compared with the beginning of the course.
5. By the end of the course considerable developments were observed in teach-
Downloaded by [New York University] at 02:29 28 April 2015
With respect to the second research question, these findings show that a profes-
sional development course can indeed help teachers make considerable progress
regarding the knowledge that is required for applying MSK in the classroom. How-
ever, to understand the nature of this progress and of its limitations, I need to turn to
a discussion of the remaining three research questions.
My ultimate goal in the TSC professional development course was to affect
teachers’ practice and eventually students’ learning. One limitation of this study is
that effects upon students’ learning were not assessed. Further study is needed to
assess such effects. The present study does, however, address the detailed conse-
quences of the course to teachers’ practice. In the literature review section of this
article, I asked what teachers need to know to be able to incorporate MSK routinely
into the course of instruction. The answer to this question involved two bodies of
knowledge. The first was teachers’ acquaintance with elements of MSK that are
pertinent to instruction of higher order thinking (i..e, what is equivalent to sub-
ject-matter knowledge in other science education contexts). The second was teach-
ers’ acquaintance with appropriate pedagogical knowledge about how to apply
MSK in classroom instruction. In what follows, teachers’ development with re-
spect to each of these bodies of knowledge is discussed in detail.
What is the nature of the development that is witnessed in teachers’ knowledge
of MSK that is pertinent to instruction of higher order thinking? The development
HIGHER ORDER THINKING 367
of sound MSK of even one thinking skill is often a long and tedious process that is
tightly connected to an individual’s strategic knowledge of that skill (e.g., Kuhn,
Garcia-Mila, Zohar, & Andersen, 1995; Siegler, 1996). With regard to some cate-
gories of thinking skills, the teachers’ responses to the course seem to fit the theory.
With regard to many other categories, however, teachers showed relatively rapid
changes. It is unreasonable to assume that the treatment of teachers’ thinking skills
that took place during the TSC course actually induced the rapid formation of to-
tally new MSK relating to so many thinking strategies. The findings thus suggest
that the pattern of teachers’ knowledge acquisition regarding this issue is complex
and varies for different categories of thinking strategies.
Downloaded by [New York University] at 02:29 28 April 2015
knowledge regarding scientific inquiry thinking strategies. However, the fact that
most teachers were initially unable to verbalize this knowledge shows that it was im-
plicit. Therefore, regarding scientific inquiry thinking strategies, the nature of the
developments that were witnessed in teachers’ MSK seems to reflect a transforma-
tion of their initially implicit metalevel knowledge into more explicit metalevel
knowledge, enabling them to verbalize it in a better way than they were prior to the
course. Teachers’ initial strategic knowledge, as well as their initial implicit
metalevel knowledge, can explain the fact that MSK pertaining to inquiry strategies
was found to be more accessible to teachers than MSK pertaining to other strategies.
Nevertheless, the findings also emphasize the significance of making such metalevel
Downloaded by [New York University] at 02:29 28 April 2015
knowledge of thinking skills explicit. Although teachers did seem to have consider-
able implicit metalevel knowledge of scientific inquiry strategies, this knowledge
was insufficient for the purpose of teaching higher order thinking in a sound and fo-
cused way. To facilitate such teaching, teachers must transform their implicit knowl-
edge into explicit knowledge that can be mediated through the language of thinking
(i.e., knowledge of the names of thinking strategies and the ability to verbalize when,
why, and how to use appropriate thinking patterns in the process of knowledge con-
struction and in problem solving, as is stated in the definition of MSK provided at the
beginning of this article). Only when the relevant MSK is indeed made explicit, (i.e.,
it becomes MSK according to the definition) does it become accessible for teachers’
use in their practice.
Argumentation skills document yet another distinct category of thinking pat-
terns, highlighting another possible route for the emergence of teachers’ MSK. Ini-
tially(i.e., before the course), the TSC teachers never addressed argumentation skills
as distinct educational objectives in the interviews or in the classroom observations.
Several previous studies have also confirmed that science teachers rarely engage
their students in argumentation (Zohar & Nemet, 2002). Following the course, how-
ever, teachers used the TSC argumentation unit extensively and expertly, addressing
argumentation skills in their classrooms in a way that reflected both strategic knowl-
edge and MSK of the pertinent thinking skills (Zohar, 2004). In fact, judging from
the large number of books that were sold, the argumentation unit became the most
popular of the TSC units and was implemented in numerous classrooms all over the
country. Teachers’fast implementation of this unit suggests that as with scientific in-
quiry strategies, the pertinent strategic and implicit metalevel knowledge had ex-
isted prior to the course. However, unlike inquiry skills, argumentation skills were
not part of what science teachers had normally experienced as part of their science
classroom culture (Zohar & Nemet, 2002). Part of the course’s contribution in this
field might be similar to the course’s contribution regarding inquiry skills, namely,
turning implicit knowledge into explicit knowledge. Another part might be in induc-
ing a change in what is valued in classroom culture and discourse. Consequently,
teachers became more disposed to bring forward into instruction knowledge compo-
nents that they had normally not applied to their instruction prior to the course. It is
HIGHER ORDER THINKING 369
important to note that the two explanations for the course’s contribution (i.e., turning
implicit metaknowledge into explicit, and changing what is valued in classroom dis-
course) support rather than exclude each other.
Different considerations, however, apply to other thinking skills. Regarding
thinking skills with which most teachers were initially totally unfamiliar and un-
able to use even on a strategic level, they indeed did not have any initial metalevel
knowledge. Regarding, for instance, identifying assumptions, it seemed that when
the appropriate MSK was presented by the leader of the course, teachers asked nu-
merous clarification questions, indicating that they found the issue unclear and
confusing. Although toward the end of the course the TSC team observed some de-
Downloaded by [New York University] at 02:29 28 April 2015
velopments in teachers’ MSK regarding this thinking skill (some teachers had be-
gun to apply it in their teaching), this development was not formally assessed.
A second limitation of this study is that it assessed teachers’ developing MSK in
a general way, rather than doing so more precisely, which would have required sep-
arate and formal measures for each of the thinking skills addressed by the study.
Further studies are needed to find ways to measure teachers’ MSK of various
thinking skills before and after the course, to learn more about the precise develop-
mental patterns of teachers’ MSK regarding specific thinking strategies. Indeed, I
am currently developing such measures in two new, ongoing studies that address
the development of students’ MSK following explicit instruction, regarding four
scientific inquiry thinking skills. Applying similar measures to assess the develop-
ment of teachers’ thinking would make an important practical contribution be-
cause such research could yield specific recommendations regarding how to teach
specific thinking skills in future professional development courses.
However, despite this limitation, the findings of the study reported in the pres-
ent article and the theoretical considerations presented earlier can illuminate some
issues that pertain to the third research question, namely, how do teachers develop
working MSK in a professional development course. The data suggest that the
overall development in teachers’ MSK during the course is a conglomerate of sev-
eral types of developments. In some cases, the course introduced new thinking
strategies that teachers learned both on a strategic and on a metastrategic level. Fu-
ture research is needed to determine the exact nature of the development of teach-
ers’ thinking regarding such strategies. In other cases, the course helped in making
preexisting, implicit metalevel knowledge more explicit, and/or in changing the
learning culture to embrace and to value new forms of discourse regarding think-
ing. The latter two developments seem to be very significant in making MSK ac-
cessible in teachers’ practice.
What is the nature of the developments witnessed in teachers’ pedagogical
knowledge? Prior to the course, Yael had a solid pedagogical knowledge. Al-
though my analysis did not attempt to discern all the components of that knowl-
edge, it makes sense to assume (based on the first classroom observation and on the
literature) that it consisted of a mixture of general pedagogical knowledge and
370 ZOHAR
PCK in the context of specific science subjects. However, prior to the course, Yael
had no explicit MSK in the sense that she was unaware of the thinking skills she
addressed in her practice and was unable to discuss them on a metalevel. She was
also not familiar with many aspects of pedagogical knowledge in the context of
teaching higher order thinking, and more specifically with the pedagogical knowl-
edge that pertains to MSK. During the first phase of the course, Yael’s knowledge
was affected in at least three areas. First, she gained some new explicit MSK. Sec-
ond, she gained some specific pedagogical knowledge concerning how to address
MSK in class (e.g., a pattern for designing a written item that required students to
think on a metacognitive level). Third, she developed a set of beliefs regarding the
Downloaded by [New York University] at 02:29 28 April 2015
significance of using MSK with her students that motivated her to implement
metacognition in her practice. Because her initial pedagogical knowledge had
been sound, these changes in her knowledge were sufficient for inducing consider-
able changes in her practice. Right after Yael returned from the course’s first phase,
she began to implement MSK in her teaching. She then used it extensively
throughout the year. Data from the late classroom observation illustrate an exem-
plary lesson applying many of the pedagogical tools that are unique to the teaching
of MSK (see the MSK in the “Thinking” Classroom section).
Sarah’s developmental pattern was very different from Yael’s. Whereas Yael ini-
tially lacked knowledge of the pedagogical tools unique to teaching MSK, Sarah in
addition had significant gaps in her broader pedagogical knowledge. Like Yael, she
had initially lacked knowledge of the pedagogical tools that are unique to the teach-
ing of MSK. However, in contrast to Yael, she had several gaps in her broader peda-
gogical knowledge. These gaps obstructed the expression of her developing MSK in
her practice. She struggled with these issues throughout the course. During the
course, she indeed improved her knowledge of explicit MSK, and of specific peda-
gogical tools for teaching MSK (such as planning written assignments that consist of
a metacognitive component aiming to teach a large and varied repertoire of thinking
skills). However, these types of knowledge could not be fully expressed in her prac-
tice until she also developed more appropriate means for treating students’wrong an-
swers and for leading students’thinking. These findings show the interrelationships
between the various knowledge components that are at play here: The expression of
MSK in instruction was dependent upon elements of pedagogical knowledge, some
of which pertain to general pedagogical knowledge (e.g., knowing how to present a
written task in a way that will motivate students), some of which pertain to pedagogi-
cal knowledge in the context of teaching higher order thinking (e.g., knowing how to
lead and guide a discussion that addresses students’thinking), and some of which are
even more specific to the teaching of MSK (e.g., knowing how to design a thinking
task with a metacognitve component).
These findings and considerations can form the basis for answering the first re-
search question regarding the types of knowledge that teachers need to be able to
apply MSK in the course of instruction. The somewhat general ideas presented in
HIGHER ORDER THINKING 371
the literature review may now be revisited and consolidated in light of the empiri-
cal data presented earlier.
Previous researchers have shown that when teaching specific contents, teachers
must have a combination of subject-matter knowledge, general pedagogical knowl-
edge, and PCK (e.g., Gess-Newsome & Lederman, 1999; Shulman, 1986, 1987).
My findings show that these three elements are also necessary for addressing MSK
in the classroom, but here they have a special character that derives from the special
nature of MSK. As is the case for any subject matter they teach, teachers need to be
proficient in various elements of MSK to apply it in their classrooms. However, due
to the special nature of MSK, there are three further requirements. First, teachers’
Downloaded by [New York University] at 02:29 28 April 2015
MSK must be explicit. Although implicit metalevel knowledge may be sufficient for
applying thinking skills for problem solving, it is definitely insufficient for the pur-
pose of sound instruction. Second, MSK should become a valued and desired com-
ponent of classroom discourse. And third, teachers must also be proficient in the stra-
tegic level of a thinking skill because it is the foundation of having metalevel
knowledge regarding that skill.
In terms of general pedagogical knowledge, instruction of MSK is also similar
to instruction of specific subjects, in that general pedagogical knowledge is a pre-
requisite for both. To effectively teach/apply MSK in their classrooms, teachers
must have a pedagogical knowledge of higher order thinking skills (which can en-
able them to teach thinking skills on a strategic level; see Zohar, 2004). In addition
to this, however, teachers also need to be proficient in the subcomponent that con-
sists of several pedagogical tools that are very specific to the domain of teaching
MSK. A graphic representation of the types of knowledge that teachers need for
applying MSK in the course of instruction is shown in Figure 1.
The findings also point to some additional ideas regarding the third research
question (namely, how teachers develop working MSK). First, the case studies of
Yael and Sarah show that the pattern of teachers’ development is individual and
highly dependent upon each teacher’s prior knowledge.
Second, the findings identified several different aspects of development in
teachers’ working MSK. One aspect was expressed when teachers became more
proficient users of the language of thinking. Being more proficient users of the lan-
guage of thinking allows teachers to incorporate a richer “thinking” vocabulary
into classroom discourse, thereby providing modeling for students’ conversations
and providing scaffolds for their thinking (Tishman et al., 1995). Most teachers (11
Downloaded by [New York University] at 02:29 28 April 2015
obvious practical recommendation that follows from this is that future professional
development courses must devote a considerable amount of time not only to teach-
ers’MSK but also to the specific pedagogical knowledge in the context of MSK that
is necessary for using this knowledge in the classroom.
Finally, in response to the fourth research question (regarding the design of pro-
fessional development to promote the use of MSK in the classroom), the study’s
findings indicate the types of knowledge that the design of professional development
courses in this field needs to address. The findings show the limitations that teachers’
implicit metaknowledge about thinking strategies have for effective teaching. The
findings thus highlight the significance of transforming such implicit knowledge to
Downloaded by [New York University] at 02:29 28 April 2015
REFERENCES
Adams, P. E., & Krockover, G. H. (1997). Beginning science teacher cognition and its origins in the
preservice secondaryscience teacher program. Journal of Research in Science Teaching, 34, 633–665.
Adey, P. (1999). The science of thinking, and science for thinking: A description of cognitive accelera-
tion through science education (CASE). Switzerland: International Bureau of Education.
Adey, P. S., & Shayer, M. (1990). Accelerating the development of formal thinking in middle and high
school pupils. Journal of Research in Science Teaching, 27, 267–285.
Adey, P. S., & Shayer, M. (1993). An exploration of long-term far-transfer effects following an extended
intervention program in the high school science curriculum. Cognition and Instruction, 11, 1–29
Adey, P. S., Shayer, M., & Yates, C. (1989). Thinking science: Student and teachers’ materials for the
CASE Intervention. London: Macmillan.
Downloaded by [New York University] at 02:29 28 April 2015
Adey, P. S., & Shayer, M. J. (1994). Really raising standarts. London: Routledge.
Aguirre, J., & Speer, N. M. (1999). Examining the relationship between beliefs and knowledge in
teacher practice. Journal of Mathematical Behavior, 18, 327–356.
Aldridge, M. (1989). Student questioning: A case for freshman academic empowerment. Research and
Teaching in Developmental Education, 5, 17–24.
Ball, D. L. (1990). Reflections and deflections of policy: The case of Carol Turner. Educational Evalu-
ation and Policy Administration, 12, 247–259.
Basca, B. B., & Grotzer, T. A. (2001, April). Focusing on the nature of causality in a unit on pressure:
How does it affect student understanding? Paper presented at the annual meeting of the American
Educational Research Association, Seattle, WA.
Bloom, B. (1956). Taxonomy of educational objectives: Handbook I. Cognitive domain. New York:
McKay.
Bogdan, R. C., & Biklen, S. K. (1982). Qualitative research for education: An introduction to theory
and methods. Boston: Allyn & Bacon.
Borko, H., & Putnam, R. T. (1996). Learning to teach. In Handbook of educational psychology: A pro-
ject of Division 15, the division of educational psychology of the American Psychological Associa-
tion (pp. 673–725). New York: Macmillan.
Bransky, J., Hadass, R., & Lubezky, A. (1992). Reasoning fallacies in preservice elementary school
teachers. Research in Science & Technological Education, 10, 83–92.
Brickhouse, N. W. (1990). Teachers’ beliefs about the nature of science and their relationship to class-
room practice. Journal of Teacher Education, 41, 53–62.
Brown, A. L., & Palinscar, A. S. (1989). Guided, cooperative learning and individual knowledge acqui-
sition. In L. B. Resnick (Ed.), Knowing, learning and instruction: Essays in honor of Robert Glaser
(p. 393–451). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
Brownell, G., Jadallah, E., & Brownell, N. (1993). Formal reasoning ability in preservice elementary
education students: Matched to the technology education task at hand? Journal of Research on Com-
puting in Education, 25, 439–446.
Bruer, J. T. (1993). Schools for thought. Cambridge, MA: MIT Press.
Carpenter, T. P., Lynn-Blanton, M., Cobb, P., Loef-Frank, M., Kaput, J., & McClain, K. (2004). Scaling
up innovative practices in mathematics and science (Research Rep.). Madison: University of Wis-
consin, National Center for Improving Learning and Achievement in Mathematics and Science.
Carrell, P. L., Gajdusek, L., & Wise, T. (1998). Metacognition and EFL/ESL reading. Instructional Sci-
ence, 26, 97–112.
Chen, Z., & Klahr, D. (1999). All other things being equal: Children’s acquisition of the control of vari-
ables strategy. Child Development, 70, 1098–1120.
Cocharn, K. F., & Jones, A. L. (1998). The subject matter knowledge of preservice science teachers. In
B. Fraser & K. Tobin (Eds.), International handbook of science education (pp. 707–718). Dordrecht,
The Netherlands: Kluwer.
HIGHER ORDER THINKING 375
Connelly, F. M., & Clandinin, D. J. (1990). Stories of experience and narrative inquiry. Educational Re-
searcher, 19(5), 2–14.
Davey, B., & McBride, S. (1986). Effects of questioning generation training on reading comprehension.
Journal of Educational Psychology, 78, 256–262.
De Jong, O., Korthagen, F., & Wubbels, T. (1998). Research on science teacher education in Europe:
Teacher thinking and conceptual change. In B. Fraser & K. Tobin (Eds.), International handbook of
science education (pp. 745–758). Dordrecht, The Netherlands: Kluwer.
Ennis, R. H. (1989). Critical thinking and subject specificity: Clarification and needed research. Educa-
tional Researcher, 18(3), 4–10.
Fishman, B. J., Marx, R. W., Best, S., & Tal, R. T. (2003). Linking teacher and student learning to improve
professional development in systemic reform. Teaching and Teacher Education, 19, 643–658.
Gess-Newsome, J., & Lederman, N. G. (Eds.). (1999). Examining pedagogical content knowledge.
Downloaded by [New York University] at 02:29 28 April 2015
Little, J.(2002). Locating learning in teachers’ communites of practice: Opening up problems of analy-
sis in records of everyday work. Teaching and Teacher Education, 18, 917–946.
Little, J.(2003). Inside teacher community: Representations of classroom practice. Teachers College
Record, 105, 913–945.
Loef-Frank, M., Carpenter, T., Fennema, E., Ansel, E., & Behrend, J.(1998). Understanding teachers’
self-sustaining generative change in the context of professional development. Teaching and Teacher
Education, 14,67–80.
Loughran, J., Gunstone, R., Berry, A., Milroy, P., & Mulhall, P. (2000, April). Documenting science
teachers’pedagogical content knowledge through PaP-eRs. Paper presented at the annual meeting of
the American Educational Research Association, New Orleans, LA.
Mevarech, Z. R. (1999). Effects of metacognitive training embedded in cooperative settings on mathe-
matical problem solving. Journal of Educational Research, 92, 195–205.
Downloaded by [New York University] at 02:29 28 April 2015
Stipek, D. J., Givvin, K. B., Sallmon, J. M., & MacGyvers, V. L. (2001). Teachers’ beliefs and practices
related to mathematics instruction. Teaching and Teacher Education, 17, 213–226.
Strauss, S., & Shilony, T. (1994). Teachers’ models of children’s minds and learning. In L. A. Hirshfeld
& S. A. Gelman (Eds.), Mapping the mind: Domain specificity in cognition and culture (pp.
455–473). Cambridge, MA: Cambridge University Press.
Thomaz, M. F., & Gilbert, J. (1989). A model for constructivist initial physics teacher education. Inter-
national Journal of Science Education, 11, 35–47.
Tishman, S., Perkins, D., & Jay, E. (1995). The thinking classroom. Boston: Allyn & Bacon.
Tobin, K. (1993). Referents for making sense of science teaching. International Journal of Science Ed-
ucation, 15, 241–254.
Tobin, K., & McRobbie, C. J. (1996). Cultural myths as constraints to the enacted science curriculum.
Science Education, 80, 223–241.
Downloaded by [New York University] at 02:29 28 April 2015
Toth, E. E., Klahr, D., & Chen, Z. ( 2000) Bridging research and practice: A cognitively based class-
room intervention for teaching experimentation skills to elementary school children. Cognition and
Instruction, 18, 423–459.
Van Driel, J. H., Verloop, N., & de Voss, W. (1998). Developing science teachers’ pedagogical content
knowledge. Journal of Research in Science Teaching, 35, 673–695.
Watts, M., Jofili, Z., & Bezerra, R. (1997). A case for critical constructivism and critical thinking in sci-
ence education. Research in Science Education, 27, 309–322.
Whimbey, A., & Lockhead, J. (1986). Problem solving and comprehension. Hillsdale, NJ: Lawrence
Erlbaum Associates, Inc.
White, B. Y., & Frederiksen, J. R. (1998). Inquiry, modeling and metacognition: Making science acces-
sible to all students. Cognition and Instruction, 16, 3–118.
White, B. Y., & Frederiksen, J. R. (2000). Metacognitive facilitation: An approach to making scientific
inquiry accessible to all. In J. L. Minstrell & E. H. Van-Zee (Eds.), Inquiry into inquiry learning and
teaching in science (pp.331–370). Washington, DC: American Association for the Advancement of
Science.
Wilson, S., Shulman,L., & Richert, A.(1987). “150 different ways” of knowing: Representations of
knowledge in teaching. In J. Calderhead (Ed.), Exploring teacher thinking (pp. 104–124). London:
Cassell.
Wilson, S. M. (1990). A conflict of interests: The case of Mark Black. Educational Evaluation and Pol-
icy Analysis, 12, 293–310.
Zohar, A. (1996). Transfer and retention of reasoning skills taught in biological contexts. Research in
Science and Technological Education, 14, 205–219.
Zohar, A. (1998). Result or conclusion? Students’ differentiation between experimental results and
conclusions. Journal of Biological Education, 32, 53–59.
Zohar, A. (1999). Teachers’ metacognitive knowledge and instruction of higher order thinking.
Teaching and Teacher Education, 15, 413–429.
Zohar, A. (2004). Higher order thinking in science classrooms: Students’ learning and teacher’ profes-
sional development. Dordrecht, The Netherlands: Kluwer.
Zohar, A., & Dori, Y. J. (2003). Higher order thinking skills and low achieving students: Are they mutu-
ally exclusive? Journal of the Learning Sciences, 12, 145–182.
Zohar, A., & Nemet. F. (2002). Fostering students’ knowledge and argumentation skills through dilem-
mas in human genetics. Journal of Research in Science Teaching, 39, 35–62.
Zohar, A., Weinberger, Y. & Tamir, P. (1994). The effect of the biology critical thinking project on the
development of critical thinking. Journal of Research in Science Teaching, 31, 183–196.