Académique Documents
Professionnel Documents
Culture Documents
International Journal of Engineering Education Vol. 32, No. 1(A), pp. 111, 2016
Printed in Great Britain
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
KATHERINE A. GUSTAFSON
E-mail: kathy.gustafson@dsisd.txed.net
PRATEEK SHEKHAR
Department of Mechanical Engineering, The University of Texas at Austin, 204 E. Dean Keeton Street, Stop C2200, ETC II 5.160, Austin,
Texas 78712-1591, USA. E-mail: pshekhar@utexas.edu
K-12 engineering is a critical platform for achieving integrated science, technology, engineering, and math STEM teaching
and learning in the Unites States. This has fueled research in the development and testing of integrated STEM curricula.
This study examines the contrasting ways in which a prescribed curriculum is translated into practice. The study examines
the implementation of 12-week secondary engineering unit (helmet design) by a teacher with high content knowledge in
engineering in a rural/suburban school with 20 students. The unit was designed with signicant input from a universitybased team including content experts, learning scientists, master teachers, classroom teachers, and school district
administrators as part of a grant focused on the creation of a high school engineering course. Five strands were identied
in the unit for analysis: assessment, activities, apparatus, technology, and standards. Findings indicate much alignment
with apparatus, standards, and technology strands and disparity within the assessment and activities strands between the
prescribed unit and its enactment in the course by the teacher.
Keywords: STEM integration; K-12 engineering education; engineering curriculum
1. Introduction
Alignment between curriculum standards, instruction, and assessment greatly facilitates communication about the specic content teachers are required
to teach and represents a necessary condition for
reliable assessment and accountability results and
condence in inferences about what students know.
Studies have shown repeatedly that students who
are taught more of the curricula content that
appears on achievement tests or well-aligned state
testing outperform those who are taught less of that
content when controlling for other factors such as
prior knowledge, teacher ability, and socioeconomic status [13]. Therefore, it appears fairly
straightforward that students opportunities to
learn, retain, and retrieve specic objects in the K16 curriculum are concurrently a feature of instruction as well as a critical factor in student learning.
The criticality of integrated science, technology,
engineering, and math (STEM) curricula towards
helping students develop deep and coherent understanding of STEM disciplines has been widely
emphasized by policy makers, research councils,
and educational researchers. K-12 engineering is a
critical platform for achieving integrated STEM
** Corresponding author.
* Accepted 15 September 2015.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
2. Literature review
As curriculum has been studied historically, it has
been realized that the general sense of the word
evolved into various ideas associated with the
expression. Researchers have made a clear distinction between the intended or prescribed curriculum,
the one planned for, and the implemented curriculum, the actual classroom practice [10]. In general,
these distinctions have been organized and articulated according to the level in which the curriculum
is examined: (a) the intended curriculum, at the level
of the system; (b) the implemented curriculum, at
the level of the class; and (c) the attained curriculum,
at the level of the student (the attained curriculum is
not addressed in this study) [1113]. Porter and
Smithson [14], in their classic work in the area,
distinguished the intended from the assessed curriculum and the enacted from the learned curriculum.
According to these researchers, the assessed curriculum is the one represented by high-stakes high
accountability tests. The learned curriculum is the
content that has been learned as well as the level of
prociency oered by test scores (p. 3) [14].
Regardless of the plans or the tests, however important they might be in determining what occurs in the
classroom, the curriculum observed during classroom practice, the enacted curriculum, has an
identity of its own. The enacted curriculum is
arguably the single most important feature on any
curriculum indicator system (p. 2) [14]. From some
researchers perspective, teachers are active developers of the enacted curriculum, constituted by the
experiences, whether intended or not, which occur
within the engineering classroom [1518]. Recent
eorts for engineering education and curriculum
reform have sought to impact these dierent levels.
In many countries, the intended curriculum is
reected in a national curriculum. In the United
States, in the absence of a national curriculum, some
entities have engaged in the process of curriculum
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
STEM Integration: A Study examining the enactment of prescribed Research Based Engineering Curriculum
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
the how, rather than the end result, laid the foundation of much-needed research in the area of measurement of this curriculum in order to qualify its
signicance.
The idea of measuring the enacted curriculum
emerged slowly and centered primarily in the area of
research on teaching [12]. Early research largely
ignored this construct, focusing almost exclusively
on the eects of teaching behaviors on student
achievement in curricular domains. This approach
occurred without any attempts to control for the
potentially confounding impact of dierences in the
amount of and quality of coverage of the curriculum
by teachers. This approach led to a great deal of
criticism and eventually to a gradual recognition
that measures of the enacted curriculum were central to research on teaching [for an excellent review,
see [27]].
One result of this critique was that early measures
of the enacted curriculum were designed simply to
control for the overlap between what was taught
and what was tested [1, 28]. Basically, the strategy
was to obtain a table of curriculum content for the
achievement test being used in a study and then to
ask teachers to check those content areas where
instruction had been oered (mainly during the
period of study).
As this research line matured, educational
researchers incorporated increasingly sophisticated
ideas about the curriculum into their research. One
development was the formulation of a hierarchical
conception of the curriculum. Here, the enacted
curriculum was seen as having at least two dimensions worthy of measurement. The rst was simply a
list of the topics or objectives that constitute a given
subject in the curriculum. A second dimension was
the cognitive complexity at which a given curriculum topic was taught [10].
Currently, most research on the enacted curriculum conceptualizes schooling as a series of repeated
(e.g., daily) exposures to instruction and takes as the
key measurement problem to sample across days of
instruction in order to produce an estimate of the
overall amount or rate of exposure to particular
elements of a curriculum during some xed interval
of time.
It has been shown that not only is the measurement of the enacted curriculum essential to understanding what students will learn, but the nature of
the analysis is equally important. Previous eorts to
gather data on the enacted curriculum have relied
on basically two approaches. The most common
approach has been to send trained observers into
schools to collect structured observational data,
using video and coding later by experts. This
approach, often seen as ideal, was used extensively
in processproduct research [for a review, see [29]]
3. Methodology
The unit was enacted in a rural/suburban school by
a group of 20 general education students (15 males)
with a teacher with high content knowledge in
engineering (a former civil engineer) as well as 10
years of experience as a classroom teacher. The
teacher was also part of the same National Science
Foundation grant (UTeach Engineering) and was in
the process of obtaining a masters degree in STEM
education during the study. The prescribed curriculum was created by UTeach Engineering sta. It
consisted of a binder with paper resources by unit
including an overview for some of the lessons, a
teacher page with specics on the intent of the
curriculum and additional resources, a student
page if needed, a CD with the same resources, and
additional resources that could be used throughout.
These supplementary documents included calculation pages, handouts on various topics related to
helmet design, PowerPoint lessons, and other
resources.
Because this course was being piloted as the
curriculum developed by The University of Texas
education and engineering sta, there were several
opportunities for interaction (focus groups and email correspondence) during the 12 weeks as well as
just-in-time trainings and lectures on helmet design
by university engineering professors oering piloting teachers resources to aid in the development of
content knowledge and their delivery of the curriculum.
In order to analyze the prescribed and enacted
curriculum systematically, the data needed to be
identied and then each piece examined in a structured way. Grounded theory is a research method
that operates almost in a reverse fashion from
traditional research and at rst may appear to be
in contradiction to the scientic method. Rather
than beginning with a hypothesis, the rst step is
marking key points in the collected data with a series
of codes, which are extracted from the text. The
codes are grouped into similar concepts in order to
make them more workable. From these concepts,
categories are formed, which are the basis for the
creation of a theory, or a reverse-engineered
hypothesis. With the understanding of the idea of
grounded theory, each curriculum was studied to
determine if there were common strands that related
to the curriculum and could be seen as possible areas
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
4. Findings
4.1 Assessment
Assessment has a vital role in any curriculum in
almost any setting, whether it is formative assessment, summative assessment, assessment centered
on accountability measures, or informal assessments of student understanding and a teachers
decision on when to proceed or remain on a topic
or unit. For the prescribed curriculum, four substands within assessment were identied: questioning techniques, class or group discussions, Engineering Notebook reections, and formal and
informal presentations. On the other hand, in the
enacted curriculum we identied dierences and
similarities within these sub-strands.
The presence of questioning techniques and class
or group discussions as a form of assessment in both
the prescribed and enacted curriculum. In the prescribed curriculum, questioning techniques usually
consisted of a series of questions following watching
videos, reading articles, or observing procedures or
apparatuses. These questions were written in such a
way to help lead the student to the desired learning
or task outcome. Usually the series included many
questions, which allowed for variety in questioning
depending on student response. The teacher logs
indicated extensive use of questioning in enactment
of the prescribed curriculum. At least a third of the
teacher logs reported instances of teacher questions
probing students helmet unit centered content
knowledge such as physics incorporated in the
bench apparatus, how to conduct data runs and
iterations, the description and utilization of box
plots, and the comparison of baseline and nal
data. Although these questions included two of
the prescribed areas of questioning such as observing procedures and apparatuses, the other questions focused on data modelling and statistical
understanding which was the teachers area of
expertise.
Similarly, the presence of class and group discussions was documented in the prescribed curriculum
and its enactment by the teacher. However, the
ndings revealed implementation dierences. In
the prescribed curriculum, class and group discussions asked the students to reect, recognize, and
compare data inconsistencies or design aws. In the
enactment, the teacher showed students videos
about usefulness of helmets and then assessed
student prior knowledge by initiating brainstorm-
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
STEM Integration: A Study examining the enactment of prescribed Research Based Engineering Curriculum
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
STEM Integration: A Study examining the enactment of prescribed Research Based Engineering Curriculum
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
also evident in the enacted curriculum. The teachers logs indicated the utilization of such technologies, for example, the internet was used for web
searches and projectors for student and teacher
presentations. These technologies were used in a
traditional prescribed manner without any innovative modications by the teacher in the enacted
curriculum.
Second, the use of software for data collection
was in alignment between the prescribed and
enacted curriculum. The prescribed curriculum
recommended the use of Labview software to collect
deection, velocity and acceleration data. The
enacted curriculum included the use of the prescribed software as an interface for data collection
and analysis for the helmet lab bench activity. The
use of software allowed the accurate measurement
of trial runs on various helmet designs, energy
absorption tests, and force impacts. For the most
part, this worked uidly and provided the teacher
and students with accurate and professional-looking lab data, which were eectively used in data
analysis and design-making decisions and iterations.
Third, the use of videos was evident in both the
curriculums, however teacher logs mentioned challenges that the teacher face in its use. The prescribed
curriculum suggested the use of YouTube videos to
aid classroom instruction. Being a prohibited site,
the use of YouTube videos was a tedious process for
the teacher. The teacher assigned most of the videos
to watch at home while the students were able to
watch some of the videos using their phones. Also,
since the videos were not created specically for the
helmet unit, there were mentions of student frustrations in teacher logs regarding the content and
relevance of the videos. The prescribed curriculum
included YouTube as the main source of videos for
aiding instruction. Although videos are a great way
for the student to engage in a lesson, access to them
needs to be universal for any school or institution.
Providing all videos on a disc or already embedded
into the curriculum would be extremely helpful to
the teacher who does not have Internet capabilities
or access to specic websites. Although not all
schools or institutions would have the required
technologies available, alternatives for the technology dependent components, including assessment,
activities, and presentations, could be written and
provided in a supplemental lesson to the curriculum. This would give teachers options within these
areas and, if the technology was not available,
provide an essential resource for those teachers.
4.5 Standards
Standards play an important role in any curriculum.
In case of our UTeach Engineering Project, stan-
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
Prescribed
Curriculum
Enacted
Curriculum
Variations
Questioning techniques
Class or group discussions
Engineering Notebook reections
Formal and informal presentations
Personality Test
Personal Experience
Present
Present
Present
Present
Not present
Not present
Present
Present
Not present
Not present
Present
Present
Yes
Yes
Yes
Yes
Yes
Yes
Accuracy Vs Precision
Concept generation
Test bench and helmet design
Research
Video-related activities
Document creation
Introduction to test bench
Design and redesign of test bench
Procedures for test bench
Use of test bench for measurements
Present
Present
Present
Present
Present
Present
Present
Present
Present
Present
Present
Present
Present
Present
Present
Present
Present
Present
Present
Present
Yes
Yes
Yes
Yes
Minimal
Minimal
Minimal
Minimal
Yes
Yes
Technology
Use of devices
Use of software
Use of videos
Present
Present
Present
Present
Present
Present
No
No
Minimal
Standards
Present
Present
Present
Present
Present
Present
Present
Present
Minimal
Minimal
Minimal
Minimal
Strand
Assessment
Activities
Apparatus
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
STEM Integration: A Study examining the enactment of prescribed Research Based Engineering Curriculum
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
5. Discussion
Alignment or tension between the prescribed curriculum and the enacted curriculum is a consistent
challenge in all of curriculum development. Before
moving further into addressing this tension, curriculum developers need to consider two intertwined
aspects of curriculum design process. First, curriculum developers need to address the degree of faculty
involvement in the curriculum development process. In our study, although the teacher played an
active role in the development of the unit, her role
was limited to providing suggestions and recommendations in the development process rather than
co-developing the unit. Our ndings indicated that
the teacher included certain elements in the enacted
curriculum conducive to student learning for that
particular classroom setting. On the other hand,
researchers have indicated that teachers perceptions played an inuential role when teachers developed a unit on their own [35]. This inuence of
teacher perception might lead to prioritization of
dierent elements of curriculum over others, leaving
room for exclusion of critical elements necessary for
coherent STEM integration. Thus, in one sense
there is the expertise and experience of curriculum
developers attempting to create a rich, innovative,
and rewarding experience for students and teachers,
while trying to keep in mind standards, accountability, and content-specic understanding. In
another sense, the expertise of the teacher also
must be acknowledged and appreciated as the
teacher implements a curriculum unit to the class.
Are the students being challenged enough? Too
much? Are the activities engaging? Do they feel up
to the content knowledge required? These are just a
few of the practical issues involved.
The second aspect that curriculum developers
need to consider is to decide whether the curriculum
is designed for direct adoption or provides enough
exibility for adaptation. Curriculum designs are
not self-sucient and often need modications to
acclimatize with the socioeconomic nuances of the
academic environment in which they are being
implemented [36]. In addition, in the case of discovery and inquiry-based learning, teachers often
shape the curriculum continuously during its implementation [37]. A strict, prescribed curriculum, due
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
10
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
the prescribed and enacted curriculum is not possible, if alignment is desired, it will not simply occur
with e-mails or having resources available via the
Internet. A conscious eort and monitoring must
exist to provide timely and important advice and
support in areas where alignment is a challenge.
This iterative process need not be overly intrusive or
paternalistic, but results indicate it does need to be
planned, purposeful, and reective.
6. Conclusion
The emphasis of K-12 engineering as a platform for
attaining STEM teaching and learning objectives
has led to development of engineering based integrated STEM curricula. This study examined how a
prescribed curriculum gets modied when enacted
in an actual classroom setting by a K-12 teacher.
Our ndings indicate the inuence resource constraints, faculty disciplinary background and professional experience on the enactment of prescribed
curriculum. Although our study is limited in terms
of generalizability, the ndings are in line with the
intent of qualitative research which aims for indepth examination and analytical generalization
than replicability of results. Our study provides an
example of how a richer theoretical conceptualization of the curriculum can be developed and how
data can be analyzed when teacher logs are used to
collect data on teaching and curricula implementation. In particular, this paper supports moving
beyond notions of the enacted curriculum as the
overlap between what is taught and what is tested in
order to measure more theoretically relevant aspects
of the curriculum, for example, the ve strands
identied in this study. Future work examining the
enactment of prescribed curriculum will aid in
identifying other aspects of the curriculum that
lead to variations between the two curriculums
and subsequently developing strategies for better
alignment and STEM integration.
AcknowledgmentsThis material is based upon work supported
by the National Science Foundation under Grant No. DRL0833726 and under Grant No. MSP-0831811. The opinions
expressed here are those of the authors alone.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
18.
19.
20.
References
1. W. W. Cooley and G. Leinhardt, The instructional dimensions study, Educational Evaluation and Policy Analysis,
1980. 2(1), pp. 725.
2. A. C. Porter, Measuring the content of instruction: Uses in
research and practice, Educational Researcher, 31(7), 2002,
pp. 314.
3. L. C. Stedman, International achievement dierences: An
assessment of a new perspective, Educational Researcher,
26(3), 1997, pp. 415.
4. National Academy of Engineering, Engineering in K-12
Education: Understanding the Status and Improving the Pro-
21.
22.
23.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
STEM Integration: A Study examining the enactment of prescribed Research Based Engineering Curriculum
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
32.
33.
34.
35.
36.
37.
38.
39.
11
Anthony J. Petrosino is a Learning Scientist and an Associate Professor of Science Technology Engineering and
Mathematics (STEM) Education at The University of Texas at Austin. He is co-founder of the UTeach Natural Sciences
Program. His research is focused on the development of expertise in the STEM disciplines, particularly within engineering.
He is co-PI on the NSF funded project that created the Engineer Your World curriculum. He holds a Masters from
Teachers College, Columbia University and a doctorate from Vanderbilt University.
Katherine A. Gustafson is a mechanical engineer and certied secondary STEM teacher. She holds a M.A. in STEM
Education with a focus on engineering education.
Prateek Shekhar is a PhD candidate in the Department of Mechanical Education at the University of Texas at Austin. His
research is focused on the adoption of research based curriculum and instructional strategies in engineering classrooms. He
holds a M.S. in Electrical Engineering from University of Southern California and B.S. in Electronics and Communication
Engineering from India.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57