A Content Analysis of How Engineering is Assessed in Published Curricula (Fundamental)
The purpose of this proposal is to present research findings concerning how and what about engineering is commonly assessed in well-known engineering or integrated STEM published curriculum. Two of the major shifts brought about by Next Generation Science Standards (NGSS) are an increased emphasis in students’ capabilities to perform higher-level reasoning skills and integrate content understanding into science practices. At the same time, NGSS has made engineering integration into science education a priority, and it is an exciting time of reform as schools are exploring curriculum resources and teachers are being trained in engineering design. When engineering is a part of science instruction, there must also be corresponding measurement of student learning, yet many teachers who are new to engineering are also unfamiliar with the process of assessing design practices. In addition, teachers must grapple with how to assess higher order skills, including how students use science to make design decisions. Evidence of higher levels of learning beyond memorizing content or identifying facts is the goal of engineering assessment, and NGSS provides general patterns of thought and behavior that students may exhibit at each grade level related to defining problems, developing solutions, and optimizing results which demonstrate learning. However, these guidelines are very broad and do not clearly recommend ways to go about assessing these practices in the classroom. It is imperative that teachers are provided with the means to properly assess student learning of both content and engineering practices.
As part of a larger goal of developing an integrated STEM curriculum for grades 4 – 8, this content analysis addresses the need for questioning how engineering is commonly assessed in elementary engineering or integrated STEM curricula. By examining current STEM assessments with two frameworks, this study investigates the following research questions: (1) What aspects of engineering are being assessed in common engineering or integrated STEM curricular units? (2) What level of cognitive demand is being referenced by these assessments? Using a purposeful sampling strategy, the authors reviewed 15 engineering curricula units published by 3 different publishing companies. To address the research questions, assessment tasks were coded based on the Task Analysis Guide in Science (TAGS) framework and alignment to the engineering process of design (POD). Preliminary results show that the majority of integrated STEM assessment items are testing students on memorized engineering practice, and very few are referencing higher levels of cognitive demand. These results indicate that the more complex thinking that students use during engineering classroom learning is being overlooked by subsequent assessment. In addition, a large proportion of assessment items are dedicated to learning background information about the problem and planning solution ideas, compared with other steps in the design process. The full paper will discuss conclusions and implications of the study.
Engineering Education, Content analysis, Engineering assessment, STEM, STEM curricula, Next generation science standards
Date of this Version
Douglas, K. A., & Moore, T. J., & Merzdorf, H. E., & Li, T., & Johnston, A. C. (2017, June), A Content Analysis of How Engineering is Assessed in Published Curricula Paper presented at 2017 ASEE Annual Conference & Exposition, Columbus, Ohio. https://peer.asee.org/27459