Global STEM Projects Evaluation Overview

Evaluation research on the Global STEM project was conducted as a collaboration between the Global STEM project leadership and Davis Square Research Associates (DSRA), a Boston-area research firm with extensive experience in STEM educational innovations (with thanks and credit to Dr. Russell Faux). The first round of data collection took place during 2012-2013 and relied primarily on pre- and post-survey findings to evaluate whether the innovation effectively met its stated objectives. The research model employed was a within-group, change-over-time design, which we believe is appropriate for an innovation at this early phase of development.

The overarching research question DSRA sought to investigate was: What are the effects—cognitive, attitudinal, behavioral, and social—that can reasonably be attributed to participation in the Global STEM project? The sample for the survey data collection included all participants in the Global STEM project. The demographic profile of the survey respondents was somewhat narrow, with 28 of the 30 respondents reporting residency in the USA. 

The methodology involved an extensive online survey designed to measure the constructs embedded in the research question. The survey demonstrated strong reliability, with a Cronbach’s Alpha of 0.93, indicating that the questions targeting the constructs were highly sensitive and appropriate. More information about the evaluation can be found below.