Over-the-Counter Data (Poster)
University of California, Los Angeles (UCLA) and National Center for Research on Evaluation, Standards, and Student Testing (CRESST) Center for Advanced Technology in Schools (CATS) Conference
April 29-30, 2014
Poster Presentation: http://www.cse.ucla.edu/conference2014/#tuesday
Description: Technology has been integrated into educators’ analyses of student data with the goal of helping educators’ accelerate student learning. However, there is extensive evidence most educators incorrectly interpret student data when using such technology or the reports it generates. Data systems most educators use to analyze student data usually display figures without supporting guidance concerning the data’s proper analysis. This presentation’s researcher explored the potential of embedding data analysis guidance within the data analysis technology, much like over-the-counter medicine is required to embed guidance for the proper use of its contents. In a quantitative study involving 211 educators of varied roles and backgrounds throughout California, the researcher explored the inclusion of such supports in data systems technology. In the study, this data-equivalent to over-the-counter medicine was termed over-the-counter data: essentially, enlisting medical labeling conventions to pair data system reports with straightforward verbiage on the proper interpretation of report contents. Respondents’ data analyses were found to be 307% more accurate when a report footer was present, 205% more accurate when a reference sheet was present, and 273% more accurate when a reference guide was present. These findings and others were significant and can be used to improve data systems technology, which will improve educator data use, which will likely improve student learning.