Scoring

Version 1.1

GO Discuss Project. 2021. "Scoring". Qualitative Data Repository. https://doi.org/10.5064/F6NJU10I. GO Discuss. V1

Learn about Data Citation Standards.

Contact Owner

Make Data Count (MDC) Metrics

since 2019-10-01

3,949 Views

1,384 Downloads

1 Citation

Description	Project Overview In this four-year project called Developing Preservice Elementary Teachers' Ability to Facilitate Goal-Oriented Discussions in Science and Mathematics via the Use of Simulated Classroom Interactions (GO Discuss), Educational Testing Service and Mursion developed, piloted, and validated a set of performance-based tasks delivered within a simulated classroom environment in order to improve preservice elementary teachers’ ability to orchestrate discussions. These tasks provided opportunities for preservice teachers in science and mathematics to facilitate discussions with five upper elementary student avatars (fifth grade) where the focus is on disciplinary argumentation within two content domains: fractions (mathematics) and structure/properties of matter (science). The overall goal of this research was to develop a validity basis for the use of such tools as formative assessment tasks that can be integrated within educator preparation programs to increase the amount, variety, and quality of clinical practice opportunities currently available to preservice elementary teachers. We scored the pre-service teachers’ video-recorded performances for the eight tasks in two waves. We scored the formative tasks (M2, M3, M4, S2, S3, and S4) immediately following each data collection and returned written formative feedback to the pre-service teachers within two weeks. For each video-recorded discussion, the formative feedback consisted of general statements and specific feedback about the strengths and areas for growth tied to each indicator in the rubric. The summative scoring (M1 and S1 pre- and post-) discussions were scored at the end of the project. To help reduce rater bias, we coded the videos so that raters could not determine if a video was a pre-service teacher’s pre- or post- video. All summative and formative discussions were scored using the same rubric. This specific data project includes materials for the scoring and development of formative feedback reports of preservice teachers' performances in the simulated classroom. For a complete description of the broader “Go Discuss” project, including a list of files for each task, as well as to read the detailed Terms of Use, please start by reading the Data Overview file. Some files appear in different formats with identical content. This is intentional. ETS wants to encourage adaptation of the deposited materials (which might be easier to implement in Word documents), but also wants to ensure that images and math notations are rendered correctly for secondary users (best preserved in PDF).
Subject	Other
Keyword	argumentation, discussion, mathematics methods, science methods, formative assessment, performance-based assessment, simulated classrooms, teacher education, education, educational assessment, teacher education, teacher preparation
Related Publication	Howell, H., Mikeska, J. N., (2021). Approximations of practice as a framework for understanding the role of authenticity in simulations of teaching. Journal of Research on Technology in Education. https://doi.org/10.1080/15391523.2020.1809033
License/Data Use Agreement	Standard Access

Change View

Table

Tree

Filter by

	1 to 10 of 98 Files	Original Format Archival Format (.tab) Request Access
	00.01 Scoring Master Files and Abbreviations Log.xlsx MS Excel Spreadsheet - 19.0 KB Published Mar 17, 2021 43 Downloads SHA512: 869951f0328aab38476f73de955182f0e058dcb3850d254d53b7d43d94876d351f7e43c4e56da15e088f4b720c0294399932fc8a0854178a351ac2660df5c0a2 Tabular Data: 5 Variables, 118 Observations UNF:6:QFgg56oh3bIAjTIRuJK6bg== Documentation	Preview "00.01 Scoring Master Files and Abbreviations Log.tab" Access File File Access Public Download Options MS Excel Spreadsheet (Original File Format) Tab-Delimited RData Download Metadata Variable Metadata Data File Citation EndNote XML RIS BibTeX
	Go_Discuss_Data_Overview.docx - 666.4 KB Published Mar 17, 2021 40 Downloads SHA512: 350878bc7019d650b9d05a1c526904b3f19757975d5c991aee65a13c1437bac5b2114e64b30ff69182c21100baef3f1dac3cec35d9352fd06b6884982c692b93 Documentation	Access File File Access Public Download Options MS Word Download Metadata Data File Citation EndNote XML RIS BibTeX
	Go_Discuss_Permission_Letter.docx - 183.6 KB Published Mar 17, 2021 24 Downloads SHA512: 9bdd34c1b5223e8e7e89686ddca461eef1a19ccb34a218e4b6d7dfe32780fb1ceafa043264d07d3d0717b94882191e9f87da7fee6ef7bb8e81449904e0e3ad49 Documentation	Access File File Access Public Download Options MS Word Download Metadata Data File Citation EndNote XML RIS BibTeX
	README_Howell_Scoring.txt - 7.0 KB Published Mar 17, 2021 32 Downloads SHA512: 43da0f53e6cead813d14544462eceedcac84bfc180502f636afb20eeb8a5d4cb9dbded6374a93da925ca4068216a9f691dc8318004db85a3725cc2bfbadcb091 Documentation	Preview "README_Howell_Scoring.txt" Access File File Access Public Download Options Plain Text Download Metadata Data File Citation EndNote XML RIS BibTeX
	01.01 Scoring Rubric.pdf General Scoring Files/ - 322.4 KB Published Mar 17, 2021 27 Downloads SHA512: bfe062b1256a13133d7eb1a835ad2f4a9a262244c9ebb924ef3d03f85b470a0b09379cf37fad25389fef70d060aa2ca3b4fff6abf73c4012778ff4bdf6814b70 Scoring Rubric - PDF	Access File File Access Restricted Request Access Download Metadata Data File Citation EndNote XML RIS BibTeX
	01.02 One Page Scoring Rubric.docx General Scoring Files/ - 58.7 KB Published Mar 17, 2021 13 Downloads SHA512: 2766dc651428cf0908cb637f335c47390deff623632a1f37e10553501d8cef3d9290938b589646ead30b13da9fdac1669a8d9479edba4c406392f7979f444ef6 One Page Scoring Rubric	Access File File Access Restricted Request Access Download Metadata Data File Citation EndNote XML RIS BibTeX
	01.03 One Page Scoring Rubric.pdf General Scoring Files/ - 119.6 KB Published Mar 17, 2021 17 Downloads SHA512: 0545f4133342e589b60dc2d5e5db26f531da863205bc93b58af805c5472b80487a24d3d1c894c6070575c23cab20532c099f8ab6982ad2d203426ec649d6b447 One Page Scoring Rubric - PDF	Access File File Access Restricted Request Access Download Metadata Data File Citation EndNote XML RIS BibTeX
	01.04 Form Feed Guidebook.docx General Scoring Files/ - 47.1 KB Published Mar 17, 2021 13 Downloads SHA512: ed2b07ed646123b44d7f2a7317dbde44bec2e9cc6c34f980b85028ca8c87151a4060c8dfc8bc207647fbb0d1e17a1674ab130efc917f156ca00634fad6c7dc3f Formative feedback guidebook	Access File File Access Restricted Request Access Download Metadata Data File Citation EndNote XML RIS BibTeX
	01.05 FFS Sent Starters.docx General Scoring Files/ - 99.0 KB Published Mar 17, 2021 13 Downloads SHA512: 08f4f4be570b6dae635608b2916eb93d455a7029748e9e073fe0f755c6f26f493a425bc6c696d482dcd0a263a1b85dc33bf94fd21ab5f3ecaf897119df58d9c3 Specific formative feedback statement sentence starters	Access File File Access Restricted Request Access Download Metadata Data File Citation EndNote XML RIS BibTeX
	01.06 PST Form Feed Temp.docx General Scoring Files/ - 66.5 KB Published Mar 17, 2021 13 Downloads SHA512: 6fcd6dc4aa60c4a64e4839b1e81f87795261092711d7cea8ce6cfda8a57514392bbe37d2e590b12bef60ee56e7b6b5259d2fbfec29e48508e89a2d640bc7918b Pre-service teacher formative feedback report template	Access File File Access Restricted Request Access Download Metadata Data File Citation EndNote XML RIS BibTeX

Data Project Persistent Identifier	doi:10.5064/F6NJU10I
Publication Date	2021-03-17
Title	Scoring
Creator	GO Discuss Project(Educational Testing Service)Educational Testing Service
Point of Contact	Use the Contact button at the top right to email this Data Project's contact. Howell, Heather (Educational Testing Service) Mikeska, Jamie (Educational Testing Service)
Description	Project Overview In this four-year project called Developing Preservice Elementary Teachers' Ability to Facilitate Goal-Oriented Discussions in Science and Mathematics via the Use of Simulated Classroom Interactions (GO Discuss), Educational Testing Service and Mursion developed, piloted, and validated a set of performance-based tasks delivered within a simulated classroom environment in order to improve preservice elementary teachers’ ability to orchestrate discussions. These tasks provided opportunities for preservice teachers in science and mathematics to facilitate discussions with five upper elementary student avatars (fifth grade) where the focus is on disciplinary argumentation within two content domains: fractions (mathematics) and structure/properties of matter (science). The overall goal of this research was to develop a validity basis for the use of such tools as formative assessment tasks that can be integrated within educator preparation programs to increase the amount, variety, and quality of clinical practice opportunities currently available to preservice elementary teachers. We scored the pre-service teachers’ video-recorded performances for the eight tasks in two waves. We scored the formative tasks (M2, M3, M4, S2, S3, and S4) immediately following each data collection and returned written formative feedback to the pre-service teachers within two weeks. For each video-recorded discussion, the formative feedback consisted of general statements and specific feedback about the strengths and areas for growth tied to each indicator in the rubric. The summative scoring (M1 and S1 pre- and post-) discussions were scored at the end of the project. To help reduce rater bias, we coded the videos so that raters could not determine if a video was a pre-service teacher’s pre- or post- video. All summative and formative discussions were scored using the same rubric. This specific data project includes materials for the scoring and development of formative feedback reports of preservice teachers' performances in the simulated classroom. For a complete description of the broader “Go Discuss” project, including a list of files for each task, as well as to read the detailed Terms of Use, please start by reading the Data Overview file. Some files appear in different formats with identical content. This is intentional. ETS wants to encourage adaptation of the deposited materials (which might be easier to implement in Word documents), but also wants to ensure that images and math notations are rendered correctly for secondary users (best preserved in PDF).
Subject	Other
Keywords	argumentation discussion mathematics methods science methods formative assessment performance-based assessment simulated classrooms teacher education (ICPSR Subject Thesaurus) https://www.icpsr.umich.edu/icpsrweb/ICPSR/thesaurus/index education (ICPSR Subject Thesaurus) https://www.icpsr.umich.edu/icpsrweb/ICPSR/thesaurus/index educational assessment (ICPSR Subject Thesaurus) https://www.icpsr.umich.edu/icpsrweb/ICPSR/thesaurus/index teacher education (ICPSR Subject Thesaurus) https://www.icpsr.umich.edu/icpsrweb/ICPSR/thesaurus/index teacher preparation
Time Period	Start Date: 2016 ; End Date: 2020
Type of Data Project	field notes; videos; pedagogical materials
Geographic Coverage	United States
Related Publication	Howell, H., Mikeska, J. N., (2021). Approximations of practice as a framework for understanding the role of authenticity in simulations of teaching. Journal of Research on Technology in Education. doi: https://doi.org/10.1080/15391523.2020.1809033 Mikeska, J. N., & Howell, H. (2020). Simulations as practice‐based spaces to support elementary teachers in learning how to facilitate argumentation‐focused science discussions. Journal of Research in Science Teaching Special Issue: Science Teaching, Learning, and Assessment with 21st Century, Cutting Edge Digital Ecologies, 57, 1356-1399. doi: doi 10.1002/tea.21659 https://doi.org/10.1002/tea.21659 Mikeska, J.N., Howell, H., & Straub, C. (2019). Using performance tasks within simulated environments to assess teachers’ ability to engage in coordinated, accumulated, and dynamic (CAD) competencies. International Journal of Testing, 19, 128-147. doi: 10.1080/15305058.2018.1551223 https://doi.org/10.1080/15305058.2018.1551223 Howell, H., & Mikeska, J.N. (2020, May 5-12). Simulated classrooms as practice-based learning spaces [Video presentation]. 2020 NSF STEM for All Video Showcase. https://stemforall2020.videohall.com/presentations/1780 Mikeska, J.N., & Howell, H. (2019, May 13-20). Simulated classrooms as practice-based learning spaces [Video presentation]. 2019 NSF STEM for All Video Showcase. https://stemforall2019.videohall.com/presentations/1495 Howell, H. & Mikeska, J.N. (2018, May 14-21). Leading science/math discussions in a simulated classroom [Video presentation]. 2018 NSF STEM for All Video Showcase. http://stemforall2018.videohall.com/presentations/1073 Mikeska, J.N. & Howell, H. (2017, May 15-22). Simulated classroom environments for facilitating math and science discussions [Video presentation]. 2017 NSF STEM for All Video Showcase. http://stemforall2017.videohall.com/presentations/934
Language	English
Funding Information	National Science FoundationNational Science Foundation: 1621344
Related Data Project	There are 10 data projects within the GO Discuss collection: one for each of four elementary mathematics tasks, one for each of four elementary science tasks, one for non-task specific simulation specialist training, and one for the scoring of pre-service teacher performances in the simulated classroom. We recommend reading the GO Discuss QDR data overview file for an overview of the overall research project and its goals, a description of the specific materials we developed and how we used them on this research project, and an explanation of the ways in which you can use, adapt, and cite these materials in your own work. Part of the purpose is also to assist you in locating and making sense of the set of files provided. There are summary charts listing the documents and their purposes in the appendices for easy reference.
Distributor	Qualitative Data Repository (Syracuse University) (QDR) https://qdr.syr.edu
Distribution Date	2021-03-16
Depositor	Lentini, Jennifer
Deposit Date	2021-02-22

Data Project Terms

License/Data Use Agreement

Our Community Norms as well as good scientific practices expect that proper credit is given via citation. Please use the data citation shown on the data project page.

QDR Standard Access Conditions Standard Access

Restricted Files + Terms of Access

Restricted Files

There are 94 restricted files in this data project.

Terms of Access for Restricted Files

All materials other than documentation remain copyrighted to Educational Testing Service © 2020, with educational use, research use (with explicit additional citation as listed on pages 5-6 of the project's Data Overview), and limited commercial uses, as described in the same document, explicitly allowed. Questions about other uses, adaptation, attribution, or requests for exceptions should be directed to the principal investigators, Jamie Mikeska (jmikeska@ets.org) and Heather Howell (hhowell@ets.org).

Request Access

Users may request access to files.

Data Project Version	Summary	Version Note	Contributors	Published on
No records found.

Edit File

This file has already been deleted (or replaced) in the current version. It may not be edited.

Restrict Access

Restricting limits access to published files. People who want to use the restricted files can request access by default. If you disable request access, you must add information about access to the Terms of Access field.

Learn about restricting files and dataset access in the User Guide.

Request Access

Enable access request

You must enable request access or add terms of access to restrict file access.

Terms of Access for Restricted Files

Save Changes

Edit Embargo

The selected file or files have already been published. Contact an administrator to change the embargo date or reason of the file or files.

Edit Retention Period

The selected file or files have already been published. Contact an administrator to change the retention period date or reason of the file or files.

Delete Files

The file will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the data project.

Select File(s)

Please select one or more files.

Share Data Project

Share this data project on your favorite social media networks.

Continue

Data Project Citations

Citations for this data project are retrieved from Crossref via DataCite using Make Data Count standards. For more information about data project metrics, please refer to the User Guide.

https://doi.org/10.1145/3576050.3576067

Inaccessible Files Selected

The selected file(s) may not be downloaded because you have not been granted access or the file(s) have a retention period that has expired or the files can only be transferred via Globus.

You may request access to any restricted file(s) by clicking the Request Access button.

Ineligible Files Selected

The selected file(s) may not be transferred because you have not been granted access or the file(s) have a retention period that has expired or the files are not Globus accessible.

You may request access to any restricted file(s) by clicking the Request Access button.

Download Options

The files selected are too large to download as a ZIP.

You can select individual files that are below the 18.6 GB download limit from the files table, or use the Data Access API for programmatic access to the files.

Select File(s)

Please select a file or files to be downloaded.

Inaccessible Files Selected

The selected file(s) may not be downloaded because you have not been granted access or the file(s) have a retention period that has expired.

Click Continue to download the files you have access to download.

Ineligible Files Selected

Some file(s) cannot be transferred. (They are restricted, embargoed, with an expired retention period, or not Globus accessible.)

Click Continue to transfer the elligible files.

Delete Data Project

Are you sure you want to delete this data project and all of its files? You cannot undelete this data project.

Delete Draft Version

Are you sure you want to delete this draft version? Files will be reverted to the most recently published version. You cannot undelete this draft.

Unpublished Data Project Private URL

Private URL can only be used with unpublished versions of data projects.

Unpublished Data Project Private URL

Are you sure you want to disable the Private URL? If you have shared the Private URL with others they will no longer be able to use it to access your unpublished data project.

Delete Files

The file(s) will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the data project.

Compute

This data project contains restricted files you may not compute on because you have not been granted access.

Deaccession Data Project

Are you sure you want to deaccession? This is permanent and the selected version(s) will no longer be viewable by the public.

Deaccession Data Project

Are you sure you want to deaccession this data project? This is permanent and it will no longer be viewable by the public.

Version Differences Details

Please select two versions to view the differences.

Version Differences Details

Version:
Last Updated:

Select File(s)

Please select a file or files for access request.

Select File(s)

Embargoed files cannot be accessed. Please select an unembargoed file or files for your access request.

Edit Tags

Select existing file tags or create new tags to describe your files. Each file can have more than one tag.

Request Access

You need to Register or Log In to request access.

Data Project Terms

Please confirm and/or complete the information needed below in order to request access to files in this data project.

This data project is made available under the following terms. Please confirm and/or complete the information needed below in order to continue.

License/Data Use Agreement

Our Community Norms as well as good scientific practices expect that proper credit is given via citation. Please use the data citation shown on the data project page.

QDR Standard Access Conditions Standard Access

Name

Institution

Position

Preview Guestbook

Upon downloading files the guestbook asks for the following information.

Guestbook Name

Collected Data

Account Information

Package File Download

Use the Download URL in a Wget command or a download manager to download this package file. Download via web browser is not recommended. User Guide - Downloading a Dataverse Package via URL

Download URL

https://data.qdr.syr.edu/api/access/datafile/

Compute Batch

Clear Batch

Data Project	Data Project Persistent Identifier	Change Compute Batch

Compute Batch

Submit for Review

You will not be able to make changes to this data project while it is in review.

Publish Data Project

Are you sure you want to republish this data project?

Select if this is a minor or major version update.

Minor Release (1.2)

Major Release (2.0)

Version Note

Publish Data Project

This data project cannot be published until GO Discuss is published by its administrator.

Publish Data Project

This data project cannot be published until GO Discuss and Educational Testing Service (ETS) are published.

Return to Author

Return this data project to contributor for modification. The reason for return entered below will be sent by email to the author.

Add/Edit a Version Note

Enter the reason this version was created. To learn more about Version Notes, visit the Version Notes section of the User Guide.

Version Note

Scoring

Project Overview