|
| TABLE OF CONTENTS |
|
|
|
| Test Overview and Design |
|
|
Introduction
|
|
Purpose
|
|
Test Overview
|
|
Purpose and Use
|
|
Test Content, Specifications and Design
|
|
MSA Science Item Types
|
|
MSA Science Operational Test Blueprints
|
|
Table 1. |
Grade 5 MSA Science Standards Assessed |
|
Table 2. |
Grade 8 MSA Science Standards Assessed
|
|
MSA Science 2012 Operational Test Construction
|
|
MSA Science 2012 Field Test Design
|
|
Table 3. |
2012 MSA Science Test Form Design |
|
| Item Development and Review |
|
| Operational Item Analysis and Equating |
|
|
Testing Population
|
|
Table 4. |
Demographic Characteristics of Grade 5 and Grade 8 Sample for Overall, Online, and Paper |
|
|
Distribution of Students Across Forms
|
|
Table 5. |
Distribution of Forms by Grade
|
|
Key Check Analysis of Operational Test Data
|
|
Analysis
|
|
Classical Item Analysis
|
|
IRT Calibration
|
|
Equating
|
|
Table 6. |
Operational Transformation Constants |
|
| Test Analysis, Operational Scaling and Scoring |
|
|
Test Analysis
|
|
Defining Scale Ranges
|
|
Table 7. |
Target LOSS, HOSS, and Scaling Constants for Grades 5 and 8
|
|
ISE Pattern Scoring
|
|
Conditional Standard Errors for LOSS and HOSS
|
|
Test Score Reliability
|
|
Table 8. |
Reliability Estimate by Grade, Form, Gender and Ethnicity |
|
| Student Performance |
|
|
Score Interpretation
|
|
Scale Scores
|
|
Performance Levels and Descriptions
|
|
Table 9. |
Scale Score Cut Scores for Grades 5 and 8 MSA Science |
|
Table 10. |
Grades 5 Performance Level Percentages and Summary Statistics |
|
Table 11. |
Grades 8 Performance Level Percentages and Summary Statistics |
|
| Field Test Item Analysis and Calibration |
|
|
Key Check Analysis of Field Test Data
|
|
Classical Item Analysis
|
|
Field Test Calibration
|
|
Table 12. |
Field Test Transformation Constants |
|
|
Differential Item Functioning (DIF) Analysis
|
|
Table 13. |
DIF Flag Summaries from all MSA Science Field Test Items |
|
|
Data Review of the Field Test Items
|
|
Results of Data Review
|
|
Validity
|
|
Content-Related Evidence
|
|
Differential Item Functioning (DIF)
|
|
Inter-Correlations Among Standards
|
|
Table 15. |
Correlation Among MSA Science Content Standards |
|
|
Confirmatory Factor Analysis
|
|
Table 16. |
Fit Indicators for Confirmatory Factor Analysis on MSA Science |
|
|
Evidence for Scores From Accommodated Testing
|
|
Table 17. |
Fit Indicators for Accommodations/Non-Accommodations Based CFA |
|
|
| References |
|
| Appendices |
|
|
Appendix A |
Item Statistics |
|
Appendix B |
DIF Analysis |
|