|
| TABLE OF CONTENTS |
|
|
|
| Test Overview and Design |
|
|
Introduction
|
|
Purpose
|
|
Test Overview
|
|
Purpose and Use
|
|
Test Content, Specifications and Design
|
|
Table 1. |
Grade 5 MSA Science Standards Assessed |
|
Table 2. |
Grade 8 MSA Science Standards Assessed
|
|
MSA Science 2008 Field Test Design
|
|
Item Development and Review
|
|
Item Development
|
|
| Calibration and Equating |
|
|
MSA Science Linking, Calibration and Equating
|
|
Analysis of Operational Test Data
|
|
Testing Population
|
|
Table 3. |
Demographic Characteristics of Grade 5 and Grade 8 Sample for Overall, Online, and Paper
|
|
Distribution of Students Across Forms
|
|
Table 4. |
Distribution of Forms by Grade
|
|
Analysis
|
|
Classical Item Analysis
|
|
Differential Item Functioning (DIF) Analyses
|
|
Table 5. |
DIF Flag Incidence Across All MSA Science Field-Test Items
|
|
Test Score Reliability
|
|
Table 6. |
Reliability Estimate by Form
|
|
IRT Analysis
|
|
Iteam Calibration and Equating
|
|
Table 7. |
Equating Constants for Operational and Field Test
|
|
Data Review of the Field Test Items
|
|
Results of Data Review
|
|
| Test Analysis, Operational Scaling and Scoring |
|
|
Test Analysis
|
|
Defining Scale Ranges
|
|
Table 8. |
Target LOSS, HOSS, and Scaling Constants for Grades 5 and 8
|
|
ISE Pattern Scoring
|
| Student Performance |
|
|
Score Interpretation
|
|
Scale Scores
|
|
Performance Levels and Descriptions
|
|
Table 9. |
Scale Score Cut Scores for Grades 5 and 8 MSA Science |
|
Table 10. |
Grade 5 Performance Level Percentages and Descriptive Statistics |
|
Table 11. |
Grade 8 Performance Level Percentages and Simple Statistics
|
|
Validity
|
|
Content-Related Validity
|
|
Construct-Related Validity
|
|
Item-Total Correlation
|
|
Table 12. |
Summary of Adjusted Point-Biserial |
|
|
Inter-Correlations Among Standards
|
|
Table 13. |
Correlation Among MSA Science Content Standards |
|
|
Unidimensionality
|
|
Confirmatory Factor Analysis
|
|
Table 14. |
Fit Indicators for Confirmatory Factor Analysis on MSA Science |
|
|
Validity Evidence for Scores from Accommodated Testing
|
|
Table 15. |
Fit Indicators for Accommodations/Non-Accommodations Based CFA |
|
|
Validity Evidence for Different Populations
|
|
| References |
|
| Appendices |
|
|
Appendix A |
Item Statistics |
|
Appendix B |
DIF Analysis |
|