- - - - - - - - - - - - - - - - - - - - - -
 Divisions
  Overview
  Academic Policy & Innovation
  Accountability, Assessment, and Data Systems
     2003-2004 Alternate Maryland School Assessment
     2012 HSA and Mod-HSA Technical Report
     HSA Technical Reports
     Maryland Standard Setting Technical Reports
     Modified HSA Technical Reports
     MSA Science Technical Reports
     MSA Technical Reports
     Staff and Student Publications
     State Test Administration and Security Committee Fact Sheet
  Career and College Readiness
  Communications, Partnerships, and Grants
  Curriculum, Assessment & Accountability
  Educator Effectiveness
  Early Childhood Development
  Finance
  Information Technology
  Library Services
  Office of the State Superintendent
  Rehabilitation Services
  Special Education and Early Intervention
  Student, Family, and School Support
Divisions
Divisions > Accountability, Assessment, and Data Systems
2012 MSA Science Technical Report

Maryland School Assessment (MSA)
Science
Grades 5 and 8

Technical Report: 2012 Administration



TABLE OF CONTENTS

Test Overview and Design

Introduction

Purpose

Test Overview

Purpose and Use

Test Content, Specifications and Design

MSA Science Item Types

MSA Science Operational Test Blueprints
Table 1. Grade 5 MSA Science Standards Assessed
Table 2. Grade 8 MSA Science Standards Assessed

MSA Science 2012 Operational Test Construction

MSA Science 2012 Field Test Design
Table 3. 2012 MSA Science Test Form Design

Item Development and Review

Operational Item Analysis and Equating


Testing Population
Table 4. Demographic Characteristics of Grade 5 and Grade 8 Sample for Overall, Online, and Paper


Distribution of Students Across Forms
Table 5. Distribution of Forms by Grade

Key Check Analysis of Operational Test Data

Analysis

Classical Item Analysis

IRT Calibration

Equating
Table 6. Operational Transformation Constants

Test Analysis, Operational Scaling and Scoring

Test Analysis

Defining Scale Ranges
Table 7. Target LOSS, HOSS, and Scaling Constants for Grades 5 and 8

ISE Pattern Scoring

Conditional Standard Errors for LOSS and HOSS

Test Score Reliability
Table 8. Reliability Estimate by Grade, Form, Gender and Ethnicity

Student Performance

Score Interpretation

Scale Scores

Performance Levels and Descriptions
Table 9. Scale Score Cut Scores for Grades 5 and 8 MSA Science
Table 10. Grades 5 Performance Level Percentages and Summary Statistics

Table 11. Grades 8 Performance Level Percentages and Summary Statistics

Field Test Item Analysis and Calibration

Key Check Analysis of Field Test Data

Classical Item Analysis

Field Test Calibration
Table 12. Field Test Transformation Constants

Differential Item Functioning (DIF) Analysis
Table 13. DIF Flag Summaries from all MSA Science Field Test Items

Data Review of the Field Test Items

Results of Data Review

Validity

Content-Related Evidence

Differential Item Functioning (DIF)

Inter-Correlations Among Standards
Table 15. Correlation Among MSA Science Content Standards

Confirmatory Factor Analysis
Table 16. Fit Indicators for Confirmatory Factor Analysis on MSA Science

Evidence for Scores From Accommodated Testing
Table 17. Fit Indicators for Accommodations/Non-Accommodations Based CFA


References

Appendices

Appendix A Item Statistics
Appendix B DIF Analysis

A complete copy of the 2012 MSA Science Technical Report is also available.

Contact Information
Carolyn Wood, Assistant State Superintendent
Division of Accountability, Assessment, and Data Systems
Maryland State Department of Education
200 West Baltimore Street
Baltimore, MD 21201
Maryland State Department of Education
200 West Baltimore Street
Baltimore, MD 21201
MSDE Privacy Statement Disclaimer  | Copyright © 2003 MSDE