Table of Contents
Effectiveness
-
Background
When evaluating the effectiveness of instructional materials, you should consider the following:
-
Utilization of State Reviewed Instructional Materials
Most states don’t know how many districts purchase state reviewed instructional materials. According to the most recent DMAPS survey, two states reported that districts purchase over 76% of state reviewed materials and four states reported that districts purchase between 21% and 75% of state reviewed materials. Six states reported that less than 20% of districts purchase state reviewed materials.
As the shift to digital instructional materials continues, states are eager to learn what materials districts are using. Once states have a better idea about the types of digital instructional materials that districts and schools are using, they can use this information to look at metrics, such as student achievement and student engagement.
Key Questions
- Does your state track the percentage of districts/schools that purchase instructional materials off the state reviewed list?
- Does your state work with vendors to determine how many districts/schools utilize digital applications?
- Does your state collect anecdotal evidence about the effectiveness of state reviewed instructional materials?
-
Educational Goals
When evaluating the effectiveness of instructional materials, you should consider your educational goals for student learning.
Key Questions: Student Success
- Did the instructional material adequately meet the state learning standard for that content area?
- Did the instructional material meet the level of quality required in your district/school?
- Did the instructional material support the learning behaviors your district has defined as important:
- Deeper learning?
- Personalized learning?
- Self-directed learning?
- Did the materials support student learning for all demographics?
- English language learners
- Students with disabilities
- Did the instructional material add value to student learning?
- Did the students customize the materials to enhance their own learning?
- Were the students more engaged?
Guidelines for EdTech Impact Research presents guidelines for conducting and reporting ed-tech research based on the new ESSA rules for evidence about which ed-tech products work in schools.
- Assess student success
- Evaluate teacher effectiveness
-
Student Learning Experiences
See the impacts on student learning experiences with the use quality instructional materials, aligned to standards.
In 2018, the Math Science Technology Magnet Academy at Roosevelt High School located in California received the ESRI Making a Difference Award In 2015, SETDA awarded the program with the Student Voice Award. Through a cross-curricular social justice community research project, students collected and analyzed data using geographic information systems (GIS). Watch this inspirational video now!
-
Success Metrics
When selecting instructional materials, districts should consider how they will evaluate the impact of those materials on student learning. Districts should develop metrics that align to the district/school’s educational goals for success. Assessments should help teachers understand and interpret student performance so they can provide personalized instruction to increase student success.
Administrators should also determine how you will measure the effectiveness of your professional learning strategy with the implementation of instructional materials.
Key Metrics
- Increased student achievement
- Improved student engagement
- Increase in teacher use of instructional materials
- Reduced teacher workload
Key Tools
- State level student testing data on end-of-course exams, proficiency exams, measurements of student progress
- State-developed assessments
- District identified/developed formative or interim assessments
- Instructional materials assessments
- Teacher performance assessments and observations
- Teacher surveys
- Student surveys
-
Navigating the Digital Shift
This report provides details to help educate school and district administrators, policy makers and the private sector on the flexibility of state policies related to the procurement of digital instructional materials.
-
The Hidden Value of Curriculum Reform: Do States and Districts Receive the Most Bang for Their Curriculum Buck?
By Ulrich Boser, Matthew Chingos, and Chelsea Straus October 2015