California Department of Education Executive Office SBE-003 (REV. 09/2011) dsib-adad-jan15item02 ITEM # 01 CALIFORNIA STATE BOARD OF EDUCATION JANUARY 2015 AGENDA SUBJECT California Assessment of Student Performance and Progress: Update on Program Activities, including National Center and State Collaborative Phase II Pilot; Alternate Field Test; Technology Update; Smarter Balanced Updates on the Digital Library of Formative Assessment Resources, Interim Assessments, Achievement Level Setting, and Reporting for 2014–15 California Assessment of Student Performance and Progress Results. Action Information Public Hearing SUMMARY OF THE ISSUE(S) This item reflects the collaboration of the Assessment Development and Administration Division (ADAD), the Educational Data Management Division (EDMD), and the Special Education Division (SED) of the California Department of Education (CDE). California Assessment of Student Performance and Progress The California Assessment of Student Performance and Progress (CAASPP) System includes Smarter Balanced computer-based assessments that are aligned with the Common Core State Standards (CCSS), specified state-developed paper-pencil assessments that were previously administered through the Standardized Testing and Reporting (STAR) Program, and new assessments to be recommended by the CDE with stakeholder input and approved by the State Board of Education (SBE). This item provides an update on the following topics: (1) the status of the National Center and State Collaborative (NCSC) Phase II Pilot and the development of an alternate field test for spring 2015; (2) technology update, including the status of the Broadband Infrastructure Improvement Grant (BIIG) to support technology infrastructure; and (3) the status and progress of Smarter Balanced activities. Within the Smarter Balanced update, the item covers the progress of the Smarter Balanced Digital Library of Formative Assessment Resources (Digital Library), interim assessments, the setting of achievement levels, and the reporting of 2014–15 Smarter Balanced summative assessment results under the CAASPP System. 1/15/2015 1:45 AM NCSC Phase II Pilot The NCSC conducted the Phase II Pilot between October 20 and November 21, 2014. The pilot window was extended for one additional week to capture more item data in reading, writing, and mathematics across grades three through eight, and grade eleven. The CDE sent an e-mail communication to the field to notify local educational agencies (LEAs) of the test window extension. The NCSC consortium had a total of 6,313 students who submitted test forms. Of these, 1,533 students were from California. California students made up 24 percent of the total students tested during the Phase II Pilot, which was the largest number of students from any participating state to submit test forms. Technical reports for the Phase I and Phase II Pilot and operational administration will be available in the fall of 2015, at the close of the NCSC grant. Spring 2015 Alternate Field Test in English Language-Arts (ELA) and Mathematics Item development continues for the spring 2015 alternate assessment field test. In fall 2014, the CAASPP contractor, Educational Testing Service (ETS), conducted a focus group of educators to gather information regarding types of items for the alternate assessment. Teachers with expertise in working with students with disabilities participated in a two-day training on item writing for ELA and mathematics before beginning the item writing process. Two item reviews are scheduled in December 2014 and February 2015. The test administration manual and a training Webcast are scheduled to be released in early March 2015. Technology Update The BIIG Request for Proposals (RFP) from technology service providers closed December 8, 2014. The K–12 High Speed Network (K12HSN), in cooperation with the Corporation for Education Network Initiatives in California (CENIC), performed a review of the proposals to determine the technology service providers’ responsiveness to the RFP. A subsequent Technical Peer Review comprised of representatives from the 11 California County Superintendents Educational Services Association regions took place on December 16, 2015. The selection of sites funded is expected to occur in early January 2015. An oral update on BIIG, including the total number of schools funded, will be provided at the January 2015 SBE meeting. A survey of a stratified random sample of schools for the Statewide Network Connectivity Report concluded in early December 2014. Pursuant to a provision in the 2014–15 Budget Act, the school-site connectivity data are being analyzed for the Report, which is due to the Department of Finance (DOF), Legislative Analyst’s Office, and the Legislature by March 1, 2015. General information about the BIIG and the Statewide Network Connectivity Report are available on the K12HSN Senate Bill 852 Web Page at http://www.k12hsn.org/sb852/. Smarter Balanced Update 1/15/2015 1:45 AM The Digital Library The Smarter Balanced Digital Library is an online warehouse that includes tools and resources designed to support teachers in the use of classroom-based formative assessment practices. The initial enrollment of 63,000 teachers for the preview period has grown to over 155,000 educators from 4,980 school sites. The Digital Library contains over 2,500 resources for consortium teachers, kindergarten through grade twelve (K−12). Since the November 2014 SBE meeting, CDE staff have identified LEAs that have not registered school sites or users, and has provided this information to ETS to conduct a call campaign to the identified LEAs. CDE staff is working with Smarter Balanced to develop a presentation that includes released Digital Library resources. An oral update will be provided regarding the status of educator enrollments, resources, and the release of sample resources. Interim Assessments The Smarter Balanced Interim Assessments allow teachers to check student progress throughout the year, giving them actionable information to inform instruction and help students meet the challenge of college-and-career-ready standards. There are two types of interim assessments: the interim comprehensive assessments (ICAs) which are full assessments based on the same blueprints as the summative assessments, and the interim assessment blocks (IABs) which assess smaller sets of skills. More information about the interim assessments can be found at the Smarter Balanced Interim Assessments Web page at http://www.smarterbalanced.org/interim-assessments/. The ICAs are expected to be released on January 15, 2015 with the IABs to be released on January 27, 2015. LEAs are encouraged to use the interim assessments as a resource for professional development during the 2014–15 school year. Reporting results for the ICA will be consistent with the summative assessment providing an overall scale score, achievement level, and a claim score per content area/subject (e.g., reading, writing, or problem solving). A claim score provides additional information about student achievement at a more refined level. Claim score reporting will consist of three classifications: above standard, at or near standard, and below standard. Specific information regarding claims can be found in the following Web documents for ELA and mathematics Smarter-Balanced-Mathematics-Claims http://www.smarterbalanced.org/wordpress/wp-content/uploads/2012/09/SmarterBalanced-Mathematics-Claims.pdf and Smarter-Balanced-ELA-Literacy-Claims http://www.smarterbalanced.org/wordpress/wp-content/uploads/2012/09/SmarterBalanced-ELA-Literacy-Claims.pdf. Smarter Balanced Achievement Level Setting California and other member states of the Smarter Balanced Assessment Consortium voted to approve achievement levels for the ELA/Literacy and mathematics assessments that will be administered as part of the CAASPP System. The achievement levels serve as a starting point for discussion about the performance of individual students and groups of students in ELA/literacy and mathematics. There are other measures that students, teachers, and parents can also use to help evaluate the academic progress of students and schools. Information about the achievement levels 1/15/2015 1:45 AM can be found on the Smarter Balanced Assessment Consortium Achievement Levels Web page at http://www.smarterbalanced.org/achievement-levels/. The Smarter Balanced member states also unanimously approved a position paper “Interpretation and Use of Scores and Achievement Levels” also located on the Smarter Balanced Assessment Consortium Achievement Levels Web page at http://www.smarterbalanced.org/achievement-levels/. This paper provides broad guidelines about scores and achievement levels and how they may be interpreted by state officials, parents, teachers, and other stakeholders. Finally, Smarter Balanced developed a video that explains the achievement level setting process and state members’ perspectives. This video is also available on the Smarter Balanced Assessment Consortium Achievement Levels Web page at http://www.smarterbalanced.org/achievement-levels/. Reporting for 2014–15 CAASPP Results For the Smarter Balanced summative assessments, individual student results for mathematics and ELA will be reported as overall scale scores, performance levels, and as performance at the claim level. A student’s test results for a content area may be viewed by the LEA electronically within four weeks of a student completing testing in the content area through the CAASPP contractor’s Test Operations and Management System as well as from the Smarter Balanced online reporting system. Because California has mandated reporting requirements that are not provided in the Smarter Balanced online reporting system, LEAs will have access to both reporting sites. Additionally, the current CAASPP contractor will provide paper Individual Student Reports (ISRs) which will include test results for all Smarter Balanced and non-Smarter Balanced assessments (i.e., science). LEAs will receive paper versions of the ISRs within eight weeks. Parents can expect to receive the paper ISR from their student’s LEA within 20 business days of the LEAs receipt of the ISRs. RECOMMENDATION The CDE recommends that the SBE take action as deemed necessary and appropriate. No specific action is recommended at this time. BRIEF HISTORY OF KEY ISSUES California Assessment of Student Performance and Progress Per California Education Code (EC) Section 60640, the CAASPP System succeeded the STAR Program on January 1, 2014. The new statewide assessment system has been designed to support the full implementation of the CCSS. In November, the SBE approved the CDE’s recommendation for full implementation of the technology-enabled assessment system and the Smarter Balanced operational assessments in 2014–15. Also approved was the recommendation to use the Smarter 1/15/2015 1:45 AM Balanced assessment development and implementation process as a model for the alternate assessments aligned to the CCSS. SUMMARY OF PREVIOUS STATE BOARD OF EDUCATION DISCUSSION AND ACTION In November 2014, the CDE provided the SBE with an update on CAASPP activities, including Smarter Balanced, Achievement Level Setting, Technology, Science Assessment, Grade Two Diagnostic Assessments, and Alternate Field Test development, including the NCSC assessment activities. (http://www.cde.ca.gov/be/ag/ag/yr14/documents/nov14item02a2.pdf) In November 2014, the SBE approved the CDE’s recommendations for the full implementation of a technology-enabled assessment system and the administration of the Smarter Balanced summative assessments in 2014–15. (http://www.cde.ca.gov/be/ag/ag/yr14/documents/nov14item03.doc) In September 2014, the CDE provided the SBE with an update on CAASPP activities, including the Smarter Balanced Field Test administration, focus groups, and post-test survey; science assessment stakeholder meetings; and alternate assessment activities. (http://www.cde.ca.gov/be/ag/ag/yr14/documents/sep14item03.doc ) In July 2014, the CDE provided the SBE with an update on CAASPP activities; details of the Smarter Balanced Field Test; results of the mid-test survey, planning of the post-test survey; and focus group meetings, and future outreach activities for the 2015 Smarter Balanced operational assessments. (http://www.cde.ca.gov/be/ag/ag/yr14/documents/jul14item22.doc) In July 2014, the SBE approved Amendment #12 to the current CAASPP contract with Educational Testing Service (ETS) and directed CDE and SBE staff to work with ETS in the modification of the scope of work, timeline, and budget for the 2014–15 administration of the CAASPP System. The previous contract end date was December 31, 2014 for the completion of the 2013–14 test administration. Amendment 12 added overlapping scope of work tasks, increased the budget, and extended the contract end date to December 31, 2015. (http://www.cde.ca.gov/be/ag/ag/yr14/documents/jul14item05.doc) FISCAL ANALYSIS (AS APPROPRIATE) The NCSC Phase II Pilot is funded by NCSC. A total of $26,689,000 in one-time funding was provided in the 2014–15 Budget Act to support the BIIG. 1/15/2015 1:45 AM The 2014–15 Budget Act includes a total of $89,081,000 for contracts related to the CAASPP System as approved by the SBE and contingent upon DOF review of the related contract during contract negotiations prior to its execution. The development of an alternate assessment field test for spring 2015, the hosting of Smarter Balanced Interim Assessments, and the reporting of 2014–15 CAASPP results, including Smarter Balanced Summative Assessment results, are only a portion of the tasks included in the scope of work and budget for Amendment 12 to the ETS CAASPP contract approved by the SBE in July 2014 for the 2014–15 CAASPP test administration. The budget for Amendment 12 is approximately $84 million. The costs for the setting of Smarter Balanced achievement levels and providing California teacher access to the Digital Library of formative assessment tools are included in the CDE contract with the University of California, Los Angeles (UCLA) for Smarter Balanced consortium services approved by the SBE in September 2013. The UCLA contract is capped at $9.55 million annually. ATTACHMENT(S) None 1/15/2015 1:45 AM