Louisiana Betieves 2012-2013 Security Irregularities Report January 2014 of EDUCATION louisiaua Betieves Test Security Irregularities 2012–2013 School Year Graduation Exit Examination (GEE) End-of-Course Tests (EOC) Louisiana Educational Assessment Program (LEAP) integrated Louisiana Educational Assessment Program (iLEAP) LEAP Alternate Assessment, Levels 1 and 2 (LAA 1 and LAA 2) English Language Development Assessment (ELDA) ACT Monitoring Spring and Summer 2013 Testing During Phase 1 and Phase 2 spring testing (March 19 and April 8–11, 2013), 70 Louisiana Department of Education (LDE) staff members made 210 test site visits in districts as well as charter schools, nonpublic scholarship schools, and other testing locations. Site visits included monitoring GEE, LEAP, iLEAP, and LAA 2. During the EOC testing window (April 24–May 17, 2013), 7 test site visits were conducted. In addition, ACT trained 6 LDE staff members to observe the March 19, 2013 state-wide ACT administration. Any school with a record of prior test security violations was likely visited; the remaining visits were randomly scheduled and included some schools that were requested by the district for monitoring. Districts received copies of the observation forms. During summer retesting, June 24–27, 2013, 11 LDE staff members made 12 test site visits in districts. Site visits included monitoring the administration of GEE, EOC, LEAP, and LAA 2. Any school with a record of prior test security violations was likely visited; the remaining visits were randomly scheduled and included some schools that were requested by the district for monitoring. Districts received copies of the observation forms. Generally, access to tests was controlled and security procedures were followed. School Test Coordinators and test administrators were knowledgeable about these procedures and appeared to work hard to ensure positive testing environments. However, irregularities in test administration procedures or breaches in test security were observed at some schools. Of the 210 sites monitored during spring 2013 testing, 18 had minor infractions noted. Examples of minor infractions are permitting students to sit too close to each other, displaying content-specific posters, and failing to post “Testing Do Not Disturb” signs on the testing room door. Examples of severe infractions are allowing cell phones in the testing room, neglecting to provide testing accommodations, and administering the tests on the wrong day. At 3 sites more severe testing irregularities were reported. Districts were required to conduct an investigation and provide a report of the investigation, along with a written plan of corrective action to LDE within thirty (30) calendar days of notification. Of the 12 sites monitored during summer 2013 retesting, 3 had minor infractions noted. No sites had more severe testing irregularities that required the districts to conduct further investigation. Plagiarism The scoring process produced information regarding written responses that have suspect or common elements, indicating potential plagiarism such as a student brought unauthorized materials to testing and used them to assist in writing, copied another student’s response, or that teacher interference might have been a significant factor. Documents flagged by the scoring contractor are independently reviewed by content area and assessment personnel in the Office of Assessments to determine if the tests are to be voided. Fall 2012 GEE, EOC, and LAA 2 Plagiarism Voids: During the fall 2012 GEE retest administration, 9 GEE tests at 2 schools in 2 districts were voided. There were no LAA 2 voids for the fall 2012 LAA 2 retest administration. During the December 2012 EOC administration, 75 EOC tests at 33 schools in 22 districts were voided. Spring 2013 GEE, EOC, LEAP, iLEAP, LAA 1, LAA 2, and ELDA Plagiarism Voids: During the spring 2013 administration, 6 LEAP tests at 3 schools in 3 districts were voided. During the spring 2013 administration, 38 GEE tests at 18 schools in 14 districts and 1 Type 2 charter were voided. During the spring 2013 EOC administration, 28 EOC tests at 16 schools in 12 districts were voided. There were no iLEAP, LAA 1, LAA 2, and ELDA voids for spring 2013. Summer 2013 GEE, EOC, LEAP, and LAA 2 Plagiarism Voids: During the summer 2013 administration, 2 LEAP tests at 2 schools in 2 districts were voided. During the summer 2013 EOC retest administration, 23 EOC tests at 16 schools in 11 districts as well as 1 laboratory school and one Type 2 charter were voided. For the summer 2013 administration, there were no plagiarism voids for GEE and LAA 2. Test Security Irregularities 2012–2013 School Year Graduation Exit Examination (GEE) Fall 2012 District School East Baton Rouge Belaire High School East Feliciana East Feliciana High School Total Test(s) English Language Arts Mathematics Social Studies Social Studies 9 End-of-Course Tests (EOC) December 2012 District School Avoyelles Marksville High School Caddo Fair Park College Academy Huntington High School Booker T. Washington New Technology High Woodlawn Leadership Academy Washington/Marion Magnet High School Mansfield High School North Desoto High School Glen Oaks Senior High School Scotlandville Magnet High School Tara High School Mamou High School Jeanerette Senior High School East Iberville Elementary/High School Bonnabel Magnet Academy High School Helen Cox High School L.W. Higgins High School West Jefferson High School Central Lafourche High School Warren Easton Senior High School Alexandria Senior High School Rayville High School Calcasieu Desoto East Baton Rouge Evangeline Iberia Iberville Jefferson Lafourche Orleans Rapides Richland Number of Tests Voided for Plagiarism 3 2 2 2 Test(s) Biology U.S. History Biology Biology Biology Number of Tests Voided for Plagiarism 2 1 1 1 1 Biology Biology 7 1 Biology Biology Biology Biology Biology Biology Biology Biology Biology 2 1 1 1 1 2 1 1 2 U.S. History Biology Biology Biology Biology Biology Biology 2 3 8 2 1 1 1 Test Security Irregularities 2012–2013 School Year End-of-Course Tests (EOC) December 2012 District St. James St. John Terrebonne Union Vernon Webster City of Monroe RSD-Algiers Charter RSD Total School Test(s) St. James High School West St. John High School Terrebonne High School Farmerville High School Pickering High School Minden High School Wossman High School O.P. Walker Senior High School Biology Biology Biology Biology Biology Biology Biology U.S. History Walter L. Cohen High School L.B. Landry High School Istrouma Senior High School Biology Biology Biology 7 2 3 75 Louisiana Educational Assessment Program (LEAP) Spring 2013 District Natchitoches St. John RSD-Algiers Charter Total School Fairview-Alpha Elementary & Junior School Garyville/Mt. Airy Math & Science Magnet William J. Fischer Elementary Charter Grade Number of Tests Voided for Plagiarism 1 1 1 7 2 4 1 2 Test(s) Number of Tests Voided for Plagiarism 2 8 Science 8 English Language Arts 2 8 English Language Arts 2 6 Test Security Irregularities 2012–2013 School Year Graduation Exit Examination (GEE) Spring 2013 District School Bossier Caddo Bossier High School Woodlawn Leadership Academy Desoto East Baton Rouge Mansfield High School Scotlandville Magnet High School Jefferson Bonnabel High School Helen Cox High School Grace King High School Madison High School Eleanor McMain Secondary School Richland High School St. Helena Central High School Breaux Bridge High School H.L. Bourgeois High School Home Study International High School of New Orleans Madison Orleans Ouachita St. Helena St. Martin Terrebonne Webster Voices of International Business RSD-Algiers Charter RSD Total O. Perry Walker High School Istrouma Senior High School Sarah Towles Reed Senior High School Test(s) Social Studies Mathematics Social Studies Social Studies English Language Arts Social Studies Social Studies Social Studies Social Studies Social Studies Social Studies Social Studies Social Studies Social Studies Social Studies Social Studies Social Studies Social Studies Social Studies Social Studies Number of Tests Voided for Plagiarism 1 8 1 2 2 4 1 1 3 1 1 1 2 1 1 1 2 2 2 1 38 Test Security Irregularities 2012–2013 School Year End-of-Course Tests (EOC) Spring 2013 District Caddo Claiborne Desoto East Baton Rouge East Carroll Orleans Rapides Tangipahoa Vernon Washington Webster RSD Total School Green Oaks Performing Arts Academy Huntington High School Homer High School Mansfield High School Glen Oaks High School Scotlandville Magnet High School Lake Providence Senior High Warren Easton Senior High School McDonogh #35 College Preparatory School Tioga High School Amite High School Pickering High School Pine High School Minden High School North Webster High School L.B. Landry High School Test(s) Biology Number of Tests Voided for Plagiarism 1 U.S. History U.S. History U.S. History Biology U.S. History U.S. History U.S. History 1 3 1 2 1 1 2 U.S. History 2 U.S. History Biology U.S. History U.S. History U.S. History Biology U.S. History 1 2 2 2 1 4 2 28 Test Security Irregularities 2012–2013 School Year End-of-Course Tests (EOC) June 2013 District School Test(s) Ascension East Baton Rouge East Ascension High School Belaire High School McKinley Senior High School Career Academy Lafayette Acadiana High School Pointe Coupee Livonia High School St. Mary Franklin Senior High School St. Tammany Salmen High School Webster Minden High School City of Monroe Wossman High School Grambling State Grambling State University Lab High School Milestone SABIS Milestone SABIS Academy of New Orleans RSD-Future is Now John McDonogh High School RSD Sarah Towles Reed Senior High School L.B. Landry High School RSD-Institute for Sophie B. Wright Learning Academic Excellence Academy Total Biology Biology Biology Biology Biology U.S. History Biology Biology Biology Biology Biology Biology 2 Biology U.S. History 1 1 Biology Biology 1 1 23 Louisiana Educational Assessment Program (LEAP) Summer 2013 District School Grade Bienville Saline High School 8 Jackson Jonesboro-Hodge Middle School 8 Total Test(s) English Language Arts English Language Arts Graduation Exit Examination (GEE) Summer 2013 District Total School Number of Tests Voided for Plagiarism 1 2 1 1 1 1 1 1 1 1 6 Test(s) Number of Tests Voided for Plagiarism 1 1 2 Number of Tests Voided for Plagiarism 0 Test Security Irregularities 2012–2013 School Year District Voids Each year districts are required to train all test administrators in proper test administration procedures, including test security policy. If schools or districts find violations of test security, including administrative errors, the violations are self-reported to the Louisiana Department of Education (LDE). Tests that are deemed to be in violation of BESE’s Test Security Policy are considered invalid and voided at the district’s request. Fall 2012 GEE, EOC, and LAA 2 District, Self-Reported Voids: During the fall 2012 administration, 8 GEE tests at 2 schools in 2 districts and no LAA 2 tests were voided for self-reported errors. During the December 2012 EOC administration, 8 EOC tests at 7 schools in 7 districts were voided for self-reported errors. Spring 2013 GEE, EOC, LEAP, iLEAP, LAA 1, LAA 2, and ELDA District, Self-Reported Voids: During the spring 2013 administration, 1 GEE tests at 1 school in 1 district and 40 EOC tests at 23 schools in 18districts were voided for self-reported errors. During the spring 2013 administration, 56 LEAP tests at 29 schools in 23 districts were voided for self-reported errors. During the spring 2013 administration, no iLEAP, LAA 1, LAA 2, and ELDA tests were voided. Summer 2013 GEE, EOC, LEAP, and LAA 2 District, Self-Reported Voids: During the summer 2013 administration, 1 GEE test at 1 school in 1 district was voided for self-reported errors. During the summer 2013 administration, 20 EOC tests at 4 schools in 2 districts were voided for self-reported errors. During the summer 2013 administration, no LEAP and LAA 2 tests were voided. ACT Voids March 19, 2013 was the first statewide administration of ACT. To maintain the integrity of ACT test scores for college admissions, ACT test security staff conducted the “schools-under-investigation” procedure and voided 208 ACT scores. Test Security Irregularities 2012–2013 School Year Avoyelles Marksville High School # of Voids 10 Bienville Caddo Cameron Ringgold High School Huntington High School Northwood High School Hackberry High School 1 1 1 3 Catahoula Block High School 2 Claiborne Concordia Haynesville High School Ferriday High School 1 1 Desoto North Desoto High School 1 East Baton Rouge Glen Oaks High School Woodlawn High School East Feliciana High School Pine Prairie High School 6 6 3 1 Bonnabel Magnet Academy High School West Jefferson High School 1 Carencro High School 3 Lafayette High School Northside Senior High School Ruston High School Ruston High School Albany High School Live Oak High School Live Oak High School 1 11 26 3 1 2 2 Live Oak High School McDonogh 35 Career Academy 5 1 McMain Secondary School 7 Glenmore High School Florien High School Hahnville High School St. Helena Central High School 1 1 2 6 District East Feliciana Evangeline Jefferson Lafayette Lincoln Livingston Orleans Rapides Sabine St. Charles St. Helena School 4 Reason for ACT Void Test administered wrong day or outside window Timing overage Timing overage Timing shortage Test administered with the wrong materials Test administered wrong day or outside window Timing shortage Tested with unauthorized or unapproved accommodations Test administered with the wrong materials Timing overage Unauthorized break Timing overage Test administered with the wrong materials Unknown Test administered wrong day or outside window Tested with unauthorized or unapproved accommodations Timing shortage Timing shortage Accommodations misadministration Security concerns Security concerns Accommodations misadministration Tested with unauthorized or unapproved accommodations Timing overage Test administered wrong day or outside window Tested with unauthorized or unapproved accommodations Timing shortage Accommodations misadministration Security concerns Unauthorized break Test Security Irregularities 2012–2013 School Year St. John St. Mary St. Tammany Tangipahoa East St. John High School West St. Mary High School Northshore High School Loranger High School # of Voids 5 1 1 1 Terrebonne Vernon H. L. Bourgeois High School Hicks High School Vernon Parish Optional PM 2 2 9 Washington Webster Webster Mt. Hermon High School Doyline High School North Webster High School 1 1 1 City of Monroe Carroll High School Carroll High School 12 3 AMIKids, Inc. Louisiana Connections Academy RSD AMIKids Southwest Louisiana Connections Academy 2 1 1 Istrouma High School O. Perry Walker Senior High 10 5 Walter H. Cohen High School Crescent Leadership Academy 2 26 Accommodations misadministration Tested with unauthorized or unapproved accommodations Accommodations misadministration Timing shortage John McDonogh Senior High 1 Accommodations misadministration Miller-McCoy Academy 7 Late start District RSD-Crescent Leadership Academy RSD-Future Is Now Schools: New Orleans RSD-Miller McCoy Academy Total School Reason for ACT Void Timing overage Timing shortage Timing overage Tested with unauthorized or unapproved accommodations Test administered out of sequence Timing shortage Test administered with the wrong materials Timing overage Timing overage Tested with unauthorized or unapproved accommodations Test administered out of sequence Tested with unauthorized or unapproved accommodations Late start Timing overage Timing shortage 208 Test Security Irregularities 2012–2013 School Year Administrative Errors Administrative errors that result in questions regarding the security of the test or the accuracy of the test data are considered testing irregularities. If an administrative error has occurred resulting in invalid test data for tests that are high stakes for students (i.e., LEAP grades 4 and 8 English Language Arts and Mathematics tests, GEE tests, EOC tests, and LAA 2 grades 10 and 11 tests), the Local Education Agency (LEA) superintendents, or the parent or legal guardian of an affected student, may initiate a request to the state superintendent of education to retest prior to the next scheduled test administration. The LEA superintendent or parent must provide the state superintendent of education with school- and studentlevel documentation describing the administrative error. If the LDE determines that an administrative error that allows for a retest did occur, the tests will be voided. LDE then notifies the LEA of the determination and of arrangements for the retest. The LEA must provide a corrective action plan. The district void counts indicated above include the administrative error retests if the request was made prior to score release. In some situations, the irregularity is discovered or reported after the voids are entered into the system. To offset costs involved in retesting, the vendor will assess the LEA a fee for each test. Fall 2012 GEE, EOC, and LAA 2 Administrative Errors: For fall 2012, 11 GEE administrative error retests at 2 high schools in 2 districts were requested. For fall 2012, 7 LAA 2 administrative error tests at 1 high school in 1 district were requested. For December 2012, 6 EOC administrative error retests at 3 high schools in 3 districts were requested. Spring 2013 GEE, EOC, LEAP, and LAA 2 Administrative Errors: For spring 2013, no GEE and no LAA 2 administrative error tests were requested. For spring 2013, 13 EOC administrative error retests were requested at 8 high schools in 7 districts. For spring 2013, 8 GEE administrative error tests at 2 schools in 1 district were requested. For spring 2013, 82 LEAP administrative error tests at 15 schools in 12 districts were requested. Summer 2013 GEE, EOC, LEAP, and LAA 2 Administrative Errors: For summer 2013, no GEE, EOC, LEAP, and LAA 2 administrative error tests were requested. Graduation Exit Examination (GEE) Fall 2012 District School Bossier Haughton High School Jefferson Helen Cox High School Total Test(s) English Language Arts Science Social Studies English Language Arts Mathematics Number Administrative Error Retests 1 2 2 3 3 11 Test Security Irregularities 2012–2013 School Year LEAP Alternate Assessment, Level 2 (LAA 2) Fall 2012 District Calcasieu School Lagrange High School Total Test(s) Mathematics Science Social Studies End-of-Course Tests (EOC) December 2012 District School Terrebonne City of Baker RSD-Educators for Quality Alternatives Total South Terrebonne High School Baker High School The NET Charter High School Test(s) Geometry Geometry English II Lafayette School Carencro High School Northside High School Total Number Administrative Error Retests 2 1 3 6 Graduation Exit Examination (GEE) Spring 2013 District Number Administrative Error Retests 3 2 2 7 Test(s) Science Social Studies Science Social Studies Number Administrative Error Retests 2 2 2 2 8 Test Security Irregularities 2012–2013 School Year Louisiana Educational Assessment Program (LEAP) Spring 2013 District Ascension Claiborne School Grade Test(s) Number Administrative Error Retests 1 19 Duplessis Primary School Homer Junior High School Broadmoor Elementary School Broussard Middle School Evangeline Elementary School Goodpine Middle School Einstein Charter Riverbend Elementary School Rougon Elementary School Red River Elementary School Berwick Elementary Evergreen Junior High 4 8 Mathematics Mathematics 4 English Language Arts 4 8 4 English Language Arts English Language Arts Mathematics English Language Arts Mathematics English Language Arts Mathematics Mathematics 1 1 1 1 1 4 4 12 Houma Junior High School 8 English Language Arts Mathematics English Language Arts English Language Arts Mathematics Mathematics 4 4 1 1 1 1 Vernon Pitkin High School 8 RSD-ICS Charter The Intercultural Center 4 English Language Arts Mathematics English Language Arts Mathematics 5 5 7 7 82 Lafayette LaSalle Orleans Ouachita Pointe Coupee Red River St. Mary Terrebonne Total 4 4 4 4 4 4 8 Test Security Irregularities 2012–2013 School Year End-of-Course Tests (EOC) Spring 2013 District School Assumption East Baton Rouge Assumption High School Tara High School Iberia Jeanerette High School New Iberia Senior High Morgan City High School Terrebonne High School Franklinton High School Miller-McCoy Academy for Mathematics and Science St. Mary Terrebonne Washington RSD-Miller McCoy Total Test(s) Algebra I English III U.S. History Algebra I Biology Geometry English II Algebra I U.S. History 13 Louisiana Educational Assessment Program (LEAP) Summer 2013 Graduation Exit Examination (GEE) Summer 2013 LAA 2 Summer 2013 End-of-Course Tests (EOC) Summer 2013 District Total School Number Administrative Error Retests 1 1 1 1 3 1 3 1 1 Grade Test(s) Number Administrative Error Retests 0 Erasure Analyses Erasure analyses are conducted to investigate excessive wrong-to-right erasures on student answer documents for the multiple-choice portions of tests. Answer documents with wrong-to-right erasures that exceed the state average by more than four standard deviations are identified for further investigation. Spring 2013 GEE, LEAP, and iLEAP Erasure Analyses: During the spring 2013 test administration, 11 classrooms at 11 schools in 10 districts were identified as having violations of test security based on erasure analyses. As a result of the analyses, 58 test scores which were identified were lowered to the lowest scaled score for school accountability in both the School Performance Score (SPS) and Adequate Yearly Progress (AYP) for the schools and classes identified. Test Security Irregularities 2012–2013 School Year Erasure Analyses Louisiana Educational Assessment Program (LEAP) Spring 2013 integrated Louisiana Educational Assessment Program (iLEAP) Spring 2013 District Avoyelles Caddo Concordia Desoto East Baton Rouge Iberville Pointe Coupee Rapides St. Martin Tangipahoa Total School Name of Test Grade Subject(s) Number of Tests Voided 6 Marksville Elementary School Oak Park Microsociety Elementary School Walnut Hill Elementary/Middle School Vidalia Upper Elementary School Logansport High School Merrydale Elementary School Dorseyville Elementary School Valverda Elementary School Mabel Brasher Elementary School iLEAP 3 iLEAP 3 LEAP 8 English Language Arts 3 iLEAP 3 Mathematics 8 LEAP 8 3 LEAP 4 LEAP 4 English Language Arts English Language Arts Science iLEAP 5 3 iLEAP 3 Parks Primary School O.W. Dillon Memorial Elementary School LEAP iLEAP 4 3 English Language Arts English Language Arts Science Social Studies Mathematics English Language Arts Mathematics 5 8 3 3 8 3 5 58