Roderitk Sams (roderitk Tuesday, July 5, 2016 3.10 PM Amy Wieland c: Shawn Joseph,Monique Felder,BryanL Subject: Re. Assessments Amchments: SHELBY RFP LMS docx Good anemoon Monique and Melissn, As previously mentioned, nttaehed is the Shelby County RFP foryour review Please note the "le Back" purchasing clause on page 5 As a next step, I recommend an onstte meeting to discuss extsling priorities and potential next steps Please share a fevt date options for lnte July or early Augusl, I will plan noeordingly Look forward to the opportunity Thanks agath Rocky On Mon, Jun 13, 20l6 at 10 41 PM, Roderick Sams wrole lhanks Arnyl Hey Ms Bryant and Dr Felder, I would love an opportunity to connect this vteek to schedule nexl steps Look to hearing from you And Dr Josephl Rocky On Monday, June 13, 2016, Amy Wieland wrote Shawn, Thank you lt nice to touch base today and Dr Felder, I've copied Dr Rocky Sams so he can help coordinate next steps We can provide Ihe REP Informauon for your review Regards, Amy Amy Wieland, Senior Vice President Performance Matters Cell -- Sent from my lPhone On Jun 13,2016,nt4 19 PM, Shawn Joseph wrote 16 Reid, Nicole R From: Sent: To: Cc: Subject: Roderick Sams Monday, July 18, 2016 8:56 AM Shawn Joseph Amy Wieland;Bryant, Melissa Re: Assessments Thank you Sir! Melissa, please share a contact number and I will give you a call to schedule. Thanks, Rocky On Mon, Jul 18, 2016 at 9:41 AM, Shawn Joseph She's cc'd. > wrote: Get Outlook for iOS On Mon, Jul 18, 2016 at 7:56 AM -0500, "Roderick Sams" wrote: Great...and I understand completely. I've reached out to Melissa to set up a talk time, but I'm sure her email inbox is slammed. Is there a contact number I can use to give her a call? Thanks again, Rocky On Mon, Jul 18, 2016 at 8:49 AM, Shawn Joseph wrote: Excellent. I need to get my bearings. We have data systems. I need to look at them and see if there is a need to enhance. If I make changes, it will be next year. We may be able to discuss a pilot this year and the costs are right! Sent from my iPhone On Jul 15, 2016, at 3:56 PM, Roderick Sams wrote: You're welcome! As an FYI, I met Dr. Changas at CGCS this week. Looking forward to visiting Nashville soon! Rocky 12 On Wed Jul 6, 2016 312 421 PM Shawn Joseph -- wrote Thanks' Shawn From: Roderick Sams (rodenck sams erformancemauers com) Cc: Amy W1eland Sam: Tuesday, July 5, 2016 2:52 PM Subject: Fwd: Assessments 1-1ey Shaun, 1 hope all 15 well and you are 1n well 1n Nashvr11e As we look at how we can extend our to 1nclude your current Vlslon for MNPS, I've attached a copy ofthe recent Shelby County RFP we were Jusl awarded tor your rev1ev1. II rneludes a "P1ggy Back" clause rs on page 5 that would allow to use as a purchasmg vehlcle 1 "111 send a follow up emar1 lo the team 1ncluded 1n your prevmus emalL and 1 look forward to engagmg soon Thanks agarnl Rocky Forunrded message From Amy Wieland Date Mon, Jun 13, 20l6 at 10 30 PM Subjecl Re Assessments To Shaun Joseph Cc Momque Felder "Mel 3 Bryant Reid, Nicole R From: Sent: To: Subject: Roderick Sams Monday, July 18, 2016 9:40 AM Bryant, Melissa Re: Assessments That date looks good but I will confirm shortly. I'll give you a call. Thanks, Rocky On Mon, Jul 18, 2016 at 10:29 AM, Bryant, Melissa wrote: Rocky, my desk number is 615-259-8421. Shawn has just told me who all he wants included in the meeting. Would Wednesday, August 17th at 9:00 a.m. work for you? Thanks, Melissa From: Roderick Sams [mailto:roderick.sams@performancematters.com] Sent: Monday, July 18, 2016 8:56 AM To: Shawn Joseph Cc: Amy Wieland; Bryant, Melissa Subject: Re: Assessments Thank you Sir! Melissa, please share a contact number and I will give you a call to schedule. Thanks, Rocky On Mon, Jul 18, 2016 at 9:41 AM, Shawn Joseph < wrote: She's cc'd. 6 Get Outlook for iOS On Mon, Jul 18, 2016 at 7:56 AM -0500, "Roderick Sams" wrote: Great...and I understand completely. I've reached out to Melissa to set up a talk time, but I'm sure her email inbox is slammed. Is there a contact number I can use to give her a call? Thanks again, Rocky On Mon, Jul 18, 2016 at 8:49 AM, Shawn Joseph > wrote: Excellent. I need to get my bearings. We have data systems. I need to look at them and see if there is a need to enhance. If I make changes, it will be next year. We may be able to discuss a pilot this year and the costs are right! Sent from my iPhone On Jul 15, 2016, at 3:56 PM, Roderick Sams wrote: You're welcome! As an FYI, I met Dr. Changas at CGCS this week. Looking forward to visiting Nashville soon! Rocky On Wed, Jul 6, 2016 at 2:48 PM, Shawn Joseph < Thanks! 7 > wrote: Shawn From: Roderick Sams To: Shawn Joseph < > Cc: Amy Wieland Sent: Tuesday, July 5, 2016 2:52 PM Subject: Fwd: Assessments Hey Shawn, I hope all is well and you are settling in well in Nashville. As we look at how we can extend our partnership to include your current vision for MNPS, I've attached a copy of the recent Shelby County RFP we were just awarded for your review. It includes a "Piggy Back" clause is on page 5 that would allow districts to use as a purchasing vehicle. I will send a follow up email to the team included in your previous email, and I look forward to engaging soon. Thanks again! Rocky ---------- Forwarded message ---------From: Amy Wieland Date: Mon, Jun 13, 2016 at 10:30 PM Subject: Re: Assessments To: Shawn Joseph < > Cc: Monique Felder < >, "Melissa Bryant (MNPS)" , rocky.sams@performancematters.com Hi Shawn, Thank you. It was nice to touch base today. Melissa and Dr. Felder, I've copied Dr. Rocky Sams so he can help coordinate next steps. 8 We can provide lhe Memphis RFP information for your review. Regards, Amy Amy Vlneland, Senior Vice President Performance Matlers Cell -- Sent from my iPhone On Jun 13, 2016, al 4:19 PM, Shawn Joseph -- wrote: Amy, Melissa Bryant can set up a time for us to talk wilh our curriculum and assessment team to discuss how we can best support teachers using quality formative assessments and quality unit assessments aligned lo Tennessee slandards. We'd also be interesled in high quality PD jusl focused on lileracy. We don'l need on--line PD lo support high quality lileracy inslruotion. Dr. Felder can give you specific requirements in advance. She is odd on this email. I will speak wilh Memphis lo see what they just purchased. Thx. Senl from my iPhone (770) 283-4145 Errur' annulled wwaerlormancemallersLom Reid, Nicole R From: Sent: To: Cc: Subject: Attachments: Roderick Sams Monday, August 15, 2016 10:30 AM Felder, Monique T Director of Schools;Shawn Joseph;Amy Wieland Course List - TNL Premium Library PL Course List with descriptions w credit hours.xlsx Good morning Dr. Felder, I hope all is well. In preparation for our meeting Wednesday, I wanted to provide in advance the Premium Library course listing accessed through our PD Management platform. I realize the primary focus is literacy, but wanted to share the complete list for your review. Looking forward to the conversation. Thanks, Rocky -- Roderick Sams, Ed.D. Director, Education Solutions (770) 283-4145 www.performancematters.com 3 Reid, Nicole R Subject: Location: Assessments and PD/Performance Matters 2601 Bransford Avenue, Nashville, TN 37204 - Director's Office Start: End: Show Time As: Wed 8/17/2016 9:00 AM Wed 8/17/2016 10:00 AM Tentative Recurrence: (none) Organizer: Required Attendees: Joseph, Shawn Narcisse, Sito J; Changas, Paul; Henson, Chris M; amy.wieland@performancematters.com; Joseph, Shawn; roderick.sams@performancematters.com; Felder, Monique T The purpose of the meeting is to discuss how we can best support teachers using quality formative assessments and quality unit assessments aligned to Tennessee standards. There will also be discussions on high quality PD focused on literacy, specifically online PD. 2 Reid, Nicole R Changas, Paul Saturday, August 20, 2016 11 :09 PM Russell, Toni M FW: Performance Matters Demo Meeting Schedule with Selected MNPS Staff--Wed., Aug. 24th From: Sent: To: Subject: Toni, I was in the Gallup training the last two days but did receive your text. I got an email from Dr. Joseph this week with the vita of the new Chief of Staff, who starts in mid-September. It will be good to have an immediate supervisor. I am forwarding an email I just received tonight from Dr. Felder regarding next Wednesday's meeting (9-11) with Performance Matters. The primary purpose for their involvement appears to be to potentially provide district benchmark assessments to replace the ones currently developed by the district. They are currently scheduled to be administered September 26-30, but a separate email from Dr. Felder indicates they may be delayed, if necessary. I hope your weekend is a good one and I will try to contact you Monday. I am at Stratford HS first thing Monday morning but perhaps we can touch base afterward. Paul From: Felder, Monique T Sent: Saturday, August 20, 2016 9:07 PM To: Shrader, Terry ; Jones, Katea J ; Williams, David S ; Changas, Paul ; Cour, Katie Cc: Amy Wieland ; Roderick Sams ; Narcisse, Sito J ; Jones, Katea J ; Beasley, Lisa R ; Bryant, Melissa Subject: Performance Matters Demo Meeting Schedule with Selected MNPS Staff--Wed., Aug. 24th Greetings, AllBelow is the Performance Matters meeting/demonstration agenda for Wednesday, August 24th . The meetings/demonstrations will take place at Central Office (2601 Bransford Ave.); room TBD. The purpose of the meetings/demonstrations is to share and get feedback from stakeholders on a proposed data dashboard system that can support educators with developing, reviewing, administering and analyzing quality standards based assessments to inform and improve instruction. e e • e Terry-Please share the 7:45-8:45 meeting/demo time slot with the selected principals. Thanks! Paul-Please share the 9:00-11:00 meeting/demo time slot with your staff and the appropriate IT staff. Thanks! David & Katie-Please share the 4:00-4:50 meeting time slot with selected teachers. Thanks! Katea & Lisa-Please ensure the 7:45-8:45, 4:00-4:50, & 5:00-6:00 meetings are on my schedule and Sito's schedule. Please informed every one of the meeting location at Bransford as well. Water will be needed at all meetings; very light snacks for the teachers' meeting @ 4:00 will be needed too. Thanks! Wednesday, August 24th-Performance Matters Meetings/Demonstrations Schedule 19 • 7:45-8:45 ('60)- Selected School/District Administrators (Note: Sito & Monique will need to depart by 8:30) • • 9:00-11:00 ('120)-:MNPS IT/Assessment team to discuss the technology infrastructure and technical requirements/expectations 4:00-4:50 ('50)- Selected Teachers (Note: Paul will kick the meeting off; Monique & Sito will arrive as soon as possible) • 5:00-6:00 ('60)-Executive Leadership Debrief & Next Steps (Note: Dr. Joseph will need to depart by 5:45) Thank you for your support! Best, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique. Felder@M N PS.org "For these are all of our children ... We will profit from or pay for whatever they become." Baldwin 20 Reid, Nicole R From: Sent: To: Subject: Changas, Paul Monday, August 22, 2016 5:23 PM Russell, Toni M RE: Wednesday's Demo Agenda Toni, Hopefully we can talk in the morning. As per the email I forwarded late last week, the meeting from 9-11 on Wednesday is intended primarily for Performance Matters to speak with IT staff regarding technology infrastructure and technical requirements for their assessment platform. I am hoping that we can host this meeting in the IT conference room in lieu of the normal data warehouse meeting. Dr. Felder asked me on Friday to help facilitate the meeting, as she and Dr. Narcisse are tied up. I said I would do so but asked for additional direction. Hopefully more info will come tomorrow. · Thank you. Paul From: Teeter, John W Sent: Monday, August 22, 2016 5:04 PM To: Changas, Paul Cc: Russell, Toni M Subject: RE: Wednesday's Demo Agenda Paul, · You have two options for this. I can share my conference bridge with you ... OR You can start using our newest tool. If you setup a 'Skype for Business' meeting (previously Lyne), when you set the skype meeting up in Outlook it will create not only an audio video capability through a PC client, but you can simply use it as an audio bridge. The dial in number and conference ID are created and become part of the notice. Let me know and if you need assistance with the Skype setup, I can walk you through it. If you'd prefer to just use my bridge, let me know and I'll send you the dial in codes. J From: Russell, Toni M Sent: Monday, August 22, 2016 4:38 PM To: Teeter, John W Subject: FW: Wednesday's Demo Agenda ??? 16 From: Changas, Paul Sent: Monday, August 22, 2016 4:31 PM Roderick Sams Cc: Felder, Monique T ; Williams, David S ; Russell, Toni M Subject: RE: Wednesday's Demo Agenda To: Rocky, Our IT staff should be able to provide the audio capability your PM team needs, but I am copying our Executive Director for IT, Toni Russell, to ensure we all stay connected. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools From: Roderick Sams [mailto:roderick.sams@performancematters.com] Sent: Monday, August 22, 2016 11:57 AM Changas, Paul Cc: Felder, Monique T ; Williams, David S Subject: Wednesday's Demo Agenda To: Good morning Sir, Looking forward to returning to Nashville Wednesday, and appreciate the opportunity to share our platform with your team. In preparing an agenda for our time together, we want to have the PM implementation team call into our meeting about 10:30 am. The purpose is to discuss our process of file sharing and the project plan. Would we have audio capability for them to call in and participate remotely? I will share the agenda with you later today for your approval as well. Thanks again! Rocky Rnde:rkk §ams, Edl.D. Director, Education Solutions (770) 283-4145 performance _. . . _ .rs·~~•~ . ·- ~8.ft~ftJ m·atte-· . Accderate Stilctent.and !;.qut::ator Gr,;wth www.performancematters.com 17 'cole From: Changas, Paul Sent: Monday. August 22, 2015 921 PM To: Hansen, Laura Cc: Russell, Toni Subject: RE: Performance Matters Meetings Laura, 1 will forward the email shortly thatl received on Saturday evening from Dr. Felder regarding the schedule for the day. That email states the 9-11 session is to disruss the "technology infrastructure and technical requirements /expectations." That's really about all [know at this point. I am facilitating a session from +5 with teachers, butl am awaiting rnore direction from Dr. Felder regarding the expectation for that session. I also have to present to the School Choice Committee ofthe Transition Team sometime Wednesday afternoon, so it will be a i am copying Toni, as i will be following up with her tomorrow at 9 if you are available, maybe we should all touch base for a few minutes, i have a meeting at noon with Dr. Felder regarding district benchmark assessments, so hopefully 1 can get more information at that time. Roderick "Rocky" Sams ofPerformanCe Matters is supposed to provide his agenda sometime tonight or tomorrow. Paul Flam Hansen, Laura Sent: Monday, August 22, 2016 4:39 PM To: changes, Paul Subject: Performance Matters Meetings Paul, just met with Monique and Site and they asked that I get in touch with you to get on the list to attend the morning 2 hoursession and then afternoon debrief session, Theydidn't give a bunch of details, but asked ifl would attend. Any information you have on the agenda would be helpful tool Happy Monday, Laura Laum Hansen Director, Information Management and Decision Support Metro Nashville public Schools sis-2598551 (Office) (Cell) 15 Reid, Nicole R From: Sent: To: Subject: Attachments: Changas, Paul Monday, August 22, 2016 10:46 PM Roderick Sams Data Warehouse Report Examples Data Warehouse Report Examples (8-2016).pdf As a follow-up to last week's meeting, I have attached a pdf containing a few examples of data warehouse reports that have been among the more popular reports with teachers in the past - particularly with respect to assessment data. I shared these with Drs. Joseph, Felder and Narcisse today. These reports are not yet live this year due to the transition to Infinite Campus as well as the lack of state assessment results from the spring. But I pulled some report examples from the past year (and de-identified teacher and student information) to provide context regarding some of the formats in which teachers have typically seen data displayed. Such context may be useful to Performance Matters as we prepare to get input from principals and teachers regarding their needs. The reports attached are as follows: • • • • Teacher Profile (provides teacher's course schedule, student attendance, student ethnicity and gender distribution, and grade distribution) Classroom Assessment Composite (class summary data and individual student trend data for a variety of state and district assessments) Assessment by Teacher (class summary data and more detailed student data for a single assessment) Virtual Data Wall (compares student projections from past state assessments to current performance on district benchmarks for a particular subject; student attendance, discipline and mobility data also referenced) As I said on Wednesday, there is not a specific dashboard in the data warehouse that has been a starting point for all teachers. And data from the more frequent formative assessments created by teachers through SchoolNet (our instructional management system) have not been available in the data warehouse. Results from district interim benchmark assessments and all other state and district summative assessments are imported into the data warehouse, however. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools 12 Data Warehouse Report Example Virtual Data Wall (5 pages) lt~IBi Metropolitan Nashville Public Schools Virtual Data Wall Page 1 of 5 2015-2016 Enrollment Year: IS' Quintile{Q): Data Guide Available School : Music City Elementary School 1 [~ 2 3 fJ~r.~ 4 [115 Enrollment Grade: 4 Assessment Subject: READING Meeting Pattern: 2M-F Class Student Status: All Active Students Only Counselor: Smith Course: 4 Eng Lang Arts Lit Y Teacher: Jones Print Labels (May take time to generate) . Level 3 !80% + Correct i~ j~j Quintile 4 2 !50-79% Correct j -------~.:. .::~.. 5 OSS )NIA l INIA . . . . .......,.....- .......:...._.J ( 70 % Latest ~-~~~.i~9-!":.~i~_J .. , _ _ _ _ _ _ ...._,....,.,....,....,,,,,.,.,.oc,~~ --!;l! . _,._. . . ,.) %ile Measure on Data Card j i ~~ti~i ~~t!ilt~;\~f~~~t~irri~~fu~~t~t;\'i~;:fui~:; ~i IB;if:i;~; ~;~~~!f.,§,~B.~~~~lt~,\~;j\m~~~~~;i~; ; t~:l~[~l il~~~~~\~~\f&M\tili~~~~~~?;.~:i~j~Tu[i\l\ 1TCAP1Eo_c___.___ l_s_t;·i;··P;i~;~ti1~·· ········----·1 Quintile 5 Quintile 4 Quintile 3 Quintile 2 Quintile 1 Total! ...,,.., • ....... ~,.. MM - - mmr,~onem,:c1:•w1:rnm;~,m ;o;-J,lf,r,,a,r,;,,;;;m~1;w-l);;%'?. j [ jQuintile5 • 1 1 Q Q 2.i iTV AAS i Proficiency Projection State Percentile i: ~ ...,.•.. i i ~ ::Ouintile4 )11 1 1 Q. .Q .Q 2.i 1: District Benchmark (DB) District Percentile ' ·-·---.---•·.--•~..-.-·-·-·- ~----------·--------~ r~ =.... ---~ . . . . Q . ---·-~- ..........-...... . Q ... ...... ~-..--....~......-•-----·----- Q_ 3 . ·~ iSummary i ~ ·----· ;: (/) r, ... . !l: ~i~~~=· § ~~~:~:::: ." ,-.«••• : .. ,-•• ,~,. ... ,,.._.,._._,._, ,_ ....,.,,.,.,_,,,. •• ,,. ••• • •·• < •·• - -•.•__ .,- .. - . c • - - - - - ,..........,_..,.,.......,,.~,_.,_,.,,,.,.,,_,__.,_. .<· •._,._,..,. ....... . . . - · - - - - - .,,.,.,.,,.,..+,.,.. '""" ..................... ._.,.•-•""""""~· """""""' ••· ·c ,,... f • ,,.,.,u,.· ,,,.,.,u,, •= "••-•----•~"""'"•"·"· c-.c..·-·•· • .........m,........,... ,; l) ..... !. . . . .,~ '"'""--------· . . .,.~ --·--- -··r ... -....._.................... ,. . .,~. '"""" ~ -..--. -,•·-----· ~ . ..., .,: ,. . : ~ ~ .... - ...........,,.................... .·-· ..·- 2. ! Total .3. 2 ........ -......... .. .......... z ···-··· ........,........ 231 .5. Jm.m.m.;;r-&Hltltll:!UEUiHi:iSE!iP55!1Ji5~:tr.m1i;i;f'.l.~';if,;~m)~'It~~Jt;t;.:}j;.i211J'-Ei~?:~~! Lastname2, Firstname 2 Lastname,1 Firstname1 %ile 14/15 TCAP TVMS I Enr. Grade 4 ED N N N A M LEP SWD Ethn Gender DB 1 D82 i R Lvl ai(Attendance %ile - i\f'res. 95%!jil ! 1D82 162jTardy lAbs •.-.. •. aj . ... Lvl Q~Attendance 5~1Dis. (ISS/OSS) 5![?is. (ISS/OSS) 5rr Cumulative S&l 3 sil#Entries r, 3 Sli .......... ! ,fL.._...,_.,_,.. y 1/B □~ 1!i 4 Cumulative S&I 4 l\l I ~ 2 4,#Entries 1 t,i 3 5)1i,.,..--........,.,~,.,_.,...,,.,.,=r-.,,,.,..,,. .... ,...................,.3;: iii ~Pres. jAbs. c ....c . . . , ••.•., . . _ ._ _ 155\ Tardy 11111 ig! Bj J " N N w READING F ru~msuiicui:1.:dm:ri!'.:r.r.m1mwm1;:1;,.a~P.;:fn~1t!1mnmH!ftnmmmmm~i~.mmmmm:rnm!!:::J;m~m,;.:ma~ SCHOOLS\PChangas Resuits(data) may vaty based on your permission Run Date: 8/18/2016 9:48:20 AM Confidential Information - MNPS 'ME_'~~r.)~~.At:.r.:J".· ,tHe C:$.,~lt;991.~ Metropolitan Nashville Public Schools Virtual Data Wall Page 2 of 5 Quintile(Q): Data Guide Available School ; Music City Elementary School Enrollment Year: 2015-2016 ii!i ;mrn 2 1 3 mHlJJ4 Its Enrollment Grade: 4 Assessment Subject: READING Meeting Pattern: 2M-F Class Student Status: All Active Students Only Counselor: Smith Course: 4 Eng Lang Arts Lit Y Teacher: Jones 1:i...icl· Lastname4, Firstname4 1····•·••·...,.... _ %ile Lvl Oi[Attendance·······•·,,.,,99%l Lastname3, Firstname3 f · ··· .':.~'.(:.. ,!~;!;CAP Enr. Grade ED LEP SWD Ethn Gender 4 ii DB 1 Ill [,062 lllij I Lvl a:~Attendance 913°/4!! !: 14115 TCAP !/!)~~ jt~i!~i,t !TVAAS ~tllJ~Jt \DB 1 Im] 3 jnB 2 Bl 3 =:ri~~~ia~~~~...····--1~J! 3 5J:#Entries 3 5/,,."""""-·-.. "'···-··-·······............., ,.!Pres. 153JTardy 111 1--•-•Y•••••---..,.,,,,.,.._~_.,..,~"""""'""~"'"''-____,,,..,,.~,J y · ~-~~;._ j 6l 1 ......J M 4 "'---·-------·-')Abs. y READING 14/15 TCAP TVAAS 1 21 ·······"'"···...·......_.~_ _ H F ~mm~ ·- ~J~6 rlfjiii!? . j5z 5ik·""''"'""'"""~-·-·""--···....·, :,1Pres. 168jTardy Oj N N N N w ! ! 4 itois. (ISS/OSS) o l_t... ,.,,..•.,,,,,., ...,, ...... ,.a,~,~=--...-, .....~..,..,..,_,..,1 4!Cumulative S&I 5il#Entries ;;~:~i,;::;~;; ·l':i:Y":?i:-i!E"::"::::::;~~:::::::.: ::-::.:.:::::~:.:-:..::~'.~•:.'.~'.'.~'. :/0::/; 'C!dC!:l~'. :·, '- - - Lastnames, Firstname5 · ··· ·· · · %ile Lvl o~•~,A_tt_e_n_d_a-nc_e_ (" 4 J i·• !l.!?J.:::,Jt~~!2~~L-naca..2:i :i 3jCumulativeS&I 2 3 j #Entries 2 3! 18 1 -:= " t~ ".::1a•»~•=•h•<:..a>u,,...,.,, ,.-.r;,t'>'<,-"'1-....... .....,_---.. . . . . . . . ,-.~-n---J1~;:~-···:~_;) ' 97% Tardy 1=,'.;. J[i! y N H F READING ~~1:::ril!im~;;m1mfu~~alumi:Pl!il;if~:.!s.-E:m:!mmmmw.m~mm:m:!::,mm~m~:m!mn~ur21as~r:i:!1 SCHOOLS\PChangas Results(data) may va,y based on your permission Run Date: 8/18/2016 9:48:20 AM Page 2 of 5 Confidential Information - MNPS Use Only Metropolitan Nashville Public Schools Virtual Data Wall Page 3 of 5 !Bl Quintile(Q): Data Guide Available School : Music City Elementary School Enrollment Year: 2015-2016 ~ill 1 3 2 l~ffJ 4 ii( s Enrollment Grade: 4 Assessment Subject: READING Meeting Pattern: 2M-F Class Student Status: All Active Students Only Counselor: Smith Course: 4 Eng Lang Arts Lit Y Teacher: Jones .jo\:)...;~;~; :~:i:/£;::::~;:::::;;;~:;;:~:_-:" • - -'-' .:.;; •- _- :: .::~ .- =, - - •:'.'=-:a:,::·; :~l:~;::::~C'.?.:":-:::=;•.'~!_::;: , Lastname6, Firstname6 . .. %ile 14/15 TCAP \{if( Lvl 'aifAttendance . %ile of:: I ::1~:.:ti,•S&I . 4:: :,;:Pres. . .... ,... .-,..~.,.=.c""=,.,..,..,,•••••...,,.~.--.... y }LEP ;;swo READING ::) \ Ethn )Gender Lvl Q~:Attendance }LEP i',swo ')'Ethn } Gender %ile 87%i(;i n! 14/15 TCAP TVAAS DB 1 DB2 ~~ N N w READING{ B '.:t~ Gender F :.;:~;;(_;; :::'.iJ~~=:::::::::::i::::: ;~:: ;:-::,: :;-;~;;.:_,~;;:.;;,:~:1:1: i::::;:r..: SCHOOLS\PChangas Results{data) may vary based on your permission ::;'! :; i-l:ic;!-;,E::.::.::.:,~l~ ;~,.$~ - 14/15 TCAP TVAAS c·::.@ •:-;:"::: 1·.""""·"-........_.,.,,............99% -....-1 - 9l 3\\ois. (ISS/OSSJ .............. 3;CumulativeS&I 1 2 4j#Entries 2 4;, ~ L.........................-.........._................,~:;~:.... 1 ,. ' -~-~;L: ~. . -~ll1\ f READING - ,. ·.•., ... _... , ... · .,~ .. Lvl alHAttendance - 31~Dis. (ISS/OSS) 3liCumulat~e S&I 2 3 !i #Entries 100% l~ I I READING \ ;; :;!_,~..-.; - , -, --- - .::;~:;:;::::::-:::::i;;=;~,- Lvl O]iAttendance 100%[ '"::47 - 3fiD~s. {lSS~OSS} -·-~-...o~ ??53' - 3l Cumulative S&I 1 · E 3 5 !#Entries { 1 ,: ~ F -.:. --.... -===-~ .... --- '.1/oile o!:~ 3 5 ', ....... -.. --, . ···-..··---·-.,}; ,!:Pres. 169/Tardy 1h 4 '-···--..·-.,-··-····--··-----·-':,Abs. F• O,! ,.,, N •·',; N N ::: '·- ·!c,~i,-:~·-:_ •c.:.:::::::::::;=;;-:~;.-:, - - · ·. . Lvl Q [Attendance · y Lastname10, Firsname10 'J~_:7:1~!! . . . . . . . . . . . . . .- . - - - N H , ~~;•./ ;(c;:;,::i ;~i::!.'.:;:;:L'.':T!:;:t: •:-;-, ."; ,) '.,j · ]-; 0.! 0'..;:2:;,;::;:::::i:=";'":'. ~L.................... ___ :-+.!:::c:~::;;:J:-EF:i:::"::::·•.'7'.i:'t~ F ,ijl;i, \\! ~~:;: ~. ; i~Ii;!~:~es:~,. 8 %tie ·~~-l~~-,. ,.-_._ _ . ."2~ -----......,.... -. s-~-~~: :.:·::;:""\"::':·.=;7; :71•:-;: _,,.,;; 0;;::::z.:::J::::?;;::-_;:-~c;c %ile ........... N N A --=;=r;;:;,, ;cl~:~;;.:~;= .:.;::;::;:~!:":?:::'::"::".''.'::':: -:::'! :i!~i,C;:c'.: i::!:J::::.?..::?.';::;;•.'':'.~'7\.;<:::~\:=(:,1-:~: ~l:::~i:0:5.::.:.: .astname9, Firstname9 :i 99%1{ ! N A -------••w~•:j 3 5 ii,~......................,................._:~: f)Pres. 168(Tardy o// 8:Ei r! . . . . . ". ___. ..J!/ M Lvl o;tAttendance ;;~:·;;:··- astname8, Firstname8 3\ID~s~(ISS/OS~>... ........,.. ol{ 3/Cumulative S&I 1 •· 2 4 #Entries 155iTardy ~ '··---·-··-·•----...................---·-···"J~~.:..,_. ___ ;;:~;-;·;;··: ----..,..-=->r:------ . 96°/4])) -- 3~Dis. (ISS/OSS) ..._,., ...... . DB 2 Grade ED 4 y ~ y SWD Ethn N A M Jl]i'jl! 2 4! L..-.. . . . . _____~~~. -,'.. . . . . . . .JjPres. 1691Tarcly ~ 1Abs. Of '·---······ .. ·····•··"··· 1ji;l ,ii ::: ', jj READING) ,;_ ... _... ,_,,_ drs\(••. e, Run Date: 8/18/2016 9:48:20 AM Confidential Information - MNPS Use ()~fy' X' Metropolitan Nashville Public Schools Virtual Data Wall Page 4 of 5 Quintile(Q): Data Guide Available School : Music City Elementary School Enrollment Year: 2015-2016 & :~J 2 1 4 :1115 Enrollment Grade: 4 Assessment Subject: READING Meeting Pattern: 2M-F Class Student Status: All Active Students Only Counselor: Smith Course: 4 Eng Lang Arts Lit Y Teacher: Jones j/'.jCC;\c!:; i/~);'.0 ;:'. ;,:;{~~;~:;;_~::i:i::::~:~ ;;;:;.;;;:-;:_';:;::°;i-':[1i!C ~~~J:r.,,,t<.W:~~ui!..1:ffi.~f.r:f:.~~j'.tl}';l:l::!!t~~~;t!mn;t:.E;S:5::i~U~P:.m~.rif'iQ~ Lastname13, Firstname13 ,stname12, Firstname12 --··ss%};( 1 2':"Dis. (JSS/OSS) .r---••·*" ..... ".......... "'. ·"" -·.-ol}.... ¾ile %ile Lvl "ci]i/Attendance iifam;.;i ;;Ii~ ;,;:A;f 3![ Cumulative S&I :~r. Grade 2 ::, /", ---··---.i;:;::~T:~~-ji j';LEP N 1iswo N \Ethn (Gender B M 0 DB 1 :DB2 I ~. ,?52 -· { DB 1 2 3f fri=:;~-;;·:·------1·siifi-i;rc1y="'1·· DB .· . 'I~..t?~.:....... ~J___________ .. 2 % •• •~"h< .. 3/,f (Abs. ¾ile --- 14/15 TCAP ;?;~;/l T\/AAS ~~~ DB 1 · 1 i#Entries -~ ~--·r Lvl Q:,Attendance - ~ ]~Dis. 2 (ISS/OSS). 2 Cumulative S&I 1 i #Entries iifj~/i Lastname17, Firstname17 N" 88%f Tardy,--,_, 6< w N N H F M N N ¾ile t , c - - .. - ~t 10 14/15 TCAP T\/MS f'.. IDB 1 Ds2 1 _ 2 2j _Chronic A~!!!:'.!:!........ •..J!Pres. 148!Tardy 1 ~ - - - - - - - - · !Abs. 21l DB 2 J,-P-re_s____ 16~4~i )Abs. ' 10j READING -~~ l!Dis. '--~------- r ½>"<->"<<'<'' 23 ---! Lastname16, Firstname16 2 fb....::...•.._•--~'"-(ISS/OSS) 2\ Cumulative S&I 2 3j Ethn Gender Lvl Ol[Attendance 94°/; - 2 I\Dis. (ISS/OSS) .,_>0 ~."tY,C"tT,•>'•":t"->'-,»,;•,- ►2 l Cumulative S&I 1 :[f:q~I 2 4j#Entries 1 '"'A'·· t :c:;:. :3 l:iPres.-" 157[Tardy........ N H mi_.,.....~ l ~&! - SWD Wl!llii 2 (ISSl?SS) """""""= 0 _ 2 [ Cumulative S&I 2 1 1 [#Entries 1 y astname15, Firstname15 ¾ile Lvi Q i1!A-,-tte-n'"'d_a_n-ce----:-c-,-,., LEP ¾ile ~;_s. :i#Entries i~ Lastname14, Firstname14 Lvl Qf~Attendance ····--..·---99%1 4 y y N H F if¥~ Lvl Q(!Attendance 97%i dois. (ISS/OSS) 2!l'cumulatfve S&I """' v1. o! 1 ; #Entries 1 2 3( _ 1;.,.--,,·-···,,..,•._, L.............. 11:Pres. ··------''iAbs. 164;,Tardy ,,il sf '~-- ... _______,_ READING Lastname18, Firstname18 ] o/oile Lvl a[JAttendance 96%/ I 14/15 TCAP f~ - 2 !(\Dis. (ISS/OSS) 0 lwAAs ~~ - 2!'cu;,;:;1ativesir·,-·:r I ios 1 IDB 2 [ Enr. Grade ED LEP SWD Ethn ·Gender 4 '1 r y y !mi~ imh~il! ~;,z,.1uc.r. 2 d#Entries 1 1\ 3 4!!t ] r - -................ v.. ..,.,,..~.......~,-·,_,...,.,1.~rn ~Pres. _.., __..,==•=-!}1 ~s_.._ 161iTardy l 6: 3,;ll( iif ,.,,~,..,~.J~! N H F SCHOOLS\PChangas Resu/ts{data) may vary based on your permission READING Run Date: 8/18/2016 9:48:20 AM Page 4 of 5 Confidential Information - MNPS Use Only {MN . ·. .~~,t;r~t~fN . . 8Sr::iYw€ . i?USt.t:C :~¢@'QJiS Metropolitan Nashville Public Schools Virtual Data Wall Page 5 of 5 Quintile(Q}: Data Guide Available School : Music City Elementary School Enrollment Year: 2015-2016 lm]f ~t4 1 2 4 5 5 Enrollment Grade: 4 Assessment Subject: READING Meeting Pattern: 2M-F Class Student Status: All Active Students Only Counselor: Smith Course: 4 Eng Lang Arts Lit Y Teacher: Jones Lastname19, Firstname19 i ·· · f. %ile 1 jDB 1 4 ,. . . ED y y LEP SWD Ethn Gender ~ \t~.ffil - 1jCumulativeS&J 2 2\#Entries 1 1 1~~6! 2 2!,j:,,.._..,"""""""·•••..-•-.·•·•.-:n,,,.,..:..,..,...... d:ii-:::;;..,. roe2 t .! o/oile I! - 1!)~l\U\~~!~~1?L,,.........~~J !Ji 14/15TCAP 1TVAAS Enr. Grade Lastname20, Firstname20 99% l t Lvi Q \\)Attendance 168jTardy 1:]Pres. 1j ·-·--··---,-·· ·-··········••... --~ \Abs. 1 --·-·-----··-...........---•·"·-·~ Lvl· oWt-ttendance·- 1 ]fois. (ISS/OSS) 1 rcu~~lative S&I 1 \#Entries 1ii 4 ')..,.,.-,.,..,..,_~_,..,..,.,..,,....,,.,.. ,..,.,.....,..._,....,.,.,,..w..,.,..,~,-,,,.,Ji!~iPr~. \Abs. y astname21, Firstname21 %ile Lvl A_tt_e_n-da_n_c_e_ v~.-,, 1 14/15 TCAP - 1 ![Dis. (!SS/OSS)_..<,,.oi TVAAS ~ - 1 j Cumulative S&I 39 2 4l#Entries DB 2 jfg~B!✓' 2 2!:t~ ,,.,.,,1- -"'~••'"'· _..,,....................,s.. .. _..,. 100%' 0 1 168JTardy ~ 0\ 2J 1) s ··••··--·-·-·~·-··-··-· N w o/oile 14/15 TCAP - Lvl Q11Attendance 95%. 1 llDis. (lSS/OSS) 0 ~i........,..,... ___ ,....,,,~._,.,.......,.,...... ,..,,...,.,,l 1 '; Cumulative S&I 13 I DB 1 DB2 . 1 /#Entries •f Enr. Grade 4 ; ........., , ,_., ED y LEP SWD Ethn Gender N N 8 M iiPres. __ ,..,,..• ...--------· "··~-.... ~ 1 ,Abs. 1SOiTardy · ·11 9l j ---~- 1--.... ~~--- ... , . ~----Im~ SCHOOLS\PChangas Results(data) may vary based on your permission . , 139/ Tardy 1 Abs. , ...12' ~-........... ::i.-..... -... - ..... ,,,..JlPres. READING Lastname, Firstname23 astname22, Firstname22 14/15 TCAP t,-, ..····••w·...~.........-,. N B M ~ O O P - " a_ __ F %ile 4 y "' N y N H al-- llllli!l 4' y !!fro~ l~~ Lvl Q!i¼ttendance 96%:: 1 \~pis. p-,-.,..,,,,...(ISS/OSS) ~........,_,_'"! .... 1 f Cumulative S&I 1 2J#Entries 1 2\ - ---·---·..··"""'"'--"" .• ot 1 1 ·.n'd ...,...- , •• ,..,.~ l1Pres. ::Abs. 164jT~rdy 6/ _, "" ~ y N H F Run Date: 8/18/2016 9:48:20 AM READING Page 5 of 5 Confidential Information - MNPS Use Only Data Warehouse Report Example Teacher Profile (1 page) Metropolitan Nashville Public Schools Teacher Profile School Year: 2015-2016 Page 1 of 1 Teacher: Srnith School: 999 Music City Elementary School A-Abs-Unex 27% Hispanic or Latino E-Ex Abs 20% Black or African Arnerican jD-Erly Dis 19% ! /BE-Bus ExAb 3% (BU-Unex Ab 0% 341 44% ,----- . . . . . . . . ·-·-·-····---· --------·-·------,.---· ------- -----·------··---- -- ·-·-·-··--·--. .. . - Grades by Marking Period - --------------------~-----~ ----··------- -----··----·-••,.----.---------.--·---~-,--~--: ---- JI A ~li B [] C 31% 32% (22) (23) 29% 28% 25% (20) (19) (17) .---- Teacher Behavior Referrals ,NciBehavior Referrals Ava1iabfe"--------------·-·-----·---·..··-·-···~· ---·=··---·------ -.-----·---· ~- ·-. j ( ' 1 -----•••--•---•••--------•-••-••-•-----••.,.......,,,,..,.,~•-r,-•"••·•·•••--~• • ••-•'--'---'• - ••---••--~•--•••-•-•~• SCHOOLS\PChangas Results(data) may va,y based on your permission RLin Date: 8/21/2016 9:16:55 PM +•••• •••---~-*•-- ~ Page 1 of 1 Confidential Information - MNPS Use Only Reid, Nicole R From: Sent: To: Cc: Subject: Changas, Paul Tuesday, August 23, 2016 8:53 AM Russell, Toni M Hansen, Laura M RE: District Assessment Discussion I will come to your office. The first district benchmark assessments are scheduled to begin on 9 /26. I scheduled a meeting at noon today with Dr. Felder and the others copied on her email at her request to discuss the ramifications if we were to suspend the first benchmark test administration. From: Russell, Toni M Sent: Tuesday, August 23, 2016 8:44 AM To: Changas, Paul Cc: Hansen, Laura M Subject: Re: District Assessment Discussion Thanks, I am eager for us to talk. I don't know what the 9/26 window is about. Sent from my iPad On Aug 23, 2016, at 8:31 AM, Changas, Paul wrote: I am forwarding an email from Dr. Felder that came late last night. I am not sure what this means, but Key Data Systems may be working with Performance Matters to provide the item bank. Paul From: Felder, Monique T Sent: Monday, August 22, 2016 11:28 PM To: Changas, Paul ; Weber, Chris ; Mccargar, Julie ; Petty, Jill G ; Jones, Katea J Cc: Williams, David S Subject: RE: District Assessment Discussion Greetings, Paul and Team! I am beyond thrilled to announce that this evening we identified a company that can provide the district with full aligned items for our benchmark assessments in time for the opening of the Sept. 26th window!! Key Data Systems will support us in this effort and ensured us that they can meet our deadline. Whew!!! Many thanks for your willingness to meet and to Paul for organizing! Best, Monique 4 Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org "For these are all of our children ... We will profit from or pay for whatever they become." Baldwin -----Origin a I Appointment----From: Changas, Paul Sent: Monday, August 22, 2016 12:29 PM To: Felder, Monique T; Weber, Chris; Mccargar, Julie; Petty, Jill G; Jones, Katea J Cc: Williams, David S Subject: District Assessment Discussion When: Tuesday, August 23, 2016 12:00 PM-12:45 PM (UTC-06:00) Central Time (US & Canada). Where: Teaching & Learning Conference Room (3rd floor - contact Katea Jones if you need assistance locating) Importance: High The purpose of this meeting is to discuss the pros and cons of suspending the first administration of the district benchmark assessments (scheduled for Sept. 26-30) and any potential impact (e.g., monitoring school performance, academic magnet qualifying, etc.). The meeting location will be provided later. 5 Reid, Nicole R From: Sent: To: Subject: Changas, Paul Wednesday, August 24, 2016 4:19 PM Russell, Toni M RE: Meeting w Performance Matters Thanks. I found out early this morning he was in meetings outside of the office and spoke to his purchasing manager, Chris Anderson. I got the information from Chris I needed pertaining to NWEA and have since also had some communication with Gary via email. Paul From: Russell, Toni M Sent: Wednesday, August 24, 2016 2:22 PM To: Changas, Paul Subject: FW: Meeting w Performance Matters See below. Gary told me he would be out of the office today and tomorrow. T From: Henson, Chris M Sent: Wednesday, August 24, 2016 1:50 PM To: Russell, Toni M Cc: Appenfelder, Gary Subject: RE: Meeting w Performance Matters Connecting Gary - From: Russell, Toni M Sent: Wednesday, August 24, 2016 11:36 AM To: Henson, Chris M Subject: RE: Meeting w Performance Matters Performance Matters is planning to send us documentation related to questions we asked today. I have to ask are we allowed to take information from these guys? I am nervous about these discussions with these guys without any RFP. From: Henson, Chris M Sent: Wednesday, August 24, 2016 8:03 AM To: Russell, Toni M Subject: RE: Meeting w Performance Matters Thanks. Sent via the Samsung Galaxy S®6 active, an AT&T 4G LTE smmiphone -------- Original message -------185 From: "Russell, Toni M" Date: 8/24/16 7:58 AM (GMT-06:00) To: "Henson, Chris M" Subject: Meeting w Performance Matters Chris, FYI I think you know this but to be sure, TIS has been asked to meet with Performance Matters this morning for 2 hours. I arranged support from my team at Paul's request from meeting with Dr. Joseph, Monique and Sito. Toni M. Russell Executive Director of Technology and Information Services Metro Nashville Public Schools Office Phone: 615-259-8433 186 Joe Joe Bass External Communications Manager Metro Nashville Public Schools 515 25 428 ose 355 mn sor SCHOOL CHOICE "Wm? rise) MNDEOHGISCKUOLCKOIEEFEST Find us on Facebook and Twifier! streiegie communication mmrisiie anenger Fram1Changas, Paul Sent: Friday, September 15, 2016 9:14 AM eber, Chris; Bass, Joseph A Subject: FW: IMPORTANT- Assessments lam forwarding an email from Dr. Felder, The third bullet says we will use the benchmark assessments as a measure for academic magnets. This is a change from earlier in the week and I do not know what the plan is now. Paul From: Felder, Monique Sent: Friday, September 16, 2016 12:32 AM To: Changes, Paul Williams, David • • • Fall administration is required; winter and spring are required unless a school has another standards based assessment (i.e., ANet); next year all 3 administrations will be required-no opt outs. We will not use the Benchmark Assessments as a measure for the academic magnets. Which office typically drafts memorandums regarding notifying schools about matters concerning assessment administration? Not sure if it's your office, my division or a combination. I honestly don't know the answer to this question and just don't want to overstep anyone's responsibilities. If a combination or your office, could you start the draft and punt to me for review, input and feedback? I am attending the BOE retreat for the next 2 days and will have little time to draft it. David has put together a document that could be part of the overall communication. (David, please send what you have including the examples. Thanks!) The communication needs to be sent to principals by Tuesday as the assessment window opens on the 26 th • Vision Statement • Does your office have a vision for assessments? If so, please share. Performance Matters & NWEA • • Performance Matters. Dr. Joseph wants to pilot Performance Matters in the Priority Schools. Can you reach out to Rocky and/or Amy regarding next steps? Please advise. Thanks! Where are we with NWEA? Please advise. Thanks! Thank you for your continued support and good cheer! Best, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org Office:615-259-8690 *Connectedness*Learner*Achiever*Relator*lntellection*lnput ''For these are all of our children ... We will profit from or pay for whatever they become." Baldwin 48 Reid Nicole From: Carlisle. mm Sent: Monday, September ie, 2015 3:00 PM To: Changas, Paul Subject: RE: Assessments Hi there, Hope all is welL Let me know 'lfyou need me to weigh in on any ofthis. Thanks. iana 1mm L. Cm'fisk, $1.3 Chief of Staff Metro Nashville Public Schools 7.501 Bransfurd Avenue Nashville, TN. 37204 Office 415-259-8734 Mobile - -- Sent: Sunday, September 18, 2015 11:23 PM To: Felder, Monique to: Williams, David 5 Carlisle, Jana Hensun, chris Subject: Re: IMPORTANT- Assessments Dr, Fielder, iwill be happy to work with katea to schedule this meeting. Thank you. Paul Sent from my iPad on Sep 15, 1016, at 1111 PM, Felder, MoniqueTahead and remain ahead on the assessments and all that is needed to ensure successful implementation, etc. Do you want to schedule the meeting or shall I? Thank you, again ... Best, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org Office:615-259-8690 *Connectedness*Learner*Achiever*Relator*lntellection*lnput "For these are all of our children... We will profit from or pay for whatever they become." Baldwin From: Changas, Paul Sent: Friday, September 16, 2016 12:35 PM To: Felder, Monique T ; Williams, David S Cc: Carlisle, Jana L ; Henson, Chris M Subject: RE: IMPORTANT-Assessments Dr. Felder, I apologize in advance for the very long email below, but I am attempting to address the various questions you raised in your email. I am copying Mr. Henson in addition to Dr. Carlisle, as several of these issues involve his departments. Benchmark Assessments With respect to benchmark assessments, I will have to defer to IT regarding bandwidth and the number of computers, but we have successfully administered online interim benchmark assessments district-wide within a two-week window on multiple occasions in the past. It is important that schools do not wait until the last few days of the test window to try to administer all of the tests, however, or there may be capacity issues within the school. I know you included John Teeter from IT in a separate email regarding this issue, and he can better speak to capacity. Thank you for the follow-up with regard to academic magnet qualifying. While the use of new, shorter benchmark assessments is not ideal for this purpose, the state's cancellation of spring testing left us with few options this year. While we will not be able to truly validate these assessments until the spring, given that last year's benchmarks correlated pretty highly with the 2015 TCAP and the new item bank appears to be better quality, I believe it will hold up OK. For most students it will be one more option rather than the only way to qualify. Communication regarding assessments has been a shared effort with your division. My office typically communicates with schools regarding most state mandated assessments, but the EL office and Exceptional Ed office in your division generally take the lead pertaining to assessments specific to their populations. When the district was using Discovery Education Assessment (DEA) as our interim benchmarks, our office oversaw the test administration process and provided almost all of 2 the communication. The previous Chief Academic Officer decided to develop benchmarks in house last year utilizing instructional coaches, and your division took the lead in communications to schools. Kelly Wade, as the person in IT who oversaw SchoolNet, had a key role in the administration process and also routinely communicated with schools. My department assisted in developing the test blueprint, analysis and reporting of results, and our data coaches provided PD pertaining to the use of the SchoolNet item bank for classroom assessments. The bottom line is that my staff will be happy to assist in any way we can and we can discuss how to most effectively work jointly on these efforts. Decisions such as which district assessments to mandate are made in your division and my office plays a support role in the administration of those assessments. Vision Statement My staff would love to work jointly with your division on a vision for assessments in MNPS. We have had numerous conversations over the years regarding what we would like to see. But given our limited role in decision making with respect to district mandated assessments, my team has not crafted a statement. However, from past conversations I believe we would all like to see a comprehensive but balanced assessment system that includes summative, interim benchmark, and classroom formative assessments that are aligned - to state academic standards and to each other. Such a system should support visible change in the instructional process and help students reach learning goals. I do not think our assessments have always been as well aligned or coordinated as they should - in part due to a tendency to respond quickly to various initiatives rather than laying out a long-term plan. As a district I believe we can also do a better job of communication and training with teachers regarding the role/use of each of the various assessments that are required. Performance Matters & NWEA I will reach out to Performance Matters. I have spoken with Gary Appenfelder in the Business Office to confirm that we do not need a solicitation to pilot an assessment in some of our schools. However, he cannot execute a contract until a funding source is identified. Gary also added that should we make a decision to go district-wide with a new instructional management system, we would need to issue an RFP. at that time. Toni Russell is out of the office today, but I spoke with Lance Lott in IT and he will brief Toni on Monday to begin conversations with Performance Matters in order to develop a plan and timeline for a pilot implementation. With respect to NWEA, Gary Appenfelder says he has some of the documentation he needs from Shelby County in order for us to buy off their contract. He is still waiting for additional information he needs, but based upon his conversations with his counterpart there, he is pretty confident that we will not need a solicitation. As with Performance Matters, he will need a funding source before a contract can be executed. We do not yet have a cost estimate based upon Shelby County's contract. NWEA did send me a separate cost estimate this week, which I have shared with Gary so that we can compare to the Shelby County contract. The standard per student fee for MAP is $13.50 per student, but we previously received a quote of $9.50 per student for both Reading and Math. Unfortunately it only drops to $8.00 for just Reading. That comes out to about $380K for grades 2-8 for the assessment, with a separate $75K indicated for professional development. The PD cost seems high and hopefully district staff can provide some of the PD. In the meantime, my office is working on a plan for rolling out NWEA that includes getting in front of principals, test coordinators and/or teams from each school. Thank you. Paul Paul Changas Executive Director Research, Assessment & Evaluation 3 Metropolitan Nashville Public Schools Office: 615-259-84<30 Strengths: Individualization -Analytical - Learner - Relator - Responsibility From: Felder, Monique T Sent: Friday, September 16, 2016 12:38 AM To: Changas, Paul ; Williams, David S Subject: IMPORTANT-Assessments Importance: High Hi PaulWe are in the midst of finalizing the Benchmark Assessments • • • • The new window will be Sept. 26 through Oct. 14th to include all make ups (need to ensure we have the bandwidth, etc. in IT to administer ... Do schools have enough computers?) Fall administration is required; winter and spring are required unless a school has another standards based assessment (i.e., ANet); next year all 3 administrations will be required-no opt outs. We wiHnot use the Benchmark Assessments as a measure for the academic magnets. Which office typically drafts memorandums regarding notifying schools about matters concerning assessment administration? Not sure if it's your office, my division or a combination. I honestly don't know the answer to this question and just don't want to overstep anyone's responsibilities. If a combination or your office, could you start the draft and punt to me for review, input and feedback? I am attending the BOE retreat for the next 2 days and will have little time to draft it. David has put together a document that could be part of the overall communication. (David, please send what you have including the examples. Thanks!) The communication needs to be sent to principals by Tuesday as the assessment window opens on the 26 th • Vision Statement • Does your office have a vision for assessments? If so, please share. Performance Matters & NWEA • • Performance Matters. Dr. Joseph wants to pilot Performance Matters in the Priority Schools. Can you reach out to Rocky and/or Amy regarding next steps? Please advise. Thanks! Where are we with NWEA? Please advise. Thanks! Thank you for your continued support and good cheer! Best, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org Office:615-259-8690 *Connectedness*Learner*Achiever*Relator*lntellection*lnput "For these are all of our children... We will profit from or pay for whatever they become." Baldwin 4 Hi PaulWe are in the midst of finalizing the Benchmark Assessments • • • • The new window will be Sept. 26 through Oct. 14th to include all make ups (need to ensure we have the bandwidth, etc. in IT to administer ... Do schools have enough computers?) Fall administration is required; winter and spring are required unless a school has another standards based assessment (i.e., ANet); next year all 3 administrations will be required-no opt outs. We will not use the Benchmark Assessments as a measure for the academic magnets. Which office typically drafts memorandums regarding notifying schools about matters concerning assessment administration? Not sure if it's your office, my division or a combination. I honestly don't know the answer to this question and just don't want to overstep anyone's responsibilities. If a combination or your office, could you start the draft and punt to me for review, input and feedback? I am attending the BOE retreat for the next 2 days and will have little time to draft it. David has put together a document that could be part of the overall communication. (David, please send what you have including the examples. Thanks!} The communication needs to be sent to principals by Tuesday as the assessment window opens on the 26 th • Vision Statement • Does your office have a vision for assessments? If so, please share. Performance Matters &. NWEA • • Performance Matters. Dr. Joseph wants to pilot Performance Matters in the Priority Schools. Can you reach out to Rocky and/or Amy regarding next steps? Please advise. Thanks! Where are we with NWEA? Please advise. Thanks! Thank you for your continued support and good cheer! Best, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org Office: 615-259-8690 *Connectedness*Learner*Achiever*Relator*lntellection*lnput "For these are all of our children ... We wiff profit from or pay for whatever they become." Baldwin 37 Best, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Mon iq ue.Felder@M NPS.org Office:615-259-8690 *Connectedness*Learner*Achiever*Relator*lntellection*lnput "For these are all of our children ... We will profit from or pay for whatever they become." Baldwin From: Changas, Paul Sent: Friday, September 16, 2016 12:35 PM To: Felder, Monique T ; Williams, David S Cc: Carlisle, Jana L ; Henson, Chris M Subject: RE: IMPORTANT- Assessments Dr. Felder, I apologize in advance for the very long email below, but I am attempting to address the various questions you raised in your email. I am copying Mr. Henson in addition to Dr. Carlisle, as several of these issues involve his departments. Benchmark Assessments With respect to benchmark assessments, I will have to defer to IT regarding bandwidth and the number of computers, but we have successfully administered online interim benchmark assessments district-wide within a two-week window on multiple occasions in the past. It is important that schools do not wait until the last few days of the test window to try to administer all of the tests, however, or there may be capacity issues within the school. I know you included John Teeter from IT in a separate email regarding this issue, and he can better speak to capacity. Thank you for the follow-up with regard to academic magnet qualifying. While the use of new, shorter benchmark assessments is not ideal for this purpose, the state's cancellation of spring testing left us with few options this year. While we will not be able to truly validate these assessments until the spring, given that last year's benchmarks correlated pretty highly with the 2015 TCAP and the new item bank appears to be better quality, I believe it will hold up OK. For most students it will be one more option rather than the only way to qualify. Communication regarding assessments has been a shared effort with your division. My office typically communicates with schools regarding most state mandated assessments, but the EL office and Exceptional Ed office in your division generally take the lead pertaining to assessments specific to their populations. When the district was using Discovery Education Assessment (DEA) as our interim benchmarks, our office oversaw the test administration process and provided almost all of the communication. The previous Chief Academic Officer decided to develop benchmarks in house last year utilizing instructional coaches, and your division took the lead in communications to schools. Kelly Wade, as the person in IT who oversaw SchoolNet, had a key role in the administration process and also routinely communicated with schools. My department assisted in developing the test blueprint, analysis and reporting of results, and our data coaches provided PD pertaining to the use of the SchoolNet item bank for classroom assessments. The bottom line is that my staff will be happy to assist in any way we can and we can discuss how to most effectively work 39 . jointly on these efforts. Decisions such as which district assessments to mandate are made in your division and my office plays a support role in the administration of those assessments. Vision Statement My staff would love to work jointly with your division on a vision for assessments in MNPS. We have had numerous conversations over the years regarding what we would like to see. But given our limited role in decision making with respect to district mandated assessments, my team has not crafted a statement. However, from past conversations I believe we would all like to see a comprehensive but balanced assessment system that includes summative, interim benchmark, and classroom formative assessments that are aligned - to state academic standards and to each other. Such a system should support visible change in the instructional process and help students reach learning goals. I do not think our assessments have always been as well aligned or coordinated as they should - in part due to a tendency to respond quickly to various initiatives rather than laying out a long-term plan. As a district I believe we can also do a better job of communication and training with teachers regarding the role/use of each of the various assessments that are required. Performance Matters & NWEA I will reach out to Performance Matters. I have spoken with Gary Appenfelder in the Business Office to confirm that we do not need a solicitation to pilot an assessment in some of our schools. However, he cannot execute a contract until a funding source is identified. Gary also added that should we make a decision to go district-wide with a new instructional management system, we would need to issue an RFP at that time. Toni Russell is out of the office today, but I spoke with Lance Lott in IT and he will brief Toni on Monday to begin conversations with Performance Matters in order to develop a plan and timeline for a pilot implementation. With respect to NWEA, Gary Appenfelder says he has some of the documentation he needs from Shelby County in order for us to buy off their contract. He is still waiting for additional information he needs, but based upon his conversations with his counterpart there, he is pretty confident that we will not need a solicitation. As with Performance Matters, he will need a funding source before a contract can be executed. We do not yet have a cost estimate based upon Shelby County's contract. NWEA did send me a sep·arate cost estimate this week, which I have shared with Gary so that we can compare to the Shelby County contract. The standard per student fee for MAP is $13.50 per student, but we previously received a quote of $9.50 per student for both Reading and Math. Unfortunately it only drops to $8.00 for just Reading. That comes out to about $380K for grades 2-8 for the assessment, with a separate $75K indicated for professional development. The PD cost seems high and hopefully district staff can provide some of the PD. In the meantime, my office is working on a plan for rolling out NWEA that includes getting in front of principals, test coordinators and/ or teams from each school. Thank you. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization -Analytical - Learner - Relator - Responsibility From: Felder, Monique T Sent: Friday, September 16, 2016 12:38 AM 40 Donna Donna Mason State Lead, Tennessee 336-601-4669 donna.mason@act.org You~ Empowgred1• This is a promotional message. Unsubscribe: To unsubscribe from all promotional messages from ACT, Inc. please use this unsubscribe link. From: Changas, Paul [mailto:Paul.Changas@mnps.org1 Sent: Monday, August 29, 2016 11:02 AM To: Donna Mason Subject: RE: ACT Data Meeting Donna, I was not aware that you had met with Dr. Felder but I did know that Performance Matters was here last week. I believe Dr. Joseph invited them and they did speak with Dr. Felder and some other district staff, including me. It is my understanding that district leadership will have exploratory conversations with different vendors in the months to come regarding a variety of potential future needs. The district currently develops its own benchmark assessments, but there is interest in either purchasing additional item banks or commercially developed benchmarks. However, these items were not budgeted for this school year and we are likely looking at an RFP process for the 2017-18 school year. There is also interest in exploring options to our current instructional management system, SchoolNet, which is up for renewal late in the current school year. The conversation with Performance Matters was focused on their management system and formative assessment platform. I did speak with Dr. Felder after receiving your email and she will be happy to have you speak further with district staff as we go forward. District leaders are still assessing the current state of our assessments and data systems, including a new student information system. Once they have a better idea of how they would like to proceed, I anticipate an RFP process and an opportunity for vendors to have the same opportunity to present to district staff involved in the selection process. Everything appears to very preliminary at this stage, but I will let you know more as we go forward. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools 145 From: Donna Mason [mailto:Donna.Mason@act.org] Sent: Thursday, August 25, 2016 3:24 PM To: Changas, Paul Subject: FW: ACT Data Meeting HI Paul, I met with Dr. Felder yesterday introducing myself and sharing information on the Grad Class profile for Metro Nashville. Our original conversations were about ACT Aspire because your new DOS asked her to reach out to me. ( I had introduced myself to him via LinkedlN) I saw the folks from Performance Matters there yesterday. They would be a direct competitor for ACT Aspire. Do you know if they were making a presentation to her and her staff? I emailed for a follow up visit asking if we could present ACT Aspire to them, especially since now ACT is required for graduation. Any thoughts? Thanks! Warm Regards, Donna Donna Mason State Lead, Tennessee 336-601-4669 :T~ You. tampower~«~ This is a. promotional message. Unsubscribe: To unsubscribe from all promotional messages from ACT, Inc. please use this unsubscribe link. From: Felder, Monique T [mailto:Monique.Felder@mnps.org1 Sent: Thursday, August 25, 2016 4:01 PM To: Narcisse, Sito J Cc: Donna Mason ; Beasley, Lisa R Subject: ACT Data Meeting Hi Sito, It would be'great if Donna Mason, State Lead, ACT, could meet with our Middle and High School principals as soon as possible. (Perhaps at their September ELP Team meeting.) Donna can review ACT trend data including highlighting specific areas where MNPS' tea need additional instructional focus. Please let Donna know when she can get face time with principals. We will also want to invite her to an upcoming Collaborative, Cross functional & Development Team meeting to ensure our district leaders, who are supporting principals, have the same information. Donna is wonderful and is copied on this email! 146 Best, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org "For these are all of our children ... We wi/1 profit from or pay for whatever they become." Baldwin 147 Reid, Nicole R From: Sent: To: Subject: Mccargar, Julie Wednesday, September 21, 2016 9:57 AM Changas, Paul;Klein, Sage N;Clark, Merrie M Re: Meeting with Dr. Felder regarding assessments I will come. Sent from my Verizon Wireless 4G LTE DROID "Changas, Paul" vvrote: Julie, I am meeting with Dr. Felder tomorrow from 3:15 to 4:15 along with David Williams, Kelly McKinney, Toni Russell and a few others to discuss different department roles and responsibilities in the administration of district and state assessments this year. She asked if I could have someone from "Budget" there, as she would like to discuss possible funding sources. I spoke with Gary Appenfelder ifhe wanted to attend and hear the discussion, but he is out of town and does not want to send someone in his place. Dr. Felder would like to pilot Performance Matters in Priority schools, but I am not sure when that will begin this year and what the expectation will be for those schools with respect to benchmark assessments. I do not know if you are interested in having someone from Federal Programs there, but I wanted to give you the opportunity since Priority schools and budget are likely topics. Let me know if you would like me to send an invite to anyone in your department. We will meet in C408 (Exceptional Ed conference room). Paul Paul Changas · Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-843 O Strengths: Individualization - Analytical - Learner - Relator - Responsibility 36 Reid, Nicole R From: Sent: To: Cc: Subject: Attachments: Changas, Paul Thursday, September 22, 2016 11 :13 AM Felder, Monique T;Narcisse, Sito J Carlisle, Jana L Feedback from Performance Matters Presentation Performance Matters Survey Results 9-2016.pdf I have attached the results from the survey responses we received from the 6-item survey we sent to principals and teachers that attended demonstrations by Performance Matters on August 24. We had responses from 22 school administrators and 10 teachers. As you can see, the results are mostly favorable. Half of the respondents had a very positive overall impression and another 38% a somewhat positive impression from the presentation. A couple of participants were neutral and a couple were somewhat negative. Twenty-seven of the 32 participants would "definitely" or "probably" like to see the district move toward such a system. The attachment includes the responses to the two open-ended questions. There were several positive comments regarding the assessment platform, the reporting capabilities, and the flexibility provided. There were some responses indicating that individuals would need to see more of the product or have a chance to actually use it in order to evaluate. Of course there was not time for participants to see everything available in Performance Matters or to drive it themselves. There were also comments indicating that the purchase of quality items and/ or pre-made classroom assessments to go with the platform would be important. A few individuals commented that they did not see this as an improvement over the current platform, that an instructional component is also needed, or that they would like to see other competing products as well. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization - Analytical - Learner - Relator - Responsibility 34 Reid, Nicole R From: Sent: To: Subject: Changas, Paul Wednesday, September 28, 2016 9:08 AM Stenson, Christine M RE: Performance Matters I do not know much either, other than Dr. Joseph wants the assessment module piloted sometime this year in our Priority schools. I do not know the timeline. I believe the same benchmark assessments we will be administering through SchoolNet will be administered through Performance Matters, but I am not 100% sure. Toni may want to ask Chris Henson to bring this to the ELT. Paul From: Stenson, Christine M Sent: Wednesday, September 28, 2016 9:02 AM To: Changas, Paul Subject: Performance Matters On the table .... No one here really knows what the intent it for this. IT is kind of overwhelmed. Christine {Tina) Stenson, Ph.D. Director of Research and Evaluation MNPS Research, Assessment, and Evaluation Dept. 2601 Bransford Ave, C409, Nashville, TN 37204 christine.stenson@mnps.org Learner I Input I Ideation I Achiever I Individualization 18 Reid, Nicole R From: Sent: To: Cc: Subject: Russell, Toni M Thursday, September 29, 2016 3:46 PM Felder, Monique T;Williams, David S;Changas, Paul Renfro, Douglas;Lott, Lance;Wade, Kelly S;Teeter, John W;Henson, Chris M;Stark, Kenneth;Appenfelder, Gary;Narcisse, Sito J Performance Matters Pilot Monique, David, and Paul, I have been asked to get a meeting scheduled with Performance Matters. Rocky is waiting to hear from me. To ensure an effective use of everyone's time at this meeting, I would like to make sure we are in sync. Some of us have had separate discussions sharing what we know but this distribution team has not discussed this together. A meeting of the parties on this distribution would be beneficial but email responses could answer the questions. My sanity question is always what problem are we trying to solve. With that in mind I ask the following: 1) MNPS wants to have a Performance Matters pilot with the high priority schools later this year. Is there a NLT {no later than) date driving when we do this? 2) Who will be the project sponsor with whom TIS would work establishing the requirements for the pilot? 3) There is a new piece of information impacting this effort. TIS has learned the Professional Development {PD) module of School Net is being sunset at the end of the school year so regardless of replacing or renewing SchoolNet, PD will have to be replaced. 4) Is using all high priority schools considered a pilot or would it be a subset of high priority schools? 5) What is the long term goal {what problem are we to solve)? Is it to understand what it would take to move to Performance Matters, replacing Schoolnet when that contract expires in April 2017? What is School Net missing that the team needs to ensure is in a replacement? Should a beefed up enhanced way of presenting School net and Datawarehouse data (which my team tells me was built from teacher input) be considered as an option? 6) If replacing is the goal, time is of the essence. It will take-time to make such a move and migrate all those years of data. So if that is the desired state, that pilot needs to start sooner rather than later and this answers item 1. If the goal is to replace School net but not necessarily with Pert Matters, I feel urgency for the district to kick start a project starting with requirements definition. 7) I believe Performance Matters told us Shelby and Montgomery counties are using their product so is the idea that would help eliminate/reduce a lengthy RFP process? Thank you, Toni M. Russell Executive Director of Technology and Information Services Metro Nashville Public Schools Office Phone: 615-259-8433 3 From: Appenfeider, Gary Sent: Wednesday, September 28, zois i137 AM To: Russell, Toni M: changas, Paul; Reniro, Douglas; Williams, David 5 Cc: Hansen, Laura Lott, Lance Subject: RE: Meeting Request I talked with Rocky by phone this week. He doesn't know what the intended or expened scope is because (his understanding) the "team" on this end hasn't yet hgured out what specifics to ask him for, So, he hasn't provided any sort of proposal. Just discussed with (presented to?) the team what things he can otter Gary Appenfeider Director of Purchasing Metro Nashville Public Schools 2601 BlansfamAi/snue Nasth/le, TN 37204 office a a she er mnsot PUBUE SCHOOLS From: Russell, Toni Sent: Wednesday, September 28, 2016 9:14 AM To: changas, Paul; Appenfelder, Gary; Renrro, Douglas; Williams, David 5 Cc: Hansen, Laura Lott, Lance subject: RE: Meeting Request l'rn reaching back outto you guys, unless I overlooked it, no one has responded yet I don't want to appear unresponsive to Rocky but i also don't want to set up a meeting with Performance Matters without knowing the scope ofthe pilot, actually coniirming from Gary we are good to go with a pilot with Performance Matters, basically the items below. Any help would be appreciated I don't want Monique to think ii is not responsive. Thanks, Toni From: Russell, Tonl Sent: Monday, September 25, 2015 2:02 PM To: Changas, Paul Appenfelder, Gary Renfro, Douglas Williams, David 5 1) 2) 3) 4) 5) MNPS wants to have a Performance Matters pilot with the high priority schools later this year. Is there a date driver that I don't know about or understand? Is using all high priority schools considered a pilot or would it be a subset of high priority schools? Is the goal to understand what it would take to move to Performance Matters, replacing Schoolnet when that contract expires in April 2017 with Performance Matters? If that is the goal, time is of the essence, it will take time to make such a move and migrate all those years of data. So if that is the desired state, that pilot needs to start sooner rather than later. And if the goal is to replace but not necessarily with Perf Matters, I feel greater urgency to put a project together. I believe Performance Matters also told us Shelby and Montgomery counties are using their product so is the belief that would help eliminate/reduce a lengthy RFP process identifying reqts, identifying candidates, selecting and closing the deal? I apologize for so many questions but I come from a world where we would be writing reqts, putting out an RFP for responses to eval, etc. I get that this may be different if we are able to benefit from an existing contract with a neighboring county. Thanks, T From: Roderick Sams [mailto:roderick.sams@performancematters.com] Sent: Monday, September 26, 2016 9:26 AM To: Russell, Toni M Cc: Changas, Paul ; Felder, Monique T ; Narcisse, Sito J ; Carlisle, Jana L ; Amy Wieland ; Teeter, John W ; Wade, Kelly S Subject: Re: Meeting Request Good morning Toni, I hope all is well. Just wanted to follow up on the previous email. Thanks in advance. Rocky On Mon, Sep 19, 2016 at 11:55 PM, Russell, Toni M wrote: Rocky, I will work scheduling of our team here based on your options and get back to you to confirm. Toni Sent from my iPhone On Sep 19, 2016, at 8:35 PM, Roderick Sams wrote: Thanks Paul for the follow up. Toni, if you and your team are available that afternoon, it would be great. However I understand completely if the 3rd is not a good day due to the break. My additional availability for an onsite meeting include the following days: • • • October 12-14 October 17 October 24-27 2 Let me know which date works best, and I will plan accordingly. Looking forward to the collaboration. Rocky On Mon, Sep 19, 2016 at 6:57 PM, Changas, Paul wrote: Rocky, I have copied our new Chief of Staff, Jana Carlisle, and Toni Russell, our IT Executive Director, on this email. Toni was out of the office last week, but I spoke with her earlier today to let her know that I would be reaching out to you regarding scheduling a meeting or phone call to discuss next steps. I will also be out of the office on October 3, but there should be other staff from my department that are available. However, the primary discussion pertaining to the implementation of a pilot will need to occur with our IT department. I will let Toni address availability of her staff on the 3rd, In speaking with Toni today I know there are some things internally that need to be discussed soon in order to better plan for this year. We have a meeting with Dr. Felder and other key staff later this week that should help in that regard. We will be in touch soon. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8M30 Strengths: Individualization - Analytical Learner Relator - Responsibility 3 From: Felder, Monique T Sent: Monday, September 19, 2016 5:39 PM To: Roderick Sams ; Narcisse, Sito J ; Changas, Paul Subject: RE: Meeting Request Hi Rocky- Sorry for the delayed response ... I will be on leave the week of Oct. 3 rd as that is MNPS' fall break. You should be hearing from Paul Changas shortly as he is scheduling the next planning meeting as we'd like to pilot PM in our 12 priority schools this year. Paul is copied on this email. Mo Carrasco, Ex. Officer, Priority Schools, and possibly members of his team, will need to be invited to the meeting as well. Thank you for your patience and persistence. Looking forward to meeting with you soon! Best regards, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org Office: 615-259-8690 *Connectedness*Learner*Achiever*Relator*lntellection*lnput "For these are all of our children ... We will profit from or pay for whatever they become." Baldwin 4 From: Roderick Sams [mailto:roderick.sams@performancematters.com] Sent: Monday, September 19, 2016 10:20 AM To: Felder, Monique T ; Narcisse, Sito J Subject: Re: Meeting Request Good morning, I hope all is well. Just wanted to follow up on the previous email. Let me know if that afternoon works, and I will schedule accordingly. Looking forward to the discussion. Thanks again! Rocky On Wed, Sep 14, 2016 at 12:08 AM, Roderick Sams wrote: Good evening Monique and Sito, ' I hope all is well. I wanted to touch bases with you regarding the scheduling of a follow up meeting with the Executive Team. We've had some great conversations regarding our Professional Learning platform and have a web demonstration of our Evaluation platform on September 30th. Given this, I felt it would be a good idea to reconvene with the idea of developing a plan that incorporates a phased in implementation that works for the district. Amy and I will be in Williamson County the morning of October 3rd. Would it be possible to meet that afternoon? Let me know a good time and I will plan accordingly. Look forward to coming together again. Thanks! 5 Reid, Nicole R From: Sent: To: Subject: Williams, David S Thursday, October 13, 2016 10:29 AM Russell, Toni M;Changas, Paul Re: Student count for Unify priority schools Thanks for keeping me in the loop on this. I'm happy to join in any conversation and provide support. Safe travels, Toni! David David S. Williams, Ed.D. Interim Executive Director of Curriculum and Instruction Division of Teaching and Learning Metropolitan Nashville Public Schools 2601 Bransford Ave Nashville, TN 37204 Ideation I Adaptability I lntellection I Connectedness I Learner David. Williams2@mnps.org (615) 259-8602 Follow us on Twitter: @mnpsinstruction From: 11 Russell, Toni M 11 Date: Thursday, October 13, 2016 at 12:56 AM To: 11 Changas, Paul 11 Cc: David Williams Subject: Re: Student count for Unify priority schoo.ls Thanks Paul. I think we are all in the same boat, we want to move forward but we need to understand what we can do via a pilot so we can then meet with Rocky. He and I continue to touch base so he knows this hasn't fallen off the radar but we have some internal communication to be done before we meet. Gary is the only person who responded when I presented questions on the Performance Matters topic a week or so ago. I look forward to the internal meeting next week when all the right parties are together. 15 I thought the data on the counts might be available but was not sure so thank you for taking that action. FYI I am out of the office Thursday and Friday in Ohio for my new mother in law's 90th birthday. The new daughter in law needed to be present. Q Toni Sent from my iPhone On Oct 12, 2016, at 11:03 PM, Changas, Paul wrote: Toni, I will give you a call in the morning, but I do not know any more about where this stands since we last spoke except that Gary Appenfelder expressed to me concern about the fact that the Schoolnet contract ends in April and if we are going to replace Schoolnet at that time we need to release an RFP ASAP. Even ifwe pilot Performance Matters, we cannot go district-wide without an RFP. Since enrollment counts are not confidential data are generally available to the public upon request (and included in some recent documents that are public), I will pull the data Rocky requested. I assume he is working on a cost proposal. However, Dr. Felder announced today that these benchmarks will be optional, although I am not 100% certain if that is the case for Priority schools. If we are only going to use Performance Matters to deliver benchmark assessments in Priority schools but not all schools are participating, that would reduce the total student count. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization -Analytical - Learner - Relator - Responsibility From: Russell, Toni M Sent: Wednesday, October 12, 2016 8:01 PM To: Changas, Paul ; Williams, David S Subject: Fwd: Student count for Unify priority schools Paul, I am not comfortable providing data to Rocky until we know what we are doing with Performance Matters. I think the meeting next Friday will get us closer to all understanding the plan. I assume Rocky is talking about the pilot Monique wants worked, right? David I added you to this email so we 3 stay in sync. You guys may know the scope of what is intended but I don't. I don't know if all parties have agreed to the pilot thus we are expected and authorized to provide the numbers. Paul, are you responding to Rocky? Thanks, Toni· 16 Sent from my iPhone Begin forwarded message: From: Roderick Sams Date: October 12, 2016 at 7:24:33 PM CDT To: "Changas, Paul" , "Russell, Toni M" Subject: Student count for Unify priority schools Good evening Paul and Toni, Can you provide the student count for the Unify priority schools project? I need that information for pricing. Thanks, Rocky Rode:rkk Sams, Ed.D. Director, Education Solutions (770) 283-4145 performa~~: matters~ Aeeel!mite Student and Ed1,1e.itor GrQwt;jt www.performancematters.com Register today for 2017 National User Conference: Making it Matter 17 Reid, Nicole R From: Sent: To: Subject: Russell, Toni M Tuesday, October 18, 2016 9:49 AM Williams, David S;Changas, Paul RE: Performance Matters Pilot Do you think there would be any value to some discussion Friday on what we have in the DW and what could be done with that data? I didn't want to take time from the meeting to discuss the DW if you guys know we would be wasting time. My first impression of what I saw with Performance Matters was it was simply a way of presenting data in the DW pretty. From: Williams, David S Sent: Tuesday, October 18, 2016 9:23 AM To: Russell, Toni M ; Changas, Paul Subject: Re: Performance Matters Pilot Hi ToniThanks so much for following up here. Honestly, I don't know the answers to hardly any of your questions. I don't know the rationale for moving in this direction other than our new leadership has experience with it and likes the product. I don't know how schools are being selected to "pilot." / I think PD is a big concern, and I'm not sure if anything can be transferred over to Performance Matters. And I'm not certain of all the repercussions if things don't transfer. I do think an issue that has come up is having a more updated interface for data warehouse, so this platform might be a way to integrate information there and in school net. We also need to run an RFP for an item bank that Performance Matters will host. I have time before 3 today to come by, but will be in the curriculum update meetings the next 2 days. Sorry I can't be of more help at this point - I feel like I'm learning as we go like the rest of us. David David S. Williams, Ed.D. Interim Executive Director of Curriculum and Instruction Division of Teaching and Learning Metropolitan Nashvi/le Public Schools 2607 Bransford Ave Nashville, TN 37204 Ideation I Adaptability I lntellection I Connectedness I Learner David Wi/liams2@mnps. orq (615) 259-8602 Follow us on Twitter: @mnpsinstruction 1 From: Russell, Toni (Tcanussell so Date: Monday, October 17, 2016 at 5:26 PM To: Changas, Paul" David Williams ; Williams, David 5 changas, Paul Cc: Renfro, Douglas Cc: Renfro, Douglas; Lott, Lance; Wade, Kelly S; Teeter, John W; Henson, Chris M; Stark, Kenneth; Appenfelder, Gary; Narcisse, Sito J Subject: Performance Matters Pilot Monique, David, and Paul, I have been asked to get a meeting scheduled with Performance Matters. Rocky is waiting to hear from me. To ensure an effective use of everyone's time at this meeting, I would like to make sure we are in sync. Some of us have had separate discussions sharing what we know but this distribution team has not discussed this together. A meeting of the parties on this distribution would be beneficial but email responses could answer the questions. My sanity question is always what problem are we trying to solve. With that in mind I ask the following: 1} MNPS wants to have a Performance Matters pilot with the high priority schools later this year. Is there a NLT (no later than) date driving when we do this? 2} Who will be the project sponsor with whom TIS would work establishing the requirements for the pilot? 3) There is a new piece of information impacting this effort. TIS has learned the Professional I Development (PD) module of SchoolNet is being sunset at the end of the school year so regardless of replacing or renewing SchoolNet, PD will have to be replaced. 4) Is using all high priority schools considered a pilot or would it be a subset of high priority schools? Within this question are several more important assumptions and sub-questions. A pilot is a limited duration trial in a limited number of schools/classrooms in order to find out if the product/service works and/or is a good fit. If the purpose of this trial is to test whether the product/service would be long term successful for Priority Schools, then this is not a pilot as it jumps to the conclusion without a subset trial, unless equivalent pilots are planned with all other potential providers of equivalent products/services. If the purpose of the pilot is to test whether the product/service would be long term successful across all district schools, then it can be a pilot if (a) a limited duration is defined, (b) a clear evaluation of results plan is defined to determine definitively if the product/service was successful, and (c) if all other providers of same/equivalent products/services are given the same pilot opportunity. A sub-question is, what is the purpose of the pilot? Is it to test the product/service, or is it to get a product into the priority schools quickly? Another questions is, what will be the funding source (federal or operating budget) since we're talking about Priority Schools? If it's federal funds, a discussion of pilot is moot- use of any provider will have to supported by competitive selection. 5) What is the long term goal (what problem are we to solve)? Is it to understand what it would take to move to Performance Matters, replacing Schoolnet when that contract expires in April 2017? What is School Net missing that the team needs to ensure is in a replacement? Should a beefed up enhanced way of presenting Schoolnet and Datawarehouse data (which my team tells me was built from teacher input) be considered as an option? Since the Schoo/net contract ends, the same/equivalent product is either to be continued or replaced or eliminated. Assuming that our desire is to continue with the same/equivalent product, we need either an existing competitively awarded contract for the same product that we can piggyback, or a competitive solicitation. I'm not aware of any contract that we can piggyback on to continue using Schoo/net. Although this is only September, I don't believe replacing Schoo/net by April 30 is possible without guaranteeing a disastrous launch. That may also be true for a timeline of launching at the beginning of the 2017-2018 school year. These statements assume that a solicitation is needed to select/award a provider after April 30. I have no idea how Performance Matters fits into the issue replacing Schoofnet. 6) If replacing is the goal, time is of the essence. It will take time to make such a move and migrate all those years of data. So if that is the desired state, that pilot needs to start sooner rather than later and this answers item 1. If the goal is to replace School net but not necessarily with Perf Matters, I feel 3 urgency for the district to kick start a project starting with requirements definition. Toni's question is basic to the issue. If the true intent is to replace Schoof net, a pilot with anybody is pointless. If we've identified (compliantly} a product to replace Schoo/net, then let's replace. A pilot only delays that procerss since the decision's already been made. If we don't have a compliantly selected replacement (at this moment, we do not), a solicitation to select a replacement needs to start now (estimated time to complete the solicitation is 4-5 months, if we hustle). 7) I believe Performance Matters told us Shelby and Montgomery counties are using their product so is the idea that would help eliminate/reduce a lengthy RFP process? I've contacted Montgomery County. They do have a contract with Performance Matters, but it was not competitively awarded and is for a customized product, so it is of no use for piggybacking. I've inquired at Shelby County today, but have not received a response. Thank you, Toni M. Russell Executive Director of Technology and Information Services Metro Nashville Public Schools Office Phone: 615-259-8433 4 Reid, Nicole R From: Sent: To: Cc: Subject: Stark, Kenneth Friday, October 21, 2016 12:19 PM Felder, Monique T;Williams, David S;Changas, Paul;Appenfelder, Gary;Russell, Toni M;Jones, Katea J;Wade, Kelly S;Teeter, John W;Renfro, Douglas;Stenson, Christine M Henson, Chris M Performance Matters/School Net Follow up Everybody, Thanks for attending this morning. I thought the conversation was very helpful. Let me provide a brief recap of the conversation along with next steps for those that weren't there and so that we can be sure we are on the same page. If your notes or recollections are different please let me know. Discussion: 1) Gary discussed the Shelby County contract with True North Logic and Performance Matters. It appears that the bidding for the contract was focused around professional development, not assessment. This limits our ability to use the bidding of this contract to enter into an agreement for the assessment pieces of the services that Performance Matters offers. We are limited to the services that were historically provided by True North. 2) There was discussion around what the intent of the current project is. The belief is that the desire is to implement the Performance Matters assessment pieces in the Priority Schools in January. There also is the need to replace the expiring SchoolNet Staff Development module. Our current agreement for School Net expires April 1. 3) There was discussion about the timing of the needed RFPs for an IMS (Schoo Net}, LMS (Blackboard), in addition to the PD tracking module that is currently a part of School Net. a. The agreement with Blackboard is believed to expire in June, 2018. The current plan calls for an RFP to be begun in January with award in July and if there is a change from Blackboard there would be approximately one year timeline to allow for a smooth transition with the start of the 18/19 school year. b. The School Net contract as a whole expires April 1. The overall contract could be extended, but the price needs to be determined. The PD portion is slated to end April 1. Kelly checked with her contact during the meeting and was told it the PD portion could possibly be kept alive through December 17. The cost of that is unknown at this point. 4) There was discussion relative to the timing of when the various transitions should be made. If we are going to transition to a new PD software package, Kelly would like to make the transition prior to March 1 so that the new system can capture all of the summer PD. We discussed the reality of that time line and whether a back-up plan needs to be in place. Given the shortness of the time line and recent experiences with implementing a new system there was significant support for a back-up. 5) There was discussion around the need to identify resources for the on-going support .of the PD system once it is . in place. And whether much of the ownership that is now undertaken by Kelly should be transitioned to the PD Office. 6) There was discussion relative to the meeting being arranged by Performance Matters. There was some believe that the meeting could be used to set a plan for proceeding with the PD module and getting that piece in place by March 1. Next Steps: 1) Gary will distribute Shelby Contract with True North Logic/Performance Matters so that everyone can be on the same page as to what is eligible for contracting without an RFP. 2) Gary will contact Pearson/School net to determine pricing of potential extensions 85 3) An RFP for an Instructional Management System needs to be undertaken as soon as possible- need to determine who will lead this effort a. An RFP for the Item bank is already underway 4) Assuming the decision is to proceed with the Performance Matters/True North PD module relying on the Shelby County contract, a purchase order will need to be completed. Funding for this needs to be identified. There may be some overlap between School Net PD and Performance matters. 5) Kelly will continue work on a project charter for the PD piece and indicate a drop dead date for the decision as to whether or not we can go live with Performance Matters PD module in time to capture summer PD which historically starts being entered March 1. 6) Doug and Dave will have a follow-up conversation with Dr. Felder about today's meeting. Again, thank you for the productive conversation. Please let me know if I missed anything or if there is anything that I got incorrect. Ken Kenneth R. Stark Executive Officer for Operations Metropolitan Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 (615) 259-8424 86 Reid, Nicole From: Sta rk, Kenneth Sent: Fr'iday, October 21. zoi a 1:34 PM To: Appenteider, Gary-,Feider, Monique TiWilliams, David 5-,Changas, Paul;Stenson, Christine M;Russell, Toni Milanes, Katea J;Wade, Kelly SyTeeter, lohn W;Renfro, Douglas;i--lenson, Chris Subject: RE: Perfurmance Matters contract with Shelby County Gary, The terms seem to blend together and have multiple possible interpretations so i want to make sure I am understanding correctly. when you say "performance measurement", my reading otthe document is that means purely employee performance, not student performance. Is that your interpretation as well? Ken From Appenfelder, Gary Sent: Friday, October 21, 2015 1:24 PM To: Stark, Kenneth Felder, Monique Williams, David 5 Reid. Nicole From: Appenfelder, Gary Friday, October 21, 2016 2:00 PM To: Stark, Kenneth,Felder, Monl'que T;Wil|iams, David s;Changas, Paul;Slenson, Christine MgRussell, Toni M;Jones, Katea J;Wade, Kelly S;Teel.er, John w;Rentro, DouglasiHenson, Chris Subject: RE: Performance Matters tontraetwirh Shelby County Yes. The RFP is interesting, but the key documents thatdeline whatTNL (Performance Matters) is to provide are the contract and the proposal. Gary Appenfelder Director or Purchasing Melm Nashville Public 2601 ElansfardAVenue Nashville, TN 37204 515 25 33 office obl'Ie Ga rifelder so METRO 'r\lfiiS'ieriLl PUBLIC SCHOOLS Sent: Friday, October 21, 2016 1:34 PM To: Appenfelder, Gary; Felder, Monique David s; changas, Paul; Stenson, Christine Russell, Toni Jones, Katee Wade, Kelly 5; Teeter, John w; Renlro, Douglas; Henson, Chris Subject: RE: Performance Matters contract with Shelby County Saw. The terms seem to blend togetherand have multiple possible interpretations so want to make sure am understanding correctly. when you say "performance measurement", my reading ofthe document is that means purely employee performance, not student performance. is that your interpretation as well? Ken From. Appenfelder, Gary sent: Friday, October 21, 2015 1:24 PM To: starh, Kenneth Felder, Monique Williams, David 5 Changes, Paul Stenson, Christine Russell, Toni Jones, Katea What we can piggyback on is srricrlv the products provided in the TrueNorthLogic proposal and contract, which appears be limited to their PD product and performance measurement. Gary Appenieldel Director of Purchaslng Metm Nashville Public Schools 2601 Bransford Avenue Nashville TN 37204 615 25 3533 office oblls enielder mn s.or PUBLSC SCHOOLS s3 Reid, Nicole R From: Sent: To: Cc: Subject: Attachments: Felder, Monique T Monday, October 24, 2016 5:10 PM Stark, Kenneth;Appenfelder, Gary;Williams, David S;Changas, Paul;Stenson, Christine M;Russell, Toni M;Jones, Katea J;Wade, Kelly S;Teeter, John W;Renfro, Douglas;Henson, Chris M roderick.sams@performancematters.com FW: Proposals-Unify and Evaluation/PD Management CONTRACT Metro Nashville FLATTENED.pdf; PROPOSAL - MNPS Unify.pdf Greetings, AllPlease see the email below and attachments from Rocky re. Performance Matters. Rocky is copied on this email. Best, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org Office:615-259-8690 *Connectedness*Learner*Achiever*Relator*lntellection*lnput "We CClV\,, wvie~VeY civ,.,d wvieYeVeY we cvioose, successfuLL!::) tecicvi ciLL cviLLdYeV\, wviose scviooLLvi,g Ls of LV\,teyest to us. we ciLYeCld!j ~Vl,OW V¾OYe tvtClV\, we ~ed to do tvicit. n ~ RQV\,ClLd E;c{V\,\,ov,.,ds From: Roderick Sams [mailto:roderick.sams@performancematters.com] Sent: Monday, October 24, 2016 1:19 PM To: Felder, Monique T Subject: Proposals-Unify and Evaluation/PD Management Hello. Monique, I hope all is well. Attached are the Unify proposal for the Priority schools pilot and the initial agreement for the Evaluation and PD Management platforms. Not sure to whom the agreement should go to, but I wanted to share with you in advance. The Unify pilot proposal includes the assessment and analytics for the priority schools, as well as analytics districtwide. It covers the platform usage from January 1,2017 to June 30, 2017-with the associated ·. implementation and training costs. The pilot can be transitioned to add additional schools as needed. The service agreement for Evaluation/PD Management is based on the piggyback clause found in the Shelby County Schools RFP for the same solutions. The clause is listed below. Piggy Back Clause 80 Shelby County Board ofEducation reserves the right to extend the terms, conditions, and prices of this contract to other Institutions (such as State, Local and/or Public Agencies) who express an interest in participating in any contract that results from this RFP. Each of the piggyback institutions will issue their own purchasing documents for purchasing of the goods. Proposer agrees that the Shelby County Board ofEducation shall bear no responsibility or liability for any agreements between Proposer and the other Institution(s) who desire to exercise this option. The Purchasing Department has been made aware of this clause. Also, the agreement term dates are flexible, as well as the payment terms can be negotiated to meet the district's budget timelines. It's my understanding that the PD Management dates are pretty accurate, be we can revisit during the meeting. Let's discuss before next week. Give me a time that works for you and I'll plan accordingly. Thanks. See you next week! Rocky Roderick Sams, Ed.D. Director, Education Solutions (770) 283-4145 performance matters~ Acte!Em,te SMfont ami ·1;:<:iucatc,ir GrQwth www.performancematters.com Register today for 2017 National User Conference: Making it Matter 81 Reld. Nicole From: Appenlelder, Gary Sent: Tuesday, October 25. 2015 11:31 AM To: Felder, Monioue T;StarK Kenneth;wnliams, Dal/id S;Changas, Paul;Stenson, christine M;Russell, Toni M;Jones. Katea J7Wade, Kelly SiTeeler, John w;Rentro, Dauglas;Henson, Chris M;McCargar, Julie Subject: RE: ProposalsAUnify and Evaluat'lon/PD Management The serv'lces or PD is Evaluation Management are available as a piggyback on the shelby Cnunty contract issued to TrueNorthLuglct There are a couple ofdelails in the pricing/tees section ofthe proposal that do not directly cross over to the Shelby County contract. Specifically, under "Subscriptlon and Hosting Fees", the Calibration license fee is a direct match, but the license fees for Management System" and "Evaluation" are not provided in detail in the Shelby County proposal or eontratt. This may not be a problem because the Shelby County contract eharges a simple "User Access" license tee uf$83 per employee, The only other questionable item in the fees proposed for MNPS is the assumption o114,00o employees. Do we have that many? I thought we were inthe 10,000 ballpark. The separate proposal lrom PM for their student assessment platform lUnity) is problematic in that this product is not included in the scope ufthe Shelby County RFP orcontratt and the estimated cost (per the proposal) exceedsthe threshold requiring a public solicitation (l'n this case, RFP) for competitive selection. If federal funds are planned to support part or all ofthe purchase, that will ampitfv the sens vity for compliance. Gary Appenfelder Director at Purchasing Mel/0 Nashville Public Schaols 2601 Bransloro Avenue Nash ville, TN 37204 - office moblle Gary QEenfeldeernQ org METRO i'xlr'iSriViLE PUBLIC SCHOOLS Sent Monday, October 24, 2015 5:10 PM To: bark, Kenneth; Appenfelder, Gary; Williams, Dav'ld Changas, Paul; Stenson, Christine Russell, Toni Jones, Katea Wade, Kelly Teeter, John Renfro, Douglas; Henson, Chris Cc: gem Subject: FW: Proposals-Unify and Evaluation/PD Management Importance: High Greetings, All-- Please see the email below and attachments from Rocky re. Performance Matters. Rockv is copied on this email. Best, Monique Monique r. raider, 7E Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monigue.Felder@MNPS.org Office:615-259-8690 *Connectedness* Learner* Achiever* Re la tor* Inte llection *In put "We cCIVv, wvieVvevey C!Vvd wherever we cvioos.e, s.uwes.s.fuLLlj twcvi C!LL cvi[LdreVv wvios.e S:cviooL[vi,g [s. of [Vvteres.t to us.. we C1LreC1otl::) ~Vvow VvLore tviCIVv we Vveed to oto tviC!t." ~ RDVvC!Lol sdvv.oVvds. From: Roderick Sams [mailto:rodericl<.sams@performancematters.com] Sent: Monday, October 24, 2016 1:19 PM To: Felder, Monique T Subject: Proposals-Unify and Evaluation/PD Management Hello Monique, I hope all is well. Attached are the Unify proposal for the Priority schools pilot and the initial agreement for the Evaluation and PD Management platfo1ms. Not sure to whom the agreement should go to, but I wanted to share with you in advance. The Unify pilot proposal includes the assessment and analytics for the priority schools, as well as analytics districtwide. It covers the platform usage from January 1,2017 to June 30, 2017 with the associated implementation and training costs. The pilot can be transitioned to add additional schools as needed. The service agreement for Evaluation/PD Management is based on the piggyback clause found in the Shelby County Schools RFP for the same solutions. The clause is listed below. Piggy Back Clause Shelby County Board ofEducation reserves the right to extend the terms, conditions, and prices ofthis contract to other Institutions (such as State, Local and/or Public Agencies) who express an interest in participating in any contract that results from this RFP. Each of the piggyback institutions will issue their own purchasing documents for purchasing of the goods. Proposer agrees that the Shelby County Board ofEducation shall bear no responsibility or liability for any agreements between Proposer and the other Institution(s) who desire to exercise this option. The Purchasing Department has been made aware of this clause. Also, the agreement term dates are flexible, as well as the payment terms can be negotiated to meet the district's budget timelines. It's my understanding that the PD Management dates are pretty accurate, be we can revisit during the meeting. Let's discuss before next week. Give me a time that works for you and I'll plan accordingly. Thanks. See you next week! Rocky Rodlerkk Sams, Ed.D. Director, Education Solutions (770) 283-4145 Register today for 2017 National User Conference: Making it Matter 79 Reid, Nicole R From: Sent: To: Cc: Subject: Henson, Chris M Tuesday, November 1, 2016 5:01 PM Felder, Monique T;Changas, Paul;Carlisle, Jana L Williams, David S;Appenfelder, Gary RE: Forward Focus Article re: NWEA Assessments Are any grant funds available for the work in the Priority/LS Schools? ___________________________________ ,., ·-------- From: Felder, Monique T Sent: Tuesday, November 01, 2016 4:26 PM To: Henson, Chris M; Changas, Paul; carlisle, Jana L Cc: Williams, David S; Appenfelder, Gary Subject: RE: Forward Focus Article re: NWEA Assessments Hi, My understanding is that we are piloting Performance Matters in the Priority/LS Schools this year. I also aware staff in HR (prior to Deborah coming on board) had conversations with the reps regarding the PD portion of their tools/resources as what the district currently has will no longer be available for next school year ... I wasn't at today's meeting, but I know we need to move forward with the work Dr. Joseph identified for the Priority/LS Schools. Not sure what the cost is for the work that needs to happen in those schools. Best, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique. Felder@M N PS.org Office:61S-2S9-8690 *Connected ness*Lea rner* Achiever* Relator* Intel lectio n*In put "We CCIV\,, wvie~ver ciVld wvierever we cvioose, successfuLL!j tecicvi ciLL cviCLvlreV\, wviose scviooLC~ Ls of LV\,terest to us. we ciLreciol!j ~V\,OW l'\,\,OYe tVlCIV\, we ~evl to vlo tvicit." - Rol/\,C!Lvl c;vlf'\,\.011\,G\S From: Henson, Chris M Sent: Tuesday, November 1, 2016 3:S4 PM To: Changas, Paul ; Felder, Monique T ; Carlisle, Jana L Cc: Williams, David S ; Appenfelder, Gary Subject: RE: Forward Focus Article re: NWEA Assessments How are we planning to fund the N$SSSK? 38 From: Changas, Paul Sent: Tuesday, November 01, 2016 1:27 PM To: Henson, Chris M; Felder, Monique T; Carlisle, Jana L Cc: Williams, David S; Appenfelder, Gary Subject: RE: Forward Focus Article re: NWEA Assessments Chris, The proposal we received from NWEA, which includes professional development, was for $455,864 for this school year. I have not been in all the Performance Matters discussions, butthe proposal I saw was for $99,300.00. I have copied Gary as I believe he has been in the loop for both vendors and can confirm whether the proposals we received are consistent with the Shelby County contracts on which we are piggy bacldng. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization - Analytical - Learner - Relator - Responsibility From: Henson, Chris M Sent: Tuesday, November 01, 2016 8:25 AM To: Felder, Monique T ; Changas, Paul ; Carlisle, Jana L Cc: Williams, David S Subject: RE: Forward Focus Article re: NWEA Assessments What is the total amount needed for NWEA and Performance Matters for this year? Are these replacing something else that was budgeted for this year? --------------·--------------------------------From: Felder, Monique T Sent: Tuesday, November 01, 2016 12:49 AM To: Changas, Paul; Carlisle, Jana L; Henson, Chris M Cc: Williams, David S Subject: RE: Forward Focus Article re: NWEA Assessments Greetings, I am looping in Chris for his support with identifying a funding source of NWEA and Performance Matters which will be piloted in the LS/priority schools. Chris, please advise. Thanks! Best, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 39 Reid, Nicole R From: Sent: To: Cc: Subject: Roderick Sams < roderick.sams@performancematters.com > Wednesday, November 2, 2016 3:16 PM Stark, Kenneth Williams, David S;Jones, Katea J;Felder, Monique T;Henson, Chris M;Renfro, Douglas;Appenfelder, Gary;Teeter, John W;Wade, Kelly S;Black, Shannon;Amy Wieland;Woody Dillaha Re: Invitation: MNPS-PM Strategy Conversation @Tue Nov 1, 2016 2:30pm - 4pm (EDT) (roderick.sams@performancematters.com) Great synopsis Ken, and I appreciate the notes as well as the conversation yesterday. I will be following up on the action items soon. Thanks again all! Rocky On Wed, Nov 2, 2016 at 1: 17 PM, Stark, Kenneth wrote: In an attempt to keep us all on the same page, here is what I have for the follow up actions from yeseterday' s meeting: Rocky: 1) Research contract with Orange County Schools for Unify (student assessment piece) to see if it meets standards that would allow MNPS to piggy-back on that contract for purposes of acquiring Unify. He w ill forward that to Gary for review and a determination. 2) Provide additional clarification around questions and about professional development options per Kelly Wade's questions, i.e . Technical Specification Documentation (TSD) for Unify and PD Management, is required in order to accurately assess timeline feasib ility 3) Review pricing and proposal because of the multiple rubrics used for Staff Evaluation per info provided by Shannon Black. 4) Research and provide further information relative to t ransfer of staff evaluation to the state . Shelby county has apparently sought and received a waiver. It is uncert ain as to whether MNPS would want a waiver or if a waiver would even be granted. 5) Provide performance SLA, backup methodologies including geographic segregation of data storage, and security model related to the Data Center for HIPPA, PII and FERPA. Gary: 1) Review whatever Rocky comes up with relative to Orange county to make a determination on moving forward with purchasing the non-Shelby county pieces of the program without a MNPS lead competitive process. 74 2) Following up from last meeting, provide information on SchoolNet extension feasibility, costs etc. to provide a plan band suitable transition time. Toni/John : 1) Review proposed implementation schedules to determine if the proposed time lines can be met given current staffing and projected workloads. 2) Review SLA, backup, and security model information from PM upon receipt Lance/Kelly: 1) Review proposed implementation schedules to dete rmine if the proposed time li nes can be met given current and projected workloads. Requires receipt of TSD noted above. 2) Review any information provided in response to questions on Staff Development. Shannon: 1) Review proposed implementation schedules to determine in the proposed time lines can be met given current staffing and projected workloads. 2) Review information provided in response to questions on Staff Evaluation . MNPS Team - not sure who can complete these : 1) Identify funding for implementation. Possibly some overlap between School Net and Performance Matters in the cu rrent fiscal year. The Performance Matters team has indicated the re is some negotiability here as to when payment would be made. 2) Confirm that the district does want to move forward with the purchase of Performance Matters as a replacement for School Net for Staff Development and Staff Evaluation modules. There is a time issue with the sunsetting of t he School Net package and the current staff evaluation system, but the process in identifying Performance Matters as the preferred solution is unclear. 3) Cost has largely been left out of the evaluation process to date. Given the magnitude of the expenditures - ~1M+ per year at full implementation ($465,360 = PD & Eva I, $5 Unify + $2 Key data x 89,000 = $623,000), budget sustainability needs to be considered . Please let me know if I have missed anything. 75 Ken From: Williams, David S Sent: Tuesday, November 01, 2016 12:48 PM To: Jones, Katea J ; Roderick Sams Cc: Felder, Monique T ; Henson, Chris M ; Stark, Kenneth Subject: Re: Invitation: MN PS-PM Strategy Conversation@ Tue Nov 1, 2016 2:30pm - 4pm (EDT) (roderick.sams@performancematters.com ) Hi all- I have several meetings this afternoon already on my calendar. I look forward to learning what was discussed and next steps. Thanks! David David S. Williams, Ed.D. Interim Executive Director of Curriculum and Instruction Division of Teaching and Learning Metropolitan Nashville Public Schools 260 7 Bransford Ave Nashville, TN 37204 Ideation I Adaptability I lntellection I Connectedness I Learner David. Williams2@mnps. orq (615) 259-8602 76 Follow us on Twitter: @mnpsinstruction METRO H I LE PUBLIC SCHOOLS From: "Jones, Katea J" Date: Tuesday, November 1, 2016 at 12:40 PM To: Roderick Sams Cc: "Felder, Monique T" , "Henson, Chris M" , "Stark, Kenneth" , David Williams Subject: RE : Invitation : MN PS-PM Strategy Conversation @ Tue Nov 1, 2016 2:30pm - 4pm (EDT) (roderick.sams@performancematters .com ) Greetings Mr. Sam, I do apologies for the short notice. Unfortunately, Dr. Felder will not be able to attend this afternoon's meeting. She has been called to a meeting with Commissioner McQueen . I have reached out to our Interim Executive Director of Curriculum & Instruction Dr. David Williams, to see if he is available to attend in her place . Again, I sincerely apologies for the short notice and any inconvenience this may cause. We do ask, if you could please share any notes and/or actions items with Dr. Monique Felder and Dr. David Williams. Thank you again for your understanding. 77 Thank you, Katea Jones Executive Assistant to Chief Academic Officer Metropolitan Nashville Public Schools Division of Teach ing and Learning 2601 Bransford Avenue Nashville, TN 37204 615-259-8690 phone 615-214-8651 fa x katea. jones@mnps.org -----Original Appointment----From: Roderick Sams [mailto :roderick.sams@performancematters.com ] Sent: Friday, October 21, 2016 10:27 AM To: Roderick Sams; Stark, Kenneth; Wade, Kelly S; Felder, Monique T; Russell, Toni M; Amy Wieland; Henson, Chris M; Changas, Paul; Story, Deborah; Black, Shannon; Jones, Katea J Subject: Invitation : MNPS-PM Strategy Conversation @ Tue Nov 1, 2016 2:30pm - 4pm (EDT) (roderick.sams@performancematters.com ) When: Tuesday, November 01, 2016 1:30 PM-3 :00 PM (UTC-06:00) Central Time (US & Canada). Where: 2601 Bransford Avenue Nashville, TN 37204 more details » MN PS-PM Strategy Conversation When Tue Nov 1, 2016 2:30pm - 4pm Eastern Time Where 2601 Bransford Avenue Nashville, TN 37204 (!!!fil1.) Calendar roderick.sams@performancematters.com 78 Roderick Sams - organizer kenneth.stark@mnps.org kelly.wade@mnps.org monique.felder@mnps.org toni.russell@mnps.org Amy Wieland Who chris .henson@mnps.org Paul.Changas@mnps.org deborah.story@mnps.org shannon.black@mnps.org katea .jones@mnps.org Going? Yes - Maybe - No more options » Invitation from Google Calendar You are receiving this courtesy email at th e account katea.iones@mnps.org because you are an attendee of this eve nt. To stop receiving future updates for thi s event. decline this event. Alterna tive ly you can sig n up for a Goog le account at https://www.qooqle.com/calendar/ and control your notification settings for your entire calendar. Forwarding thi s invitation could allow any recipient to mod ify you r RSVP response. Learn More. « File: invite.ics » Roderick Sams, Ed.D. Director, Education Solutions (770) 283-4145 performance matters. - IIJ Accelerate Student and Educator Growth www .performancematters.com Register today for 2017 Na tional User Conference: Making it Matter 79 From: Roderick Sams Shannon Subject: RE: Invitation: MNPS-PM Strategy Conversation@ Tue Nov 1, 2016 2:30pm - 4pm (EDT) ( roderick.sams@performancematters.com) In an attempt to keep us all on the same page, here is what I have for the follow up actions from yeseterday's meeting: Rocky: 1) Research contract with Orange County Schools for Unify (student assessment piece) to see if it meets standards that would allow MNPS to piggy-back on that contract for purposes of acqui ring Unify. He will forward that to Gary for review and a determinat ion . 2) Provide additional clarification around questions and about professiona l development options per Kelly Wade's questions, i.e . Technical Specification Documentation (TSD) for Unify and PD Management, is required in order to accurately assess timeline feasibility 3) Review pricing and proposal because of the multiple rub rics used for Staff Evaluation per info provided by Shannon Black. 4) Research and provide further information relative to transfer of staff evaluation to the state. Shelby county has apparently sought and rece ived a waiver. It is uncertain as to whether MNPS would want a waiver or if a waiver would even be granted. 5) Provide performance SLA, backup methodologies including geographic segregation of data storage, and security model related to the Data Center for HIPPA, PII and FERPA. Gary: 1) Review whatever Rocky comes up with relative to Orange county to make a determination on moving forward with purchasing the non-Shelby county pieces of the program without a MNPS lead competitive process. 2) Following up from last meeting, provide information on SchoolNet extension feasibility, costs etc. to provide a plan band suitable transition time. Toni/John : 1) Review proposed impleme ntation schedules to determine if the proposed timelines can be met given current staffing and projected wo rkloads. 2) Review SLA, backup, and security model information from PM upon receipt Lance/Kelly: 64 1) Review proposed implementation schedules to determine if the proposed t imelines can be met given current and projected wo rkloads. Requires receipt of TSD noted above. 2) Review any information provided in response to questions on Staff Development. Shannon : 1) Review proposed implementation schedules to determine in the proposed timelines can be met given current staffing and projected workloads. 2) Review information provided in response to questions on Staff Evaluation. MNPS Team - not sure who can complete these: 1) Identify funding for implementation . Possibly some overlap between School Net and Performance Matters in the current fiscal year. The Performance Matters team has indicated there is some negotiabi lity here as to when payment would be made. 2) Confirm that the district does want to move forward with the purchase of Performance Matters as a replacement for School Net for Staff Development and Staff Evaluation modules. There is a time issue with the sunsetting of the SchoolNet package and the current staff evaluation system, but the process in identifying Performance Matters as the preferred solution is unclear. 3) Cost has largely been left out of the evaluation process to date. Given the magnitude of the expenditures - ~1M+ per year at full implementation ($465,360 =PD & Eval, $5 Unify+ $2 Key data x 89,000 =$623,000), budget sustainability needs to be considered. Please let me know if I have missed anything. Ken From: Williams, David S Sent: Tuesday, November 01, 2016 12:48 PM To: Jones, Katea J ; Roderick Sams Cc: Felder, Monique T ; Henson, Chris M ; Stark, Kenneth Subject: Re: Invitation: MN PS-PM Strategy Conversation@ Tue Nov 1, 2016 2:30pm - 4pm (EDT) (roderick .sams@performancematters.com ) 65 Hi all- I have several meetings this afternoon already on my calendar. I look forward to learning what was discussed and next steps. Thanks! David David S. Williams, Ed.D. Interim Executive Director of Curriculum and Instruction Division of Teaching and Learning Metropolitan Nashville Public Schools 2601 Bransfor d Ave Nashville, TN 3 7204 Ideation I Adaptabil ity I lntellection I Connectedness I Learner David Williams2@mnps.orq (615) 259-8602 Follow us on Twitter: @mnpsinstruction METRO V IL PUBLIC SCHOOLS 66 From: "Jones, Katea J" Date: Tuesday, November 1, 2016 at 12:40 PM To: Roderick Sams Cc: "Felder, Monique T" , "Henson, Chris M" , "Stark, Kenneth" , David Williams Subject: RE: Invitation: MN PS-PM Strategy Conversation @ Tue Nov 1, 2016 2:30pm - 4pm (EDT) (roderick.sams@performancematters.com ) Greetings Mr. Sam, I do apologies for the short notice. Unfortunately, Dr. Felder will not be able to attend this afternoon's meeting. She has been called to a meeting with Commissioner McQueen. I have reached out to our Interim Executive Director of Curriculum & Instruction Dr. David Williams, to see if he is available to attend in her place. Again, I sincerely apologies for the short notice and any inconvenience this may cause. We do ask, if you could please share any notes and/or actions items with Dr. Monique Felder and Dr. David Williams . Thank you again for your understanding. Thank you, Katea Jones Executive Assistant to Chief Academic Officer Metropolitan Nashville Public Schools Division of Teaching and Learning 2601 Bransford Avenue 67 Nashville, TN 37204 615-259-8690 phone 615-214-8651 fax katea.jones@mnps.org -----Original Appointment----From: Roderick Sams fmailto:roderick.sams@performancematters.com ] Sent: Friday, October 21, 2016 10:27 AM To: Roderick Sams; Stark, Kenneth; Wade, Kelly S; Felder, Monique T; Russell, Toni M; Amy Wieland ; Henson, Chris M; Changas, Paul; Story, Deborah; Black, Shannon; Jones, Katea J Subject: Invitation: MN PS-PM Strategy Conversation@ Tue Nov 1, 2016 2:30pm - 4pm (EDT) (roderick.sams@performancematters.com ) When: Tuesday, November 01, 2016 1:30 PM -3:00 PM (UTC-06:00) Central Time (US & Canada). Where: 2601 Bransford Avenue Nashville, TN 37204 more details » MNPS-PM Strategy Conversation Wilen Tue Nov 1, 201 6 2:30pm - 4pm Eastern Time Where 2601 Bransford Avenue Nashville, TN 37204 (!!11lQ) Calendar roderick.sams@performancematters .com Roderick Sams - organizer kenneth.stark@mnps.org kellv.wade@mnps .org monique.felder@mnps.org toni .russell@mnps.org Wilo Amy Wieland chris .henson@mnps.org Paul.Changas@mnps.org deborah.storv@mnps.org shannon .black@mnps.org katea. iones@mnps .org 68 Going? Yes - Maybe - No more options » Invitation from Google Calendar You are rece iving this courtesy email at the account katea.jones@mnps.org because you are an att endee or this event. To s top receiving future updates for this event. decline this event. Alternatively you can sign up for a Google account at https://www.qoogle.com/calendar/ and control your notification settings fo r your entire calendar. Forwarding this invi tation could allow any recipient to modify your RSVP response. Learn More. << File : invite.ics >> Roderick Sams, Ed.D. Director, Education Solutions (770) 283-4145 performance matters - IJ Accelerate Student and Educator Growth www.performancematters.com Register today for 2017 National User Conference: Mrtld11g if M a/fer 69 Reid, Nicole R From: Sent: To: Cc: Subject: Roderick Sams < roderick.sams@performancematters.com> Monday, November 14, 2016 7:03 AM Black, Shannon Appenfelder, Gary;Shelby Greer;Teeter, John W;Gabriel Barrett Re: Orange County RFP Information Thanks Shannon for the update. There is a meeting onsite Wednesday of this week with Executive Leadership, and I've been asked to not make any updates until then. We can definitely review the difference in the Evaluation platfonn and the Observation only tool on the web demo tomorrow, and I can speak to the pricing differences as well. After Wednesday's meeting, I will update the agreement with the final edits and adjustments. Thanks, Rocky On Mon, Nov 14, 2016 at 7:17 AM, Black, Shannon wrote: Good morningMy apologies for not responding sooner. I have been out of town. The 11,000 number is accurate. Rocky was going to get me a description on how the Performance Matters evaluation tool differs from their observation management tool. Could we also get a breakdown of price for each? Also-in the meeting a few weeks ago, we discussed putting the support evaluation tool into the system. Are costs reflected in what was shared for adding in their evaluation tool to the platform? Shannon Shannon Black Director, Talent Management Office of Human Capital Metro Nashville Public Schools shannon.black@mnps.org From: Roderick Sams Sent: Monday, November 14, 2016 5:57:04 AM To: Appenfelder, Gary .Cc: Shelby Greer; Black, Shannon; Teeter, John W; Amy Wieland Subject: Re : Orange County RFP Information Thanks Gary. We will make the update in the final version. Rocky 27 On Sat, Nov 12. 2016 at 1 1:59 AM, Appenrelden Gary wmte: Actual empluyee count is 11,161. Gary Appenlelder Dlreclor of Purchasing Menu Nashville Public Schnuls 2601 ansiordAwnue Nashville, TN 37204 [615 25978533 office _rmMs Ga 3 enleldel mn 5'0! fly; METRO 0 PUBLIC, SCHOOLS From: Roderick Sams Sent: Thursday, November 10, 2016 5:27 AM To: Appenfelder, Gary Cc: Shelby Greer Subject: Re: Orange County RFP Information Good morning Gary, I believe lhe total for Evaluation was given by Shannon Black and confirmed by John Teeler. Ifthal number is not accurate, we will definitely update the next vcl'sion omie agreement. Also, 1 included both versions in my last email, but I'm attaching the licensing version here as well, Thanks again! 28 Rocky On Wed, Nov 9, 2016 at 1 1:08 PM, AppenfeIder, Gary wrme: Thanks, Ruckv. Sorry that I come across anal, Who spetilicaHv is "the team" that gave you 12,300 number? My prelerence isto have the licensing broken down per person forclarity, ratherthan rolling it up into some aggregate number. Gary Appenlelder Director at Purcnasing Melm Nashville Public SMOOIS 2601 Elanslord Avenus Nashville, TN 37204 1515 259-5533 office _mnbfie nleldel mn svor METRO PUBLIC SCHOOLS From: Roderick Sams Sent: Monday, November 07, 2016 11:00 AM ppenfelder, Gary Cc. heiny Greer Subject: Re: Orange County RFF Information Good morning Gary, 19 My apologies for the late reply. The questions in the first three paragraphs will be addressed in the updated contract. The team gave me the following numbers last Tuesday (14,000 for PD; 12,800 for Evaluation). Also, Shelby pricing agreement did not require a specific listing the unit price per license for PD or Evaluation, but was a combination of all subscription costs (PD, Evaluation, Calibration) in one lined total. We can mirror that approach in the updated version if you prefer. I copying Shelby Greer, Sales Analyst, on this email as she will be able to minor the process you require for the updated agreement. Please call me with questions. Thanks again! Rocky On Fri, Nov 4, 2016 at 4:27 PM, Appenfelder, Gary wrote: Rocky, I had a couple of minor questions regarding the PD management product (TrueNorthlogic) pricing. These may get answered in the revised proposal that you're submitting. If they are, I apologize for not keeping up. In Exhibit A, in section 3. Subscription and Hosting Fees, the PD Management and Evaluation lines says 14,000 employees. Our employee count is more like 10,000, but I need to verify that. Were you simply using 14,000 as a placeholder until we could give you the correct actual number? The per user price for Calibration is exactly as stated in the Shelby County contract. No questions there. I could not find user prices for PD Management or Evaluation in the Shelby County documents. The $11.66 per user for PD Management is close to the result you get by dividing the total amount in the Shelby County Proposal for PD Management ($139,900) by the 12,000 employees assumed for Shelby County. Is that correct? If yes, then the unit pri ce is fine - just need the adjustment to employee count. The Evaluation unit price has me stumped. I can't find anything in the Shelby County documents (price, description, or $ amount) that seems to relate to it. Can you clarify? 30 Gary Appenielder Direclor of Purchasing Metro Nashville Public Schuuls 2601 Elsi-Islam Avenue Nashville, TN 37204 $15 259-3533 "Woe Ga enleldel m" METRO '7 a ll, PUBLIC SCHOOLS me: Roderlck Sams Sank: Thursday, Navember 03, 2016 7:15 PM To Appenfelder, Gary Subject: Re: Orange County Information Great Gary! Thank you! I should be fmwal'ding updated Evaluation/PD Management contract in the next couple ofdays. Also, we will be reworking the Unify pricing to give the district multiple optinns (pliority schools, etc')' You should have that early next week as well. Rocky On Thu>> Nov 3, 2015 a18:00 PM, Gary wrote: Excellentl Thanks, Rocky. I already reached out to my counterpalt at Orange County and can also Contact same ln Palm Beach. Gary Direclcr cl Purchaslng 31 Melm Nashville Pub/m SL'honIs 2601 Blansfom Avenue Nashville, TN 37204 (515 259-5533 office --mm 63 .a enfelder mn 5.0 METRO PUBLIC SCHOOLS From: Roderlck Sams [mailtmrodericksams @gfiurmancemattersmm] Sent: Thursday, November 03, 2016 1:06 PM To: Appenfelder, Gary Subjed: Re: Orange County RFP Information One more thing. Palm Beach County Schools. FL and Pasco County Schools. FL both used this RFP to purchase Unify' I forgot to include in my rim email. Thanks again, Rocky On Thu, Nov 3. 2016 at 2:03 PM, Roderick wrote: Hey Gary. Below is the information for me Unify-awarded RFP from Orange County Schools (FL). Please let me know ifyou need any additional information. 32 Reid, Nicole R From: Sent: To: Cc: Subject: Roderick Sams < roderick.sams@performancematters.com > Thursday, November 17, 2016 5:30 AM Amy Wieland;Appenfelder, Gary;Carlisle, Jana L;Changas, Paul;Felder, Monique T Dave Nelson;Marnie Stockman;Narcisse, Sito J;Patrice Hartnett;Shelby Greer;Woody Dillaha Re: Eval/PD contract in Word Good morning Monique, I hate I missed the meeting yesterday, but obviously Team MNPS was in great hands! I have three dates I would like to suggest for the onsite, as we realize the time sensitive nature for beginning the project. December 1st December 2nd December 5th If either date works, please give us the best time for the team. Looking f01ward to our work together. Thanks again! Rocky On Thu, Nov 17, 2016 at 1: 19 AM Felder, Monique T wrote: Hi Amy, Great seeing you today! We look forward to receiving potential meeting dates from you for drafting an implementation work/action plan to bring this project to fru ition . Best, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 21 Monique.Felder@MNPS.org Office :615-259-8690 * Connectedness * Learner* Achiever* Relator* I nte Ilection * In put "We CCIV\,, wvieV\,evev CIV\,Gl wvievevev we c.vioose, successfuLLt:J teac.vi aLL c.viLLGlveV\, wviose sc.viooLLV\,g Ls of LV\,tevest to us. we aLveavli::j izMW V\,\.OY-e tV\ClV\, we 11\,eevl to Glo tviat." - RL)V\,fAL!il EovlV1AOV\,GlS From: Amy Wieland [mailto:amy.wieland@performancematters.com] Sent: Wednesday, November 16, 2016 1:03 PM To: Appenfelder, Gary Cc: Roderick Sams ; Woody Di Ila ha ; Felder, Monique T ; Narcisse, Sito J ; Shelby Greer Subject: Eval/PD contract in Word Hi Gaiy, It was a pleasure meeting with you today. I've attached the Eval/PD contract in Word as you requested. We are currently working on the Unify proposal to incorporate the district wide purchase with the phased payment that we described using the Orange County pricing that we discussed today. We will provide that to word to you as well as soon as it is complete. I anticipate having that complete by tomorrow at the latest. Please reach out to us if you need additional inf01mation. We look f01ward to working together. Regards, Amy 22 Amy Wieland Senior Vice Presid ent Register today for 2017 National Learners Conference: Making it Matter performance matters ...... I!: Accelerate Student and Educator Growth 407 .462.9169 www.performancematters.com Roderick Sams, Ed.D. Director, Education Solutions (770) 283-4145 www.performancematters.com 23 NicoleR From: Appentelder, Gary Senl: Friday, November 13, 201611239 AM To: Stark, Kenneth Subje RE Unify Kickal'f Meeting I had a small hiccup that area. BC send me the RFP Rt contracts docs via Googledocs, but Khe neglected to gramme viewing permission. We requested that and should have later today. Not too worried about that as I discussed our project in some detail with my counterpart from DC last week, and he was very comfortable that the oc cuntracl covers the Unily portion that we're interested m. I attended a meeting on Tuesday that sort olclarities [for the momentl what we're planning as the engagement, I'll briel you in person Gary Appenlelder Director ol Purchasing Nashville Pub/lo Schools 2501 Blansfam Avenue Nashville, TN 37204 615 259 5130ch mobile Ga an elder mn PUBLIKCV SCHOOLS Sen Fr'lday, November 18, 2015 11:20 AM To: Appenfelder, Gary Subject: FW: Un'lfy Kickoff Meeting Gary, Have you reviewed the orange county contract? Do you have any idea which pieces we are actually moving ahead with? Ken From: changas, Paul Sent: Friday, November 13, 2015 11 15 AM To: Roderick Sams Felder, Monique Cc: Carlisle, Jana Amy Wieland Stark, Kenneth Subject: RE: Unify Kickoii Meeting [have copied Ken Stark, Executive Office of Dperalilms, as the most critical wurk in this process resides in IT. Paul Paul Changes 14 Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Otlice: 615- 259- 84<30 Streng th s: Indi viduali zati on - Analytical -Learn er - Helator - Responsibility From: Roderick Sams [mailto:roderick.sams@performancematters.com] Sent: Friday, November 18, 2016 7:09 AM To: Felder, Monique T Cc: Changas, Paul ; Carlisle, Jana L ; Amy Wieland Subject: Re: Unify Kickoff Meeting Thanks Monique, and I definitely agree with you on the desired meeting outcome. Jana and Paul, I will await your reply and schedule accordingly. Thanks again! Rocky On Fri, Nov 18, 2016 at 7:53 AM, Felder, Monique T wrote: Hi Rocky, I will be on work related travel on those dates. However, the meeting can certainly proceed in my absence. I will touch base with Jana Carlisle, Chief of Staff and the person Paul reports to, about proceeding in my absence. The most important outcome for this meeting in my opinion is the development of an action plan outlining the launch date and all that needs to be done (who, what and by whom) to successful implement. Best regards, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org Office: 615-259-8690 15 * Connectedness * Learner * Achi ever* Relator* Intel lection * In put "We ce1111,, wvie111,evev c;i111,G{ wvievevev we cvioose, successfuLLtJ tec;icv, e1LL cviLLGlve111, wviose scviooLL~ Ls of (111,tevest to us. we e1Lvee1Gli:j R,111,ow V\,\.ove tv,c;i111, we 111,eecl to Glo tvie1t." - Ro111,e1Lcl cclV\,\.0111,Gls From: Roderick Sams [mailto :roderick .sams@performancematters.com 1 Sent: Thursday, November 17, 2016 8:59 PM To: Felder, Monique T ; Changas, Paul Cc: Carlisle, Jana L ; Amy Wieland Subject: Unify Kickoff Meeting Good evening Monique and Paul, I wanted to follow up on the previous email regarding the scheduling of the onsite kickoff meeting. It would be helpful if we had representation from Assessment, IT, and Cuniculum and Instruction present as we will be discussing the project implementation and training plans. The requested dates are: • December 1st • December 2nd • December 5th Hopefully one of those dates can work. Let me know the best time and we will plan accordingly. Thanks again! Rocky Roderick Sams, Ed.D. Director, Education Solutions (770) 283-4145 16 d.Nco|eR From: Cariisle, Jana 52m: Monday, November 28, 2016 9:15 AM To: Changes, Paul Subject: MNPS Unify Professional Services Plan Hi: iihst sentan invite farWednesday. Perhaps you can check with Mo, Monique and sarv about any details they have and we can then compile into a project plans Thanks hape all is well Jana Jana (51175552, GBP1179 Chief of Staff Metro Nashville Public Schools 2501 Bransford Avenue Nashville, TN. 37204 Office--61545943734 STRATEGIC RELATOR Frnm: Changas, Paul sent: Tuesday, Novemberzz, 2015 5:09 PM To: Carll'sle, lane subject: RE: MNPS Unify Professional Services Plan That would be helpful. i have been in some meetings with Performance Matters but was not in the most recent one and am not sure what time frame is for this plan, as it pertains to district-wide FD. I can ask Dr. Felder for more information iithis is not something that has been shared with you, lust let me know iiwhen you have an npeningin your schedule. Thank you. Paul Paul Changas Executive Director Research, Assessment Evaluation Metropolitan Nashville Public Schools omoe: 515.959.3450 lndlilli'lualizauun 7 Analytical 7 Learner Relamr Fro Carlisle, Jana Sent: Tuesday, November 22, 2016 4137 PM as mn 5.0r Unify meessiorial Services Plan Hi: Wuuld you like to meeno discuss a project plan forthis? Jana Jaim Cm'fi'sfe, faCD Chlefcf Staff Metro Nashville Public Schools 2501 Bransford Avenue Nashville, TN, 37204 Office 615159-8734 Mobile From Felder,MoniqueT Sent: Saturday, November 19, 2015 6:26 AM To: Roderick 5ams Cc:Carli5le,lana changas, Paul > whys: "maul/lg is af Murat to big, we Mahala lei/Law Mm: film/ewe Mali to all: that! Ronald Edi/mowing Fro oderick Sams Sen Friday, November 13, 2016 5:15 PM To: Felder, Monique Suhiect: MNPS Unify Professional Services Plan Monique, Attached is the Professional Sewvices plan submitted with Unify pricing to Purchasing. This covers the district- wide implementation. Please let me know if you have any quesLions. 2 Rocky Roderick Sams, Ed.D. Director, Education Solutions (770) 283-4145 performance . ·-a· · lii!!o~•tt . t··. t··er·s··.·Ji'H~ft.-~2l m Educator Accefol'MeSti.ltie(lt.and G.rowth www.performancematters.com Register today for 2017 National User Conference: Making it Matter 3 From: Felder, Monique Sent: Tuesday, November 29, 2016 1:04 PM To: Appenteloer, Gary: Changas, Paul Cc: Carlisle, Jana Subject: RE: Pertorrnance Matters payment schedule Hi Gary, Thanks for this update! i don't recall this part ortne discussion, but am looping in Paul Changas as he is leading this effort, Best regards, Monique Monique T. Fela'er, Chief Academic Officer Metro Nashviile Public Schools 2601 Bransford Avenue Nashville, TN 37204 MO gu org 0 Ice.615-259-8690 ~we om, whenever and wherever we ahoose, successfuLLU teneh nu whose schooling is pft'wtctest to us. We ntrendrd lenow morethnn wt med tn do that Ronald Epmonns From: Appenfeider, Gary Sent: Tuesday, November 29, 2015 1:01 PM To: Felder, Subiect: Performance Matters payment schedule Monique, I had a phone conversation yesterday with the PM tolk regarding a couple of minor language items for the contracts. However, one ofthase items may be significant, I had drafted contract language for the PD Management product that gave us flexibility in scheduling the start of implementation for that product, and would delay the annual license fee (forthe PD) until the implementation is complete. PM states that the waiverofthe Unify annual license fee this fiscal year cost for immediate implementation and unlimited usage through 5/30/16) was contingent upon immediate implementation of the PD Management product in this schooi year ismx implantation plus license). I don't recall hearing any comment about this during the meeting I attended with you, site, Dru Joseph, and Woody Amy fram PM. is this bundling arrangement also your understanding of what's been agreed to? i don't want to this arrangement if it's not something we've previously agreed to. Gary Appentelder Director ot Purchasing Metro Nashvi/Is Puhlic 2501 Brews/om Avenue Nashville, TN 37204 office mobile am aggen der@mngs om Reid, Nicole R From: Sent: To: Cc: Subject: Appenfelder, Gary Thursday, December 1, 2016 10:23 AM Felder, Monique T; Changas, Paul Carlisle, Jana L; Henson, Chris M; Stark, Kenneth RE: Performance Matters payment schedule I talked at length again with Rocky and Woody. I asked Woody directly who at MNPS had agreed that the Unify assessment product and the PD Management would be implemented and paid for simultaneously. He answered that the only time that was presented to MNPS as a bundled deal was at the meeting in Dr. Joseph's conference room on Nov 16. I reminded him that I was in that meeting, but I don't recall any explicit statement or implication by the PM team that the proposals for the two products were contingent upon simultaneous implementation. I also reminded him that I had commented in that meeting that in the support team meetings I've attended, which included the department heads who would be responsible for the actual implementations, there was a strong desire to delay the PD Management product implementation so as to avoid overreaching our internal capacity to handle multiple simultaneous implementations. To this, Woody responded that it would be OK to postpone implementation of the PG Management product until February 1, 2017. He was very polite and tactful about that, but at the same time very adamant. This is smelling very fishy and in the interests of Performance Management rather than MNPS. The separate contracts that we are piggybacking for these two products were not contingent upon other implementations. The proposals from PM do not provide any special pricing (beyond what the piggyback contracts provide), except that there would be no incremental Unify student license fees payable in the 2016-2017 school year regardless of how many students use the product. Although that sounds like (may really be) a good deal, the fixed fee for Unify for 2016-2017 is $99,000, which is equivalent to pro-rated license fees for about 37,000 students. I have no idea if our realistic potential for number of students engaged in the system (on average for the period Jan-May 2017) is way below or way above that. The only figure I've seen as an estimate of 4,100 students from the 12 priority schools (provided in PM's original proposal for Unify). Do we have a specific number of students that we are mandating to use the Unify product for assessments in the Spring semester of this school year? The PD Management product is the more expensive of the two. It has a $147,000 implementation charge, due up front, and an annual license fee of $382,429 (based on 11,200 employees), which is due at the beginning of each li·cense year. That's $31,869 per month for the license fee compared to our current product (Pearson - Schoo IN et PD Planner), which is costing us approximately $6,250 per month. The SchoolNet product must be replaced because Pearson support for the product will end. The initial information provided to the MNPS team considering how to replace Pearson's PD product was that Person would discontinue support at the end of this school year. I confirmed with Pearson week before last that they are continuing support of the School Net product through June 2018 and we can continue use of the product after April 2017 on a month-to-month basis at the cost mentioned above. The only reason that the PM (TrueNorthlogic) PD Management product has been considered and pursued is because (via the Shelby County contract) it is immediately available without going through a formal solicitation. But, the immediacy of that need has been removed. My recommendation is to take a firm stance with Performance Matters that the True North Logic PD Management product is contractually unbundled from the Unify product so that the timing of implementation and fiscal liability is completely at our option. Further, as terms for both the TrueNorthlogic and the Unify products, I recommend that payment of initial license fees (and the start of the initial license periods) be contingent upon completion of implementation and successful acceptance testing by MNPS. Gary Appenfelder Director of Purchasing Metro Nashville Public Schools 1 2501 Avenue Nashville, TN 37204 office while Ga enlelder mn sor METRO JiliLE PUBLIC SCHOOLS Appenfelder, Gary Sent: Tuesday, November 29, 2016 4:35 PM To: Felder, Monique Changes, Paul Cc: Carlisle, Jana Subject: RE: Performance Matters payment schedule OK. Thanks. l'm wondering if this isiust PM pursuing their own agenda. l'll push back an inem in gel speclfics about with wnam, where and when iney made inis agreement. Gary Appenfelder Director of Purchasing Metro Nashville Public Schools 2601 Avenue Nashville, TN 37204 Office "while a 29 er@mnps org 7 METRO bl" "l"f'llLC PUBLIC SCHOOLS From Felder, MoniqueT Sent: Tuesday, November 29, 2015 1:04 PM To: Appenfelder, Gary; Changas, Paul Cc Carlisle, Jana Subject: RE: Performance Matters payment schedule Hi'Gary, Thanks forthis update! I don't recall inis pan more discussion, but am looping in Paul Changas as ne is leading this effort. Best regards, Monique Monique r. Felder, Pnn, cniei Academic Officer Metro Nashville Public Schools 2601 Eransford Avenue TN 37204 Mu Felder Office 15725978690 vt, whenever wherever we Manse, sunnasstALLU IALL child rm whose schooling is of to we Manda move we Mani to pin that," RawaLDl almonds From: Appenrelder, Gary Sent: Tuesday, November 29, 2016 1:01 PM To: Felder, Monique T From: Carlisle, lana l. Sent: Thursday, December 1, 2015 1:05 PM To: Appentelder, Gary Cc: Henson, Chris Stark, Kenneth; Felder, Monique Changas, Paul Subject: RE: Perlormance Matters payment schedule lspoke with Monique last night. she says her priority is only the L5 schools piece (and associated with its implementation), We're thinking the piece is something that HR and Shannon Black wanted. Also Paul and discussed the opportunity to continue with SchoolNet through the end of the year and he telt he has money to do that did had a conversation with Dr. Joseph yesterday to try to find out his expectaliun and he also conveyed that we were implementing only in L5 schools but that other schools could have access Note that Monique thinks this would be confusing for schools and i think we are all in agreement, 50 L5 Schools, And yes take a hard stand with PM Jana Cal/fish faCD Chief of Staff Metro Nashville Public Schools 1501 Bransiotd Avenue Nashville, TN 37204 Office --6157259-8734 Mobile - STRATEGIC INPUT ACHIEVER RELATDR From: Appentelder, Gary Sent: Thursday, December 1, 2015 10:23 AM To: Felder, Monique changas, Paul Cc: Carlisle, lana Henson, chris Stark, Kenneth Subject: RE: Performance Matters payment schedule itallted at length again with Rocky and Woody. i asked Woody directly who at MNPS had agreed that the unity assessment product and the PD Management would be implemented and paid for simultaneously. He answered that the only time that was presented to MNPS as a bundled deal was at the meeting in Dr. loseph's conterenee room on Nov 16, I reminded him that was in that meeting, but don't recall any explicit statement or implication by the PM team that the proposals torthe two products were contingent upon simultaneous implementation, also reminded him that i had commented in that meeting that in the supportteam meetings l've attended, which included the department heads who would be responsible for the actual implementations, there was a strong desire to delay the PD Management product implementation so as to avoid overreaching our internal capacity to handle multiple simultaneous implementations. To this, Woody responded that it would be OK to postpone implementation utthe PG Management product until February 1, 2017, He wasvery polite and tactful about that, out at the same time very adamant. This is smelling very fishy and in the interests of Performance Management rather than MNPS. The separate contracts that we are p'iggybacking forthese two products were not contingent upon other implementations The proposals from PM do not provide any special pricing (beyond what the piggyback contracts provide), except that there would be no incremental Unify student license fees payable in the 201572017 school year regardless or how many students use the product, Although that sounds like lmay really be) a good deal, the fixed fee for Unify for 20152017 is $99,000, which is equivalent to prorated license fees for about 37,000 students. I have no idea it our realistic potential for number or students engaged in the system (on average for the period Emma; 2017) is way below or way above that. The only figure I've seen as an estimate of4,100 students from the 12 priority schools (provided in original proposal for Unify). Do we have a specific number of students that we are mandating to use the Unity product for assessments in the Spring semester of this school year? The PD Management product is the more expensive of the two. It has a $147,000 implementation charge, due up front, and an annual license fee oi$332,429 (based on 11,200 employees), which is due at the beginning oi each license year. That's $31,359 per month for the license fee compared to our current product (Pearson -- SchoolNet P0 Planner), which is costing us approximately $6,250 per month. The SchoolNet pruductw be replaced because Pearson support for the product will end. The initial information pruvlded to the MNPS team considering how to replace Pearson's PD product was that Person would discontinue support at the end ofthis school year. i confirmed with Pearson week before last that they are continuing support orthe SchoolNet product through June 2018 and we can continue use ofthe product after April 2017 on a month>>to-month basis at the cost mentioned above. The only reason that the PM (TrueNorthLogic) PD Management product has been considered and pursued is because (via the shelby County contract) it is immediately available withoutgoing through a formal solicitation. But, the immediacy ofthat need has been removed. My recommendation is to take a firm stance with Performance Matters that the TrueNorthLug'lc PD Management product is contractually unbundled from the Unity product so thatthe timing of implementation and fiscal liability is completely at our option. Further, asterms for both the TrueNorthLogic and the Unity products, I recommend that payment or initial license fees (and the start ofthe initial license periods) be contingent upon completion or implementation and successful acceptance testing by MNPs Gary Appenfelder Director of Purchasing Metro Nashville Public Schools 2601 Branslord Avenue Nashville TN 37204 Gal 3 enfelder mn sur 1' METRO PVC '1 PUBLIC SCHOOLS From Appenrelder, Gary Sent: Tuesday, November 29, 2016 4:35 PM 1 elder, Monique Changes, Paul arlisle,1ana Subject: RE: Performance Matters payment schedule DK. Thanks. I'm wondering if this isiust PM pursuing their own agenda. i'H push back on them to get specifics about with whom, where and when they made this agreement. Gary Appenfelder Director of Purchasing Metro Nashville Public Schools 2501 Brans/ord Avenue Nashville, TN 37204 PUBU SCHOOLS From: Felder, Monlque Sent: Tuesday, November 29, 2016 1:04 PM ppenfelder, Gary; Changas, Paul . Jana Subject: RE: Performance Matters payment schedule Hi Gary, Thanks torthis update! i don't recall this part of the dlscussian, but am looping in Paul changes as he is leadingthis efforL Best regards, Monique Monique T. Felder, chief/Academic oiticer Metro Nashville Public Schools 2501 Eiansfard Avenue Nashville, TN 37204 Mom lder Office 1545978690 'we win, whammy anal wherever we choose, successful/L5 teach all. children whose schooling ls 9f interest to hs. we hirehixlj let/tow more than we wee/i to pin that would Eolvhohols From: Appenl'elder, Gary Sent: Tuesday, November 29, 2015 1:01 PM To: Felder, Monique Subiect: Performance Matters payment schedule Monique, I had a phone conversation yesterday with the PM talk regarding a couple otminor language items torthe contracts, However, one of those items may be significant I had drafted contract language tortne PD Management product that gave us flexibility in scheduling the start of implementation tor that product, and would delay the annual license (torthe until the implementation is complete, PM states that the waiver aithe Unify annual license fee this iiscal year cost forimmediate implementation and unlimited usage through 6/30/16) was contingent upon immediate implementation oithe PD Management product in this school year implantation plus $3le license). I don't recall hearlng any comment about this during the meeting I attended with you, Sito, Dr. Joseph, and Woody Amy from PM. Is this bundling arrangement also your understanding of what's been agreed to? I don't want to acknowledge this arrangement if it's not something we've previously agreed to. Gary Appenielder Director of Purchasing Mel/'0 Nashvills Public Schulz/s 2601 Avenue Nashville TN 37204 615 2 8533 affine mobile Ga 3 enfelder run so! METRO PUBLIC SCHOOLS Reid, Nicole R From: Sent: To: Subject: Changas, Paul Friday, December 2, 2016 9:52 AM Russell, Toni M RE: Performance Matters payment schedule Toni, I should be available this morning to talk between 10:00 and 11:30 to talk if you have a few minutes. My direct line is 615-259-8425 and my cell is 615-480-4340. I think things are moving in the right direction but I have a followup meeting with Jana at 11:30. I spoke briefly to Lance yesterday and Ken this morning about the situation. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization - Analytical - Learner - Relator - Responsibility From: Russell, Toni M Sent: Thursday, December 01, 2016 11:27 AM To: Changas, Paul Subject: FW: Performance Matters payment schedule Good morning Paul, I let Ken know you were going to speak with Jana about PM yesterday. I wanted him aware in case he hears anything. How did your meeting go? We can have a call today if you want. Thanks, Toni From: Stark, Kenneth Sent: Thursday, December 01, 2016 10:36 AM To: Russell, Toni M ; Lott, Lance Subject: FW: Performance Matters payment schedule Just keeping you in the loop on this. From: Appenfelder, Gary Sent: Thursday, December 01, 2016 10:23 AM To: Felder, Monique T ; Changas, Paul Cc: Carlisle, Jana L ; Henson, Chris M ; Stark, Kenneth Subject: RE: Performance Matters payment schedule I talked at length again with Rocky and Woody. I asked Woody directly who at MNPS had agreed that the Unify assessment product and the PD Management would be implemented and paid for simultaneously. He answered that the only time that was presented to MNPS as a bundled deal was at the meeting in Dr. Joseph's conference room on Nov 16. I reminded him that I was in that meeting, but I don't recall any explicit statement or implication by the PM team that 27 the proposals for the two products were contingent upon simultaneous implementation, also reminded him that i had commented in that meeting that in the support team meetings l've attended, which included the department heads who would be responsible tor the actual implementations, there was a strong desire to delay the PD Management product implementation so asto avoid overreaching our internal capacity to handle multiple simultaneous implementations, To this, Woody responded that it would be OK to postpone implementation orthe PG Management product until February 1, 2017. no wasvery polite and tactrul about that, but at the same time very adamant. This is smelling very fishy and in the interests or Performance Management rather than MNPS. The separate contracts that we are piggybacking rorthese two products were not contingent upon other implementations The proposals irom PM do not provide any special pricing (beyond what the piggyback contracts pmvidei, except that there would be no incremental Unity student license fees payable in the 2015-2017 school year regardless at how many students use the product. Although that sounds like (may really be) a good deal, the fixed fee for Unify for 20154017 is $99,000, which is equivalent to profited license fees for about 37,000 students. have no idea if our realistic potential for number or students engaged in the system (on average forthe period Jan-May 2017) is way below or way above that. The only rigure l've seen as an estimate of 4,100 students from the 12 priority schools (provided in PM'soriginal proposal for Unify). Do we have a specific number or students that we are mandating to use the Unify product for assessments in the Spring semester orthis school year? The PD Management product is the more expensive ofthe two. it has a $147,000 implementation charge, due up tront, and an annual license fee of$382,429 (based on 11,200 employees), which is due at the beginning or each license year. That's $31,359 per month rorthe license tee compared to ourcurrent product (Pearson -- Schoolnlet PD Planner), which is costing us approximately $6,250 per month. The SchooINet product be replaced because Pearson support for the product will end. The initial information provided to the considering how to replace Pearson's PD product wasthat Person would discontinue support at the end ofthis school year, confirmed with Pearson week before last thatthey are continuing support of the SchoolNet product through lune 2018 and we can continue use of the product after April 2017 on a basis atthe cost mentioned above. The only reason that the PM PD Management product has been considered and pursued is because (via the shelby County contract) it is immediately available without going through a formal solicitation. But, the immediacy orthat need has been removed. My recommendation is to take a iirm stance with Performance Matters that (he TrUeNorthogic PD Management product is contractually unbundied trom the Unify product so that the timing or implementation and fiscal liability is completely at our option. Further, as terms ior both the Truenlorthtogic and the Unify products, recommend that payment orinitial license tees (and the start or the initial license periods) be contingent upon completion or implementation and successful acceptance testing by MNPS. Gary Appenielder Director of Purchasing Metro Nashvi/IB Public Schaols 2501 Bans/0rd Avenue Nashville TN 37204 office obile Ga a enfelder inn s.or mgrno P'Eileuc SCHOOLS Frum Appenfelder, Gary Sen Tuesday, November 29, 2016 4:35 PM To: Felder, Monique Changes, Paul 23 Cc: Carl'lsle, Jana Subjetx: RE: Performance Matters payment schedule OK. Thanks. I'm wondering if this isiust PM pursuing their own agenda. I'll push back on them to get specifics about with whom, where and when they made this agreement, Gary Appenlelder Director or Purchasing Maire Nashville Publlo Schools 2501 Branslald Avenue Nashvil TN 37204 oinos abile Ga enfelder inn 5.0 METRQ PUBLIC if . SCHOOLS Fro Felder, Monique'i' Sent: Tuesday, November 29, 2016 m4 PM To: Appenfelder, Gary; Changes, Paul ce- Carlisle, Jana Subject: RE: Performance Matters payment schedule Hi Gary, Thanks for this updafel i don't recall this part of the discussion, but am looping in Paul Changas as he is leading this effort. Best regards, Monique Monique T. Felder, ChiefAcademic Officer Metro Nashville Public Sehdels 2601 Eransford Avenue Nashville, TN 37204 Mo ue elder MNPs 'wc wiritMi/er and wL cheese, tench nu Lhildvm whose schaoliug Ls iwttvest to us we Maw mm tinny>> w: Meal to via that." ieovuztd Edmunds me ppenfelder,Gary Sent: Tuesday, November 29, 2016 1:01 PM TezFelder,MoniqueTPM States that the waiver of the Unify annual license fee this fiscal year cast for immediate implementation and unlimited usage through 6/30/16) was contingent upon immediate implementation oithe PD Management product in this school year implantation plus license). don't recall hearing any comment about this during the meeting I attended with you, Site, Dr,loseph, and Woody Amy from PM. is this bundling arrangement also your understanding otwhat's been agreed to? don't want to acknowledge this arrangement ifil's not something we've previously agreed to. Gary Appenleldar Director ol Purchasing Metro Nashville Pub/it: Schauls 2601 EmnsfurdAl/enue Nashvilla. TN 37204 515 33 allies obi/e Ga enielder rm ,0 "5.739; PUBLIC 11:. SCHOOLS 30 Reid, Nicole R From: Sent: To: Subject: Henson, Chris M Monday, December 5, 2016 11 :04 AM Appenfelder, Gary FW: Performance Matters payment schedule From: Joseph, Shawn Sent: Monday, December 05, 2016 11:03 AM To: Felder, Monique T Cc: Henson, Chris M Subject: Re: Performance Matters payment schedule I agree with Gary. We should have him follow up. Sent from my iPhone On Dec 1, 2016, at 8:26 PM, Felder, Monique T wrote: Hi Shawn, FYI. .. Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org Office: 615-259-8690 *Connectedness*Learner*Achiever*Relator*lntellection*lnput "We CCIII\,, wvievcever fAlfl,d wvierever we cvioose, S1A.ccessf1A.LL!j te!Acvi !ALL cviLLdrell\, wviose scviooLLVl-0 Ls of Lll\,terest to 1A.S. we IALrrnd!j R,11\,0W Vv\,OYe tvilAII\, we vceed to do tvilAt." - Roll\,/ALd sdVl,\,Oll\,ds From: Appenfelder, Gary Sent: Thursday, December 1, 2016 10:23 AM To: Felder, Monique T ; Changas, Paul Cc: Carlisle, Jana L ; Henson, Chris M ; Stark, Kenneth Subject: RE: Performance Matters payment schedule I talked at length again with Rocky and Woody. I asked Woody directly who at MNPS had agreed that the Unify assessment product and the PD Management would be implemented and paid for simultaneously. He answered that the only time that was presented to MNPS as a bundled deal was at the meeting in Dr. Joseph's conference room on Nov 16. I reminded him that I was in that meeting, but I don't recall any explicit statement or implication by the PM team that the proposals for the two products were contingent upon simultaneous implementation. I also reminded him that I had commented in that meeting that in the support team meetings I've attended, which included the department heads who would be responsible for the actual implementations, there was a strong desire 1 to delay the PD Management product implementation so as to avoid overreaching our internal capacity to handle multiple simultaneous implementations, To this, Woody responded that it would be OK to postpone implementation ofthe PG Management product until February 1, 2017. He was very polite and tactful about that, but at the same time very adamant This is smelling very fishy and in the interests of Performance Management rather than MNPs. The separate contracts that we are piggybacking for these two products were not contingent upon other implementations. The proposals from PM do not provide any special pricing (beyond what the piggyback contracts provide), except that there would be no incremental Un'iiy student license fees payable 'in the 2016-2017 school year regardless of how many students use the product Although that sounds like [may really be) a good deal, the fixed fee for unity for 2016-2017 is which is equivalent to pro rated license fees for about 37,000 students. have no idea if our realistic potential for number of students engaged in the system (on average forthe period Jan-May 2017) is way below orway above that. The only figure I've seen as an estimate of 4,100 students from the 12 priority schools lprovided in PM's original proposal for Unify). Do we have a specific numberof students that we are mandating to use the Unify product for assessments in the Spring semesterofthis school year? The PD Management product is the more expensive ofthe two. It has a $147,000 implementation charge, due up front, and an annual license fee of $332,429 (based on 11,200 employeesl, which is due at the beginning of each license year. That's $31,869 per month for the license fee compared to our current product (Pearson eSchoolNet PD Plannerl, which is costing us approximately $6,250 per month, The SchoolNet product be replaced because Pearson support forthe product will end. The initial information provided to the MNPS team considering how to replace Pearson's PD product was that Person would discontinue support at the end ofthis school year. confirmed with Pearson week before last thatthey are continuing support ofthe SchoolNet product through June 2013 and we can continue use of the product after April 2017 on a month-tu-month basis at the cost mentioned above, The only reason that the PM (TrueNorthLogici PD Management product has been considered and pursued is because lvia the shelby County contractl it is immediately available without going through a formal solicitation. But, the immediacy ofthat need has been removed. My recommendation is to take a firm stance with Performance Matters that the TrueNorthLog'ic PD Management product is contractually unbundled from the Unify product sothat the timing of implementation and fiscal liability is completely at ouroption. Further, as terms for both the TrueNorthLogic and the unify products, I recommend that payment of initial license fees (and the start ofthe initial license periods) be contingent upon completion of implementation and successful acceptance testing by MNPs, Gary Appentelder Director at Purchasing Metro Nashville Public Schools 2601 Bronsford Avenue Nashville TN 37204 Ga 8 enlelder ml 5.07 From Appenfelder, Gary Sen . uesday, November 29, 2016 4:35 PM To: Felder, Monique Changas, Paul Cc: Carlisle, Jana Subject: RE: Performance Matters payment schedule OK. Thanks. l'm wondering iithis is lust PM pursuing their own agenda. i'll push back on them to get specifics about with whom, where and when they made this agreement. Gary Appenfeldei Director oi Purchasing Metro Nashville Public 2601 Avenue Nashville TN 37204 Gag From Feider, MoniqueT Sent: Tuesday, November 25, 2015 1:04 PM 1o: Appenrelder, Gary; changas, Paul Cc: Jana Subject: RE: Performance Matters payment schedule Hi Gary, Thanks forthis updatel idan't recall this part at the discussion, but am looping in Paul Changes as he is leading this effort. Best regards, Monique Monique r. Felder, FILD chief Academic onicer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Mon gu 'we tn n, and we choose, tench oil chilnven whose schooling is of interest to M5. We levtnw may: med to dl: that." Rowan)! Edmovtois From: Appenrelcier, Gary Sent: Tuesday, November 29, 2015 1:01 PM ue.Felder mn s.or Subiect: Performance Matters payment schedule Monique, had a phone conversation yesterday with the PM folk regarding a couple ofminor language items forthe contracts. However, one of those items may be significant. I had drafted contract language for the PD Management product that (at gave us flexibility in scheduling the start oiimpiementation for that product, and would delay the annual license fee lforthe PD) until the implementation is complete. PM states that the waiveroithe Unify annual license fee this fiscal year cost for immediate implementation and unlimited usage through 6/30/16) was contingent upon immediate implementation ofthe PD Management product in this school year implantation plus iicensel. I don't recall hearing any comment about this during the meeting I attended with you, site, Dr. Joseph, and Woody gt Amy from PM. is this bundling arrangement also your understanding orwhat's been agreed to? i don't want to acknowledge this arrangement it it's not something we've previously agreed to. 3 Gary Appenfe'der Dream of Purchasing Metro Nashw/le Public Schouls 26m Eransford Avenue Nashw/Ie, TN 37204 Ffice while Ga enielder mn Sm Reid, Nicole From: Carh's'e, Jana Sent: Monday. December 5, 2016 1:05 PM To: Appenrewer, Gary Cc: Changes, Paul Subject: Re: Perlormance Matters payment schedme Woml Jana Carlisle Chief cf Sufi Metro Nashvil'e Public Schools on Dec 5, 2016,31: 1:01 PM, Appenfelder, Gary wrote: Waddya know! 1 gar wearkhe big whist'e. Gan] Appenfeldel Direcmr o1 Purchasmg Metro Nashville Pub/fa Schno/s 2607 BlansfordAvenue Nashville, TN 37204 Ga enfelder or From Henson, Sent: Monday, Deuember 05, 2015 11:04 AM To: Appenfelder, Gary Subject: FW: Performance Matters payment schedule From Joseph, Shawn Sen - Monday, Deoember as, 2015 11:03 AM To: Fewer, Monique Cc: Henson, Chn's Subject: Re: Performance Matters payment schedule I agree with Gary. We should have him follow up. Sent from my whone On Dec 1, 2015, at8:26 PM, Felder, wrote: Hi Shawn, Monique 1. Fe/der, pm. 19 Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org Office:615-259-8690 *Connectedness* Learner* Achiever* Re lator*I nte llectio n*In put "We wv,,, whev,,ever civu;I wherever we choose, successfuLLtJ tecich ciLL chLLc;lrev,, whose schooLLv,,g Ls of LV\,tere.st to us. we ciLrecic;l tJ ~v,,ow V\,l,Ore thci V\, we v,,eec;! to cloth cit." ~ ROVl,ClLc;{ Sc;!V1,1,ov,,cls From: Appenfelder, Gary Sent: Thursday, December 1, 2016 10:23 AM To: Felder, Monique T ; Changas, Paul Cc: Carlisle, Jana L ; Henson, Chris M ; Stark, Kenneth Subject: RE: Performance Matters payment schedule I talked at length again with Rocky and Woody. I asked Woody directly who at MNPS had agreed that the Unify assessment product and the PD Management would be implemented and paid for simultaneously. He answered that the only time that was presented to MNPS as a bundled deal was at the meeting in Dr. Joseph's conference room on Nov 16. I reminded him that I was in that meeting, but I don't recall any explicit statement or implication by the PM team that the proposals for the two products were contingent upon simultaneous implementation. I also reminded him that I had commented in that meeting that in the support team meetings I've attended, which included the department heads who would be responsible for the actual implementations, there was a strong desire to delay the PD Management product implementation so as to avoid overreaching our internal capacity to handle multiple simultaneous implementations. To this, Woody responded that it would be OK to postpone implementation of the PG Management product until February 1, 2017. He was very polite and tactful a bout that, but at the same time very adamant. This is smelling very fishy and in the interests of Performance Management rather than MNPS. The separate contracts that we are piggybacking for these two products were not contingent upon other implementations. The proposals from PM do not provide any special pricing (beyond what the piggyback contracts provide), except that there would be no incremental Unify student license fees payable in the 2016-2017 school year regardless of how many students use the product. Although that sounds like (may really be) a good deal, the fixed fee for Unify for 2016-2017 is $99,000, which is equivalent to pro-rated license fees for about 37,000 students. I have no idea if our realistic potential for number of students engaged in the system (on average for the period Jan-May 2017) is way below or way above that. The only figure I've seen as an estimate of 4,100 students from the 12 priority schools (provided in PM's original proposal for Unify). Do we have a specific number of students that we are mandating to use the Unify product for assessments in the Spring semester of this school year? The PD Management product is the more expensive of the two. It has a $147,000 implementation charge, due up front, and an annual license fee of $382,429 (based on 11,200 employees), which is due at the beginning of each license year. That's $31,869 per month for the license fee compared to our current product (Pearson - School Net PD 20 Plannel'l, which is costing us approximately $5,250 per month. The SchoolNet product be replaced because Pearson forthe product will end. The initial information provided to the MNPS team considering how to replace Pearson's PD product was that Person would discontinue support at the end ofthis school year. confirmed with Pearson week before lastthat they are continuing support ofthe schoolNet product through June 2018 and we can continue use ofthe product after April 2017 on a month-tomonth basis at the cost mentioned above. The only reason thatthe PM (TrueNorthLogic) PD Management product has been considered and pursued is because (via the Shelby County Contract) it is immediately available withaut going through a formal solicitation. But, the immediacy ortnat need has been removed, My recommendation is (0 take a firm stance with Performance Matters that the TrueNorthLogic PD Management product is contractually unbundled from the Unify product so that the timing oiimplementation and fiscal liability is completely at our option, Further, as termsfor both the TrueNorthtogic and the Unify products, recommend that payment of initial license fees land the start af the initial license periods) be contingent upon completion of implementation and successful acceptance testing by MNPS. Gary Appenfelder Director of Purchasing Metro Nashville Public schools 2501 BransiordAvenua Nashville, TN 37204 miles more i ris.o From. Appenfelder, Gary Sent: Tuesday, November 29, 2015 4:35 PM To: Felder, Monique Changes, Paul Cc: Jana Subject: RE: Performance Matters payment schedule OK. Thanks. l'm wondering if this is Just PM pursuing their own agenda. I'll push beckon them to get specifics about with whom, where and when they made this agreement, Gary Appenfelder Director of Purchasing Malia Nashville Public Schools 2501 Blansfurd Avenue TN 37204 615 2598533 office mobile Ga enfelder 5.0! From Felder, MoniqueT Sent: Tuesday, November 29, 2016 1:04 PM To: Appenfelder, Gary; Changas, Paul Cc: Carlisle, Jana Subject: RE: Performance Matters payment schedule 21 Re'd From: Aopenlelder, Gary Sen Monday, December 5, 2016 3:05 PM 1' . Stark, Kenneth;kussell. Toni Subject: FW: Perlormance Matters payment schedule Breakthroughl l'm contacting PM to clearly state that the PD module implementation will be on the schedule that we set, not them Although the Unify implementation will only involve the L5 schools thisyear, explanation is thatthere is no secondary or supplemental Installation vequired in order to have the product accessible by all schools in the district. Gary Appenlelder Director ol Purchasing Mam} Public Schools 2501 57911le Avenue Nashville, TN 37204 me more Ga ,3 enleldev mn 5.0 on; METRO SCHOOLS From' Henson, Chris Se onday, December 05, 2016 11:04 AM To: pperrlelder, Gary Subject: FW: Performance Matters payment schedule Prom Joseph, Shawn Sent: Monday, December 05, 2016 11:03 AM To: Felder, Monique Cc: Henson, chris Subject: Re: Performance Matters payment schedule lagree with Gary, We should have him lollow up. Sent lronr my iPhone on DEC 1, 2016, at8125 PM, Feldel, org> wrote' Hi Shawn, FVI Mmlique T, PILD. Chiel Academic Officer Metro Public Schools 49 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org Office :615-259-8690 * Connectedn ess * Learner * Achiever* Relater* Inte l lecti on * In put "We CC1111,, wvie111,evev ci111,cl wvievevev we e,vioose, s1A.e,e,essf1A.LL1j tecie,vi ciLL e,v,LLclve111, wviose se,viooLL111,g Ls of L111,tevest to IA.S. we ciLvecicltJ ~111,ow VVl-ove tvici111, we Vl,eecl to clo tvicit." - Ro111,ciLcl 5clVV1-0111,cls From: Appenfelder, Gary Sent: Thursday, December 1, 2016 10:23 AM To: Felder, Monique T ; Changas, Paul Cc: Carlisle, Jana L ; Henson, Chris M ; Stark, Kenneth Subject: RE: Performance Matters payment schedule I talked at length again with Rocky and Woody. I asked Woody directly who at MNPS had agreed that the Unify assessment product and the PD Management would be implemented and paid for simultaneously. He answered that the only time that was presented to MNPS as a bundled deal was at the meeting in Dr. Joseph's conference room on Nov 16. I reminded him that I was in that meeting, but I don't recall any explicit statement or implication by the PM team that the proposals for the two products were contingent upon simultaneous implementation . I also reminded him that I had commented in that meeting that in the support team meetings I've attended, which included the department heads who would be responsible for the actual implementations, there was a strong desire to delay the PD Management product implementation so as to avoid overreaching our internal capacity to handle multiple simultaneous implementations. To this, Woody responded that it would be OK to postpone implementation of the PG Management product until February 1, 2017. He was very polite and tactful about that, but at the same time very adamant. This is smelling very fishy and in the interests of Performance Management rather than MNPS. The separate contracts that we are piggybacking for these two products were not contingent upon other implementations. The proposals from PM do not provide any special pricing (beyond what the piggyback contracts provide), except that there would be no incremental Unify student license fees payable in the 2016-2017 school year regardless of how many students use the product. Although that sounds like (may really be) a good deal, the fixed fee for Unify for 2016-2017 is $99,000, which is equivalent to prorated license fees for about 37,000 students. I have no idea if our realistic potential for number of students engaged in the system (on average for the period Jan-May 2017) is way below or way above that. The only figure I've seen as an estimate of 4,100 students from the 12 priority schools (provided in PM's original proposal for Unify). Do we have a specific number of students that we are mandating to use the Unify product for assessments in the Spring semester of this school year? The PD Management product is the more expensive of the two. It has a $147,000 implementation charge, due up front, and an annual license fee of $382,429 (based on 11,200 employees), which is due at the beginning of each license year. That's $31,869 per month for the license fee compared to our current product (Pearson - School Net PD Planner), which is costing us approximately $6,250 per month. The School Net product must be replaced because Pearson support for the product will end. The initial information provided to the MNPS team considering how to replace Pearson's PD product was that Person would discontinue support at the end of this school year. I confirmed with Pearson week before last that they are continuing support of the School Net product through June 2018 and we can continue use of the product after April 2017 on a month-to-month basis at the cost mentioned above. The only reason that the PM (TrueNorthlogic) PD Management product has been considered and so pursued is because [via the Sheioy County contract) it is immediately available without going through a formal solicitation. But, the immediacy of that need has been removed. My recommendation is to take a firm stance with Performance Matters that the TrueNorthLogic PD Management product is contractually unbundled irom the Unify product so that the timing af implementation and liscal liability is completely at our option. Further, asterms for both the TrueNorthLogic and the Unity products, recommend that payment oiinitial license fees [and the start of the initial license periods) be contingent upon completion of implementation and successful acceptance testing by MNPS. Gary Appenleluer Director of Purchasing Mario Nashville Public Schools 2601 Stanford Avenue Nashville, TN 31204 615 259 sazoflroe mobile mn Ga enleldel ppenielcier, Gary Sen . Tuesday, November 29, 2015 4:35 PM To: Felder, Monique changas, Paul Cc: Carlisle, Jana Subject: RE: Performance Matters payment schedule ox. Thanks. I'm wondering it this is just PM pursulng theirown agenda. push back on them to get specifics about with whom, where and when they made this agreement. Gary Appenleldor Director at Purchasing Mam: Nashville Publlc Schools 2501 Bums/Did Avenue Nashvil TN 37204 815 259 maul/loo moblle mn del From: Felder, Monique sent: Tuesday, November 29, 2015 1:04 PM To: Appenfelder, Gary; Changes, Paul co: Jana Subject: RE: Perrormance Matters payment schedule Hi Gary, Thanks tor this updatel I don't recall this part or the discussion, but am looping in Paul changes as he is leading this elrort. Best regards, Monlque Monique T. reluer, chief Academic otilcer Metro Nashville Public Schools 51 1601 Bransfurd Avenue Nashville, TN 37204 Mon gu rg OlfI: 15-259-5590 'wc cm, wheMt/cr and we ahoosc, tench all thLrAvm whosc sampling is to us we alumni" iewow more than we mm to dating: Ronald Edmond; From: Appenfelder, Garv Sent: Tuesday, November 29, 2016 1:01 PM To: Felder, Monique sz From: Appenfelder, Gary Sem: Tuesday, December 6, 2016 933 AM To: Carlisle, lana Cc: Henson, chris Stark. Kenneth; Felder, Monique Changas, Paul Subject: RE: Performance Matters payment schedule i had a conference call with PM this morning iArny wieland and Rocky Samsl. I explained that our firm actual needs are Unify implementation per the schedule already underway, but solely involving our L5 schools for the 2015-2017 school year and (bi an indefinite start of implementation lit and when we decide to start) tor the TrueNorthtogic PD management product. There was no push back on this. I'll immediately send Amy, Rocky, and Woody an email confirming the conversation, followed quickly py revised drafts oithe separate contracts for each product, Payment schedules forthe Variaus pieces ofeach product (implementation setup, data initialization, training, licensing, etc.) will be based on dates that we trigger each, rather than full lump sum up front. Dec 31 is the end Chile PM fiscal Year, Their primary objective is to have executed contracts in hand before the end of the wni is doable. Payment scheduling during their FV can be somewhatflexlble, ifneeded, to accommodate our fiscal yearto fiscal yearfunding availability. Gary Appenfeider Director of Purchasing Melro Nashville Public SCHOOLS 2501 Erans/ardAl/enue Nashyf TN 37204 515 259 533 office ubils 2 METRO PUBLIC SCHOOLS cram: canistejanaI Sent: Thursday, December 01, 2016 1:06 PM To: Appenfelder, Gary Cc: Henson, Stark, Kenneth; Felder, Monique Changes, Paul Subject: RE: Performance Matters payment schedule spoke with Monique last night. she says her priority is only the LS schools piece (and associated with its implementationi. We're thinkingthe piece is something that HR and shannon Black wanted. Also Paul and discussed the opportunitvto continue with SchooiNet through the end ofthe year and he felt he has muney to do that. I did had a conversation with Dr. Joseph yesterday [0 (N in find out his expectation and he also conveyed that we were implementing only in L5 schools but that other Schools could have access. Note that Monique thinks this would be confusing for schools and I think We are all in agreement 50 L5 schools. And yes take a hard stand with PM jmia Cm'fi'sl'e, Chief of Staff Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN. 37204 Office - 515 259 8734 Mobile -- I. :o'c'iizt: STRATEGIC INPUT RELATOR From: Appenfelder, Gary Sent: Thursday, December 1, 2016 10:23 AM To elder, Monique changas, Paul Subject: RE: Performance Matters payment schedule i talked at length again with Rocky and Woody. i asked Woody directly who at MNPS had agreed that the Unify assessment product and the PD Management would be implemented and paid for simultaneously He answered thatthe only time that was presented to MNPS as a bundled deal was at the meeting in Dr. Joseph's conference room on Nov 16. I reminded him that I was in that meeting, but don't recall any explicit statement or implication by the PM team that the proposals forthe two products were contingent upon simultaneous implementation. I also reminded him that I had commented in that meeting that in the support team meetings l've attended, which included the department heads who would be responsible forthe actual implementations, there was a strong desire to delay the PD Management product implementation so as to avoid overreaching our internal capacity to handle multiple simultaneous implementations. To this, Woody responded that it would be on to postpone implementation otthe PG Management product until February 1, 2017. He wasvery polite and tactful about that, but at the same time very adamant. This is smelling very fishy and in the interests of Performance Management rather than MNPS. The separate contracts that we are piggybacki'ng for these two products were not contingent upon other implementations. The proposals from PM do not provide any special pricing (beyond what the piggyback contracts provide), except that there would be no incremental uniiy student license fees payable ln the 20154017 school year regardless of how many students use the product. Although that sounds like (may really be) a good deal, the fixed fee for Unify for 20164017 is $99,000, which is equivalent to prorated license fees for about 37,000 students. i have no idea lfour realistic potential for number of students engaged in the system (on average forthe period lan-May 2017) is way below or way above that. The only figure l've seen as an estimate of 4,100 students from the 12 (provided in PM's original proposal for Unify). Do we have a specific numberof students that we are mandating to use the Unify product for assessments in the Spring semester otthis school year? The PD Management product is the more expensive ofthe two. It has a $147,000 implementation charge, due upfront, and an annual license fee of$382,429 (based on 11,200 employees), which is due at the beginning of each license year. That's $31,869 per month forthe license fee compared to our current product (Pearson --5chooINet PD Planner), which is costing us approximately $5,250 per month. The SchoolNet pruduuM be replaced because Pearson support for the product will end, The initial information provided to the considering how to replace Pearson's PD product was that Person would discontinue support at the end of this school year. i confirmed with Pearson week before last that they are continuing support of the SchoolNet product through June 2013 and we can continue use ofthe product afterApril 2017 on a month-to-month basis at the cost mentioned above. The only reason that the PM (TrueNorthLogicl PD Management product has been considered and pursued is because (via the Shelby County contract) it is immediately available without going through a formal solicitation. But, the immediacy ofthat need has been removed My recommendation is to take a firm stance with Performance Matters that the TrueNorthLogic PD Management product is contractually unhundled rrom the Unity product so that the timing of implementation and fiscal liability is completely at ouroption Further, as terms for both the rrueNorthtogic and the Unity products, I recommend that payment of initial license tees (and the start orthe initial license periods) be contingent upon completion Of implementation and successful acceptance testing by Gary Appenfelder Director or Purchasing Melm Nashville Public Schools 2501 Eransford Avenue NashVi/l TN 37204 515 25 8533offlce mobile I METRO SCHOOLS From Appenfelder, Gary Sen . uesday, NDVember 29, 2016 4:35 PM To: Felder, Monique Changas, Paul Cc: Carlisle, Jana Subject: RE: Performance Matters payment schedule OK. Thanks. i'm wondering irthis isiust PM pursuing their own agenda, in push back on them to get specifics about with whom, where and when they made this agreement. Gary Appenfelder Director cl Purchasing Menu Nashville Pub/7c Selma/s 2607 EransfordAl/enue Nashville, TN 37204 office Whole Ga enlelder mn METRO liulal'le SCHOOLS From: Felder, Monique Sent: Tuesday, November 29, 2015 1:04 PM To: Appenfelder, Gary; Changas, Paul Cc: Carlisle, Jana Subject: RE: Performance Matters payment schedule Hi Gary, Thanks ior this updatel I don't recall this part orthe discussion, but am looping in Paul Changas as he is leading this etiort. Best regards, Monique I Felder, Chief Academic Officer Metro Nashville Public Schools 1501 Branslord Avenue Nashville, TN 37204 Mun gue org Offlce:615-Z 5948690 Relzwr'lntellectinn'lnpm "We can, 11le wherever we choose, teach all children whasc scMopLLVug of interest to us. we Alva/Mg Rwaw mun thaw we want ti; d2 that! Ramld Evin/tam: From: Appenielder, Gary Sent: Tuesday, November 29, 2015 1:01 PM To: Felder, MoniqueTReid oleR From: Appenlelder, Gary Sent: Tuesday, Decembere, 2016 10:40 AM To: Changas, Paul Subject: FW: Performance Matters payment schedule Paul, when we get around to full district deployment otthe Unify product (assessment analysis), will that include the Charter school students? since the annual license tee is $4.50 per student, it will make a significant difference in our annual cost. Gary Appenielder Director ol Purchasing Metro Pub/lo Schools 2601 Eransfard Avenue TN 37204 515 25 asaaofli'ce oblle El 92 @mnpsorg . 1' l' From. ppenfelder, Gary Ll 8 Sent: Tuesday, December 06, 2016 9:33 AM To: mrlisle, Jana Cc: Henson, chris stark, Kenneth; Felder, Monique changes, Paul Subject: RE: Performance Matters payment schedule I had a conference call with PM this morning [Amy Wieland and Rocky Samsl, I explained that ourrirm actual needs are Urll'fy implementation perthe schedule already underway, but solely involving our L5 schools torthe 2015-2017 school year and an indefinite start ol implementation (ifand when we decide to start) tor the TrueNorthLoglc PD management product. There was no push back on this, I'll immediately send Amy, Rocky, and Woody an email confirming the conversation, followed quickly by revised drafts oftne separate contracts for each product. Payment schedules furthe various pieces oleach product (implementation setup, data initialization, training, licensing, etc.) will be based on dates that we trigger each, rather than full lump sum up tront, Dec 21 isthe end orthe PM fiscal year. Thelr primary object'lve is to have executed contracts in hand before the end of the FV. This is doable. Payment scheduling during their FV can be somewhat flexible, if needed, to accommodate our fiscal yearto fiscal yearfullding availability. Gary Appenieider Dlreclar of Purchasing Metro Nashville Public Schools 2607 Blans10rdAvenus TN 37204 office mobile Ga enfelder mn s.or METRO Ni'li 1" PUBLIC SCHOOLS From: Jana Sent: Thursday, December 01, 2016 1:06 PM To: Appenfelder, Gary Cc: Henson, Chris Stark, Kenneth; Felder, Monlque Changes, Paul Subject: RE: Performance Matters payment schedule I spoke with Monique last night. she says her priority is only the L5 schools piece (and associated with its implementation). We're thinking the piece is something that HR and shannon Black wanted. Also Paul and I discussed the opportunity to continue with SchoolNetthrough the end otthe year and he relt he has money to do that. I did had a conversation with Dr. Joseph yesterday to try to find out his expectation and he also conveyed that we were implementing only in L5 schools butthat other schools could have access, Note that Monique thinks this would be canfusingfor schools and think we are all in agreement. St) L5 schools, And yestake a hard stand with PM Jana L. Ca7[is[e, 1M7.) Chief of Staff Metro Nashville Puhllc Schools 2501 Bransford Avenue Nashville, TN 37204 Office -- 515-259-8734 Mobile From ppentelder, Gary Sent: Thursday, December 1, 2016 10:23 AM To: Felder, MuniqueT; changes, Paul The separate contracts that we are piggybacking for these two products were not contingent upon other implementations. The proposals from PM do not provide any special pricing lbeyond whatthe piggyback contracts provide), except that there would be no incremental Unify student license fees payable in the 2016-2017 school year regardless orhow many students use the product. Although that sounds like (may really be) a good deal, the fixed ree for Unify for 20161017 is $99,000, which is equivalent to profited llcense fees for about 37,000 students. have no idea ifour realistic potential lot number of students engaged in the system (on average rorthe period Janell/lay 2017) is way below orway above that The only figure I've seen as an estimate uf4,100 students rrom the 12 priority schools (provided in PM's original proposal for Unify). Do we have a specific number ofstudents that we are mandating to use the Unity product ror assessments in the Spring semester orthis school year? The PD Management product isthe more expensive of the two. it has a $147,000 implementation charge, due upfront, and an annual license fee orsaismze (based on 11,200 employees), which is due at the beginning of each license year. That's $31,869 per month forthe license fee compared to our current product (PearsoanchoolNet PD Planner), which is costing us approximately $6,250 per month, The SchoolNet product be replaced because Pearson support for the product will end, The initial information provided to the MNPS team considering how to replace Pearson's PD product was that Person would discontinue support at the end nfthis school yeari confirmed with Pearson week before last that they are continuing support of the SchoalNet product through June 2018 and we can continue use ofthe product after April 2017 on a month-tesmuntn basis at the cost mentioned above. The only reason that the PM (TrueNurthLugic) PD Management product has been considered and pursued is because (via the Shelby County contract) it is immediately available without going through a tormai solicitation. out, the immediacy otthat need has been removed. My recommendation isto take a firm stance with Periormance Matters that the TrueNorthLogic PD Manageme product is contractually unbundied from the Unify product so that the timing oiimplementation and fiscal liabi is completely at our option. Further, as terms ror both the TrueNorthLogic and the Uniry products, i recommend that payment ofinitial license fees land the start oltiie initial license periods) be contingent upon completion or implementation and successrui acceptance testing by MNPs. Gary Appenfelder Direclor or Purchasing Metro Nashville Public Schools 2601 Bronsiom Avenue Nashville, TN 37204 515 259-8533 office mobile am eager) der@mngs,org SCHOOLS From Appenfelder, Gary Sen - Tuesday, November 29, 2016 4:35 PM To: Felder, Monique Changes, Paul Cc: Carlisie, Jana Subject: RE: Performance Matters payment schedule on Thanks. rm wondering ltthis is just PM pursuing their own agenda, l'll push back on them to get specifics about with whom, where and when They made this agreement. Gary Appenieider Director of Purchasing Metro Nashville Public schools 2601 Bransloid Avenue Nashville, TN 37204 515 25 8533mm mobile are er@mngs.org ET SCHOOLS From Felder, MoniqueT Sen Tuesday, November 29, 2016 1:04 PM To: Appenfelder, Gary; Changas, Paul Cc: Carlisle, Jana Subject: RE: Performance Matters payment schedule Hi Gary, Thanks for this update! i don't recall this part ofthe discussion, but am looping in Paul Changes as he is leading this eiiort Best regards, Monique Monique i, Felder, chiefAcademic Officer Metro Nashville Public Schools 2501 aransiord Avenue Nashville, TN 37204 Mauigu office:615-2saeasso eon, whtwaver AM we choose, teach nit ehudvcn whose stl/ioplivlg is of interest to us we among keyww man than w: laud ta pin that} Eel/mm Edmond: Fram2Appenfelder Gary Sent: Tuesday, November 29, 2016 1:01 PM To: Felder, Monique Dvrector of Purchasing Nashville Public Schools 2501 Bransford Avenue Nasth/e, TN 3720! mobile [y 99 der@mngs.crg METRO SCHOOLS From: Sent: To: Cc: Subject: Appenteider, Gary Tuesday, December 5.2015110} AM Amy wieiand Roderick Sams', Woody Dillaha RE: initial Legal Feedback 1, Regarding the redline items from your legal team, none ortnem present a problem except for the language added to section 3 Term. We cannot use autosrenewai or amuaexlensiun language. However, lwill add language to that section to clearly state that the contractls) can be extended incrementally outta a maximum of five years, i know yourAtturney would preferthe redline language, but l'm certain the alternative I described will be acceptable, 2. To recap our conversation this morning lplease correct me on anything rm misstating or misscremembering): a. b, The Unify product implementation and the TrueNorthLogic PD Management product will be unbundled for contractual and scheduling purposes, Our existing schedule for Unify implementation (already underway) is unchanged. Deployment in the 2016-2017 school year will be strictly limited to the Priority schools (less than 5,000 studentsl. Data setup for district deployment will be separately scheduled. Start date forthe schedule to implement the TrueNorthLogic PD Management product is to be determined. A number offacturs affect this, including the firm end date liune 30, 2018) of access to our current PD Management product. Our intent is to operate both products in parallel fur a period ottime, Best guess at timing for the start of TrueNorthLogic PD implementation is the fall of 2017. Next step is for Gary to send revised drafts of both contracts to PM far final review and edit ltarget today). Final settlement of mutually agreeable language is expected oythe end ofthis week. Upon final agreement of language, Gary will initiate electronic signature routing (via Docusign) of both contracts, Routing will be to PM first, then through the MNPS list of signers. Full execution to be completed oerore 12/31/15. Exceptrer scheduling, the TrueNorthLogic product contract and pricing is pretty it's a full deployment, regardless otthe start date. However, for the Unity product contract, my intention is to define pricing to resemble more closely the pricing rormat used in the proposal sent on actoper 24, so that it's ciearwhat elements and what multipliers apply to any tees due leg. student count, etc). Gary Appentelcier Director of Purchasing Mal/a Nashville Pub/in 2601 Brans/DIdAt/emie Nashville, TN 37204 @8533 Office SH obile amappen der@mngs org nip SCHOOLS METRO From: Amy Wieland Sent: Tuesday, December 05, 2016 9:08 AM To: Appenreider, Gary Cc: Roderick Sams; Woody Dillaha Subject: Initial Legal Feedback Hi Gary, Thank you so much for the call this morning. Attached is the initial feedback on your original draft document. We look forward to seeing your drafts as soon as they are available. As a goal, we hope to wrap up all paperwork by the end of this week. Of course, we understand we my need to follow up again next week depending on the initial reviews of the paperwork. Please feel free to reach out to us directly whenever you are ready. Regards, Amy Wieland Senior Vice President !Register toda~ for 2017 National rarners Conference: Making it Matter 407.462.9169 www.performancematters.com 2 Reid Nicole From: Changas. Paul Sent: Monday, December '12, 2016 4:44 PM To: McClarey, Jody Subjeck: FW: Contract and Quote for Metro Nashville Public Schools Aliachmentsz Metro Nashville Public School - MAP Contractdocx; Metropolitan Nashville Public Schools>> District Expansiontdoc; NWEA Northwest Evaluation Association Contract.pdi FYI From ppenfelder Gary Sent: Monday, December 12,1015 3:45 PM To: changas, Paul Subject: FW: Contract and Quote for Metro Nashville Public Schools Paul, i'm addressing the redline changes in the contract document Looks bad, but almostaii are OK. I need to check with Legal on the inoernnity clause. in the "District Expansion" doc, does that look DKto you? it implies a lump sum payment atthe point when you pull the trigger, which think is whatyou're anticipating. Main thing i want to pointout is that the rediine does Lat mention or loch in the pricing ofthe Math assessment. So, as redlined, if we later want to use the Math, it will have to be added as an amendment, Are you OK with that? Gary Appenielder Director of Purchasing Melm Nashville Public Schools 2601 Bransiord Avenue Nashville, TN 37204 files obl/e Gag aggenfe dei@mngs,org PUBLIC SCHOOLS sherry DeSimone [mallm hero}. deslmoneanea org] Sent: Sunday, December 11, 2015 5:07 PM To- Appenfelder, Gary Cc: Alison Levitt; Sherry DeSlmone Subject Contract and Quote for Metro Nashville Public Schools Good afiemoon Gary, Please accept our apologies for the delay in getting this back to you. We Wale waiting on our attorney to review and clarify a few things, With that said, below are some notes from our legal team with a couple of needed clarifications. Attached are the documents referenced below with the suggested edits to the contract, 31 1. The attached contract has our attorney's edits. (Please review and let us know if you have any questions or concerns. accept these changes, please incorporate the new language and return a signed copy to us for signatures. We will need this along with the other 2 documents attached. 2. The "not to exceed amount" on the contract reads $451,000 and our quote (Schedule A) is for roughly $381,000. Is it correct to assume that this is a set amount by MNPS to allow for average? Please advise. 3. The original cost proposal sent to Dr. Feh'ler and Dre Changas included the recommended professional development plan and research hours. These are not included on the attached quote (Schedule A) because MNPS has not decided exactly how many workshops will he needed. We are discussing this and will hopefully have the total determined by January. The first workshops are to take place the week ofJanuary Does this have to be determined before this contract gets signed? We are planning to send a separate quote for the PD package once the amount otdays is determined. Please advise if this can wait or you need these numbers and amount before proceeding with signatures. 4. The proposed amount for the PD package is $75,000, but again, there may be more or less workshops once all is determined and the number of staff to be trained is determined. Is the "not to exceed amount" ($451,000) on the attached contract supposed to cover PD, as well as, the student license? If that is the case, the current estimate will exceed that amount. Again, it may not be over, but we still need to know how to incorporate language onto that Schedule A once we know how many days they decide to purchase Once we get clarification on these items and you are satisfied with the language, we will need a full package signed and retumed for signatures from our team. Please ieview and let Alison know if you have any questions. I will be traveling out of the country this and will have very limited access to email, but will check in periodically. However, Alison will be happy to set up a call with our legal team if that would he more efficient for you. Just let us knowll Thanks again for your patience as we work these details out! Cheers, Sherry 5W sherry oesunone Regional Manager. Major Accounts East NWEA Partnering to Help All Kids Learn us on Fecebaok at NWsl/aluatlan or, follow us at twtiencame/i v: Navigator the NEW skills mastery and progress monitoring assessment from NWEAW 32 Reid, Nicole Frum: Carlisle, Jana Sent: Saturday, December 17. 2016 12:42 PM To: Changes, Gary Subject: Pevformance Matters Sorry. Public Impact is doing something else. The Perf Matters rep is attempting to run an end game Jana Caxlisle Chief of Metro Nashville Public Schools On Dec 17, 2016. at 10:24 AM, Carlisle, Jana gs.org> wrote: Hi- If possible could one of you call me? Vendor went in Monique about not giving all schools we made that decision. Jana Carlisle Chief of Staff Metro Nashville Public Schools 14 Reid, Nicole R From: Sent: To: Cc: Subject: Russell, Toni M Monday, December 19, 2016 1:29 PM Appenfelder, Gary Stark, Kenneth RE: Performance Matters 2-276664-01 : Unify Hi Gary, I noticed this includes $23K FY 2016-2017 and $953K future years. Is this binding us to PM for the full blown purchase to include PD? I didn't think we had determined we are for sure going with PM post Unify? I don't want to hold up progress but wanted to understand for sure what I am signing. Thanks, T From: DocuSign System [mailto:dse_na2@docusign .net] Sent: Monday, December 19, 2016 9:15 AM To: Russell, Toni M Subject: Performance Matters 2-276664-01 : Unify Error! Filename not specified. Gary Appenfelder gary.appenfelder@mnps.org 21 Stark, Kenneth Tuesday, December 20, 2015 10:45 AM . Appenfelder, Gary subject: RE: Performance Matters 2-275664-00: PD Management Thanks. From: Appenfelder, Gary 5e Tuesday, December 20, 2015 10:44 AM 1p: (ark, Kenneth Subject: RE: Performance Matters 17176564700: PD Management That's correct. The PD contract is very specifically set up so that no obligatlon starts until we trigger it and (hi the financial obligation (when we trigger it] is dependent on the numberof employees thatwe specify. an that last point, our assumption has always been that we need the seruicefprall employees. Gary Appenfelder Direclor of Purchasing Mam: Nashville Public Schools 2801 BranslamAl/snus TN 37204 615 2 5533 office mobile enfelder s.or METRO SCHOOLS From: Stark, Kenneth sent: Tuesday, December 20, 2016 10:12 AM To: Appenfelder, Gary Subject: RE: Performance Matters 2-276664-00: PD Management Gary, didn't realize we were mar/mg ahead with this portion. I knew we were ahead with the Unlfy parts, hut not the PD management part. I talked Toni and she says that you told her that we aren't necessarily obligated to mpve forward with this particular product even once the contract is in place. Is that accurate? Iknowthere isn't any cash flowing out from us for this preduetthis fiscal year. It is the amounts in subsequentyearsthat concern me. Ken From: DocuSign System [mailtoadse naZQdocusign.net] Sent: Tuesday, December 20, 2015 10:03 AM To: Stark, Kenneth Subject: Performance Matters 2-276664-00: PD Management Error! Filename not specified. Gary Appenfelder gary.appenfelder@mnps.org Kenneth Stark, Please DocuSign Performance Matters (2-276664-00) financial summary.docx, Performance Matters (2-276664-00) final 12-1516.docx, Performance Matters COl.pdf, Performance Matters (2276664-00) Exhibit A final.docx, Performance Matters (2-27666400) Exhibit B.pdf Thank You, Gary Appenfelder 9 Reid, Nicole R From: Sent: To: Cc: Subject: Williams, David S Thursday, January 5, 2017 5:47 PM Felder, Monique T;Changas, Paul;Pattullo, Kathryn;McClarey, Jody;Lineberger, Jan Ellen;Lipsey, Tamera K Jones, Katea J Assessments, 17-18 Hi everyone, This topic has bubbled up in conversations in various corners during the first semester. I think we need to sit down and have a formal discussion around assessments that will be offered next year. I like the framing for national, state, local. I want to be clear which are required (state/national), the policy it fulfills, and the function each assessment serves. I know we have most of this information already in some form. I want us to inspect any redundancies/overlaps and see if there is anything we can take off the table and/or streamline. For example: o o o Tammy, Monique, and I had a discussion about limiting TLA beyond a certain grade and reading level. We need to investigate if we want MAP to serve as a universal screener, for ELA and math if we move to both content areas, and if we will expand beyond grades 2-8. We need to decide if we will be administering district benchmark assessments (possibly through Performance Matters) and if they will be required. There's not a perfect time to discuss all of this, but I know we would all like to start this process now and have clarity sooner rather than later. There are certainly other assessment issues to discuss. Please send me those. I can set the agenda for the discussion and we can find a time/place to meet in the next few weeks. Since Monique is the hardest to pin down © I will let Katea let us know when she can attend. I think two hours is a good place to start and we can go from there for additional meetings. I would also like for us to think about scheduling the results analysis and implication trainings/sessions as we think about the suite of assessments. I think as we schedule assessments, we schedule follow up support, too. David David S. Williams, Ed.D. Interim Executive Director of Curriculum and Instruction Division of Teaching and Learning Metropolitan Nashville Public Schools 2601 Bransford Ave Nashville, TN 37204 Ideation I Adaptability I lntellection I Connectedness I Learner David. Wil/iams2@mnps.org (615) 259-8602 5 Foilow us on Twitter: @mnpsinstruction From: Carlisle, Jana Sent: Tuesday, January 24, 2017 1:30 PM To: "Leslie Eichei' Felder, Monique TLWEW, APR Eder Commwarmlw Office/r 314-965 -1 776 Mom. -- Twitter: From Matt McGh1e Date: Tuesday, January 24, 2017 at 11:17 AM To Subject: Fwd: Re: Partnership Introduction at the National Leamers Conference On January 17, 2017 at9:58138 AM, Matt Qpen'ormancemauersxam wrote: Nioe to meet you Monique and Jana Thanks iortne introductions Rocky. As Rocky mentioned, we're excited to be partnering MNPS and looking forward to some great things. As you know. we have our eventcoming up soon and I was hopeful we make a joint announcement ebouttne partnership. I'm guessing you have a communications or PR person ettne distii'cl'? Would you be able to make an introduction for me to that pelson? id love to start a conversation around this, Thanks so rnuoh. m@ Matt McGhie VP Marketing 80145124355 Register 2917 National Learner-s Conference: Rem- Tagalhei' On January 16, 2017 at 8:54:03 PM, Roderick Sams wrote: Good evening Monique and Jana, i hope is We at Periorrnance Matters are very exclted about our partnership with MNPS. So much so, we are plann'ing [0 make an announcement at our National Learners Conference next month. i'd like to introduce Matt Mrehie, who heads up our Marketing ream. I'm sure he has some questions in preparation, and i wanted him connected with both af you. Thanks again, and 100k forward to visiting soan! Rocky 29 From: Kovach, David B Sent: Wednesday, January 25, 2017 1:46 PM To: Changas, Paul Subject: Re: Communication to LS principals Thanks-let me know when you finalize with David. David David Kovach Acting Executive Officer LS Innovation Schools (615) 259-8553 Analytical, Connectedness, Ideation, Strategic, Relator From: "Changas, Paul" Date: Wednesday, January 25, 2017 at 12:00 PM To: "Kovach, David 8 11 Subject: Communication to LS principals David, As a follow-up to our meeting yesterday, I have drafted an email message for you to send to LS principals. I have touched base briefly with David Williams but I would like to follow up with him this afternoon before this communication goes out. He and I are in a meeting from 1:00 to 2:30 today and I just want to confirm that we will be able to pull from the entire school year's standards when we construct the end-of-year benchmark. Based upon my brief conversation with him yesterday, there may be an additional cost to the district for the fourth benchmark, but I should be able to cover this in my budget. I will follow up with you after I have had a chance to speak with David. Feel free to edit/modify any or all portions of the following draft. Principals, This email is to clarify the involvement of our LS schools this spring with Performance Matters Solutions. Performance Matters provides an assessment and reporting platform that will be utilized in all MNPS schools next school year. It provides improved functionality for the administration of district benchmark and classroom assessments, as well as integrated reporting and analytics that draw from a variety of data sources. Our LS schools will have the opportunity to preview Performance Matters prior to other schools in the district. While there had been interest in administering the third district benchmark assessment through this platform, we will continue to utilize Schoo/Net for those schools that choose to give the third district benchmark. We do not want to disrupt school schedules prior to the administration of this year's TNReady assessments. We will instead administer short end-ofyear benchmark assessments in English/LA and Math through Performance Matters in all LS schools. These benchmarks will draw from state academic standards covered throughout the school year. These assessments should therefore be correlated to TNReady and thus provide schools with a preliminary estimate of student end-of year achievement. 33 We will ask schools to administer the end-ofyear benchmark assessments the week of May 15. Each school will need to send one or two staff members to a half-day test administration training session the week of May 8. There will be opportunities to begin learning how to utilize the Performance Matters reports following the test administration. Please let me know ifyou have questions or would like additional information regarding Pe1formance Matters. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-84.30 Strengths: Individualization - Analytical - Learner - Relator - Responsibility 34 Reid, Nicole R From: Sent: To: Subject: Attachments: Sarah Webster Thursday, February 2, 2017 4:29 PM Changas, Paul Fwd: Executive meeting with Performance Matters at National Users Conference 2017SessionDetail_012517.pdf Dear Dr. Changas, I reached out to Jana Carlisle a few days ago regarding the scheduling of an Executive Meeting at the Perfo1mance Matters National Learners Conference next week. I spoke to Roderick Sams earlier today and he tells me that you are likely the person I should have reached out to. My apologies that the request is coming to you so late in the game, but are you and your team available to meet during the conference next week? The proposed time was Wednesday, Febrnary 8th at 10:15am. Thank you, Sarah ---------- Forwarded message---------From: Sarah Webster Date: Fri, Jan 27, 2017 at 9:42 AM Subject: Executive meeting with Perfonnance Matters at National Users Conference To: iana.carlisle@mnps.org Dem: Dr. Carlisle, By way of introduction, my name is Sarah and I am working with Rocky Sams and others on our National Learners Conference coming up in a couple weeks. I am working to coordinate a meeting between your team and our executives during the conference. Would Wednesday, February 8th at 10: 15 will work for you and your team? I realize that is during our breakout session two so I hope that doesn't cause a conflict for you and your team. I've attached the latest version of our session agenda for your reference. If this time does work, please let me know who from your team will be joining you and I will send an invite to eve1yone. Thank you and have a pleasant day, Sarah Sarah 1Web§for Events and Experiences l\1anager per· rmance matters~ A<:<:eletat.i.studentand Educator Growth (801) 895-3789 www.performancematters.com 4 Sarah Webster Events and Experiences Manager performanc~ .m· a·- t··. t·. .ers· ~~•,.. · · ·~E':.l.-·~·nf~ Accelerate Student and Edilcafc>r Gfowth (801) 895-3789 www.performancematters.com 5 Reid, Nicole R Changas, Paul Monday, February 27, 2017 5:12 PM Carlisle, Jana L RE: Item Bank for Performance Matters From: Sent: To: Subject: I spoke to Doug. He said he budgeted only the PD portion of Performance Matters, which is also known as True North Logic ($500,000). He did not budget the assessment component He said that Toni Russell and Ken Stark were discussing the full cost of implementation, but that was some time ago and he does not know if assessment was budgeted anywhere. My estimate of $435,000 is based upon the PM contract estimate of $387,000 for assessment and analytics and $48,000 for PD (20 days at $2400/day). We can probably cut back on PD and build internal capacity. Paul From: Carlisle, Jana L Sent: Monday, February 27, 2017 4:51 PM To: Changas, Paul Subject: Re: Item Bank for Performance Matters Double check! Jana L Carlisle Chief of Staff Metro Nashville Public Schools On Feb 27, 2017, at 4:28 PM, Changas, Paul wrote: Jana, Sorry, but I am not sure what you are asking ("de"?). Paul From: Carlisle, Jana L Sent: Monday, February 27, 2017 4:15 PM To: Changas, Paul Subject: Re: Item Bank for Performance Matters I just don't see it in his. Can you de please? Jana L Carlisle Chief of Staff Metro Nashville Public Schools On Feb 27, 2017, at 4:10 PM, Changas, Paul wrote: Jana, 402 No one indicated to me that the instructional management system was moving to my budget, and I asked Doug Renfro some time ago if he knew if Performance Matters would be in his budget. At that time I believe he thought that was the case since SchoolNet had been in Learning Tech's budget. If this needs to move to my department, that is fine. But as with SchoolNet, PM includes much more than just an assessment module. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization - Analytical - Learner - Relator - Responsibility From: Carlisle, Jana L Sent: Monday, February 27, 2017 3:35 PM To: Changas, Paul Subject: Re: Item Bank for Performance Matters Do we know where Performance Matters -- the $482k reference in your budget -is captured? I don't see it in Learning Tech or your budget. Jana L Carlisle Chief of Staff Metro Nashville Public Schools On Feb 15, 2017, at 6:06 PM, Changas, Paul wrote: I am fine with this. Although the selection of the item bank (thrciugh an RFP process) is being conducted by C&I, we are used to having assessments and assessment components/platforms put in our budget. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization - Analytical - Learner - Relator - Responsibility From: Carlisle, Jana L Sent: Wednesday, February 15, 2017 5:46 PM To: Changas, Paul Subject: RE: Item Bank for Performance Matters Does this make sense to you? If so, I'll let Glenda know. 403 Jana l. Ca'rfi'st'e, EMID Chief of Siaff Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN. 37204 Office -- 615 259-8734 Mobile INPUT RELATOR From hangas, Paul Sent: Tuesday, February 14, 2017 3:51 AM To: Carlisle, Jana Subject: FW: Item Bankiur Performance Matters FYI. Paul Paul Chang-ts Executive Director Research Assessment 81 Evaluation Metropolitan Nashville Public Schools Office 615--259-8430 sn individualization Analytical -- Lennie. -- Relutor Responsibility Fro enfro, Douglas Sent: Tuesday, February 14, 1017 8:33 AM To: Changas, Paul Doug Renfro douglasmufm Executive Director of Learning Technology and Librmy Services, GalluprCerliflcd Coach, CETL Office: 615-298-8456 Ext: 2404 Cell' Twitter: @dsrenfi'o 405 Reid. Nicole From: Changas, Faul Sent: Monday, February 27, 2017 5:45 PM To: Carlisle, lana Subject: RE: item Bank for Performance Matters SchoalNet has as PD component that we are currently using, so we will need a replacement at some palm in the Coming year. ltis my understanding thatthe PD module ofPM might notbe implemented until some point later in the school year But I do net think we can delay 0r drop PD without cnnfinulng with SchoolNet during that time. Sent: Monday, February 27, 2017 5:32 PM To: Changas, Paul Sublect: RE: Item Bank for Performance Matters Ugh. Now LT did budget fur the PD PM piece which lthoughtwe weren't doing.l mayjust swap those two items. Thoughts? and L. Cm'fl'sfe, 7511'. Chief ofstaff Nashville Public Schools 2501 Brahsford Avenue Nashville, TN. 37204 of": *515 259 3734 none-- STRATEGIC ACHIEVER RELATDR From hangas, Paul Sent: Monday, February 27, 2017 5:31 PM To: Carlisle, lana Subject: item Bank for Performance Matters I just spoke with Tani Russell, and she did nut budget for Performance Matters. So it does appear that the cost of assessment and logistics and associated training is not currently covered. Paul Fro lana Sent: Monday, February 27, 2017 4:51 PM To: Changes, Faul Chief of Staff Metro Nashville Public Schools On Feb 27, 2017, at 4:28 PM, Changas, Paul wrote: Jana, Sorry, but I am not sure what you are asking ("de"?). Paul From: Carlisle, Jana L Sent: Monday, February 27, 2017 4:15 PM To: Changas, Paul Subject: Re: Item Bank for Performance Matters I just don't see it in his. Can you de please? Jana L Carlisle Chief of Staff Metro Nashville Public Schools On Feb 27, 2017, at 4:10 PM, Changas, Paul wrote: Jana, No one indicated to me that the instructional management system was moving to my budget, and I asked Doug Renfro some time ago if he knew if Performance Matters would be in his budget. At that time I believe he thought that was the case since SchoolNet had been in Learning Tech's budget. If this needs to move to my department, that is fine. But as with SchoolNet, PM includes much more than just an assessment module. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization - Analytical - Learner - Relator - Responsibility From: Carlisle, Jana L Sent: Monday, February 27, 2017 3:35 PM To: Changas, Paul Subject: Re: Item Bank for Performance Matters Do we know where Performance Matters -- the $482k reference in your budget -is captured? I don't see it in Learning Tech or your budget. Jana L Carlisle 391 Chief of Staff Metro Nashville Public School: On Feb 15, 2017, at 6:06 PM, Paul wrote: I am fine with this. Althnugh the selection ufthe item bank [through an RFP process] is being conducted by C&l, we are used to having assassmems and assessment components/platforms put in our budget, Paul Paul Changas Executive Diiector Research, Assessment 3: Evaluation Metropolitan Nashville Public Schools Office. 615459-5430 indwidnaiinnan rAnalyuan -- Lumev'r Relaior -- stpmisibility arlisle, Jana Sent: Wednesday, February 15, 2017 5:46 PM To: cnangas, Paul INPUT REIATOR From. Changas, Paul SentzTuesday, February 14, 2017 3:51 AM To: Carlisle, Jana > -- Remnsibiliiy 3-32 From enfro, Douglas Sent: Tuesday, February 14, 2017 8:38 AM Tu: Changas, Paul Reid, Nicole R From: Sent: To: Subject: Changas, Paul Tuesday, February 28, 201710:20 AM Carlisle, Jana L RE: PD system Perf Matters Jana, It is my understanding that Doug only addressed the PD module of Performance Matters but not the $43 SK for the assessment module. Previously all of this was in his budget through SchoolNet. So it appears we still have $435K that has not been addressed. Ifwe need to cut costs, it may be possible to delay implementation of the PD module for a year and stay with SchoolNet (which is less costly) until then. Doug, Kelly Wade and Toni Russell may need to weigh in on this. However, Gary Appenfelder has told me that the contract with PM is written in such a way that we do not pay them for a module until it is implemented. Paul From: Carlisle, Jana L Sent: Tuesday, February 28, 2017 9:58 AM Changas, Paul Subject: PD system Perf Matters To: HiSo ... the amount Doug put in for the PD piece is necessary to replace SchoolNet as well as the $435k, right? Also are we implementing MAP M next year as well as MAP R? Thx J Jana L Carlisle Chief of Staff Metro Nashville Public Schools 389 Reid. Nicole From: Russell, Toni Sent: Monday, March 27, 2017 2:32 PM To: Changas, Paul Cc: Wade, Kelly SiLott, Lance Subject: RE: peri matters This is about a call i Subject: pelf matters He'lr When I sent the lM Kelly and lance had come over to talk to me and Ken about Performance Matters. We want to make sure again we are all in sync. Toni M. Russell Executive Director ofTeclmongy and information Serviees Metro Nashville Public Schools Office Phone: 615-259-8433 For fastest assistance with support needs, please contact the IT Help Desk at (615) 169-5956 or 355 Reid. Nicole From: Carlisle, Jana Sent: Tuesday, March 23, 2017 10:04 AM 10: Changes, Paul Cc: Brandon, Brigetle Subject: RE: Performance Manors who is going to dose the loop with Rocky? Jana Carfilrfe, 750(1) Chief of Staff Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN. 37204 Office - 615 259 8734 RELATOR Fro hangas, Paul Sent: Tuesday, March 23, 2017 10:03 AM To: Carlisle, Jana Cc: Brandon, Brigelte subjear: RE: Performance Mauers Jana, i am at Lakeview Elementary this morning with Dr. Joseph, Monique and sud. We bought odenorher contract and we have eosrs associated for different modules ifwe chuose rd purchase them. But I have confirmed multiple times With Gary [including yesterday). that there is no obligation to buy any module, Paul Paul Chan gas Executive Director Research, Assessment 8: Evaluation Metropolitan Nashville Public Schools Office- BIS-25978480 individuaiizezion Annlyucal -- Learner- a Mom From. Carlisle, Jana Sent: Tuesday, March 23, 2017 9:40 AM Tenthangas, PaulHi: lust tried to call boih numbers, lalso didn't think we were purchasing the evaluation portion. Deborah called me late last week and read me the contract which indicated we Also, there are monies in Tunis budget proposal for roughly the same amount forthe evaluation piece. I would trust Gary on it because he did the negotiating. I think Rocky may he trying to pull a fast one. Jana Jana Cmfi'sfe, Chief of Staff Metro Nashville Public Schools 2601 Btansiord Avenue Nashville, TN. 37204 Office -- 615725978734 Mobile ACHIEVER RELAYOR Fro hangas, Paul Sent: Monday, March 27, 2017 4:26 PM mn 5.0 Cc: Brandon, arigetteLReid Nicole From: Changas, Paul Sent: Tuesday, March 25, 2017 203 PM To: Carlisle, Jana Cc: Brandon, Brl'gelle Subject: RE: Periormance Matters Jana, close the loop with Rocky. I wanted to make sure we were on the same page before 1 reached out, We plan to go forward with assessment, reporting and professional development through Performance Matters, but not with evaluation. 1 will also ask Rotky to work through me regarding questions about district direction. Without going into detall here, Kelly and Shannon bath felt somewhat pressured/uncomfortable with the calls they received. Thank yuu. Paul Paul Changas Executive Director Research, Assessment 25: Evaluation Metropolitan Nashville Public Schools Office: 6 15-259>>3450 Analytical 7 Learner rRElaml' Respomlbillty From: Carlisle, Jana l. Sent: Tuesday, March 28, 2017 10:04 AM To: Changas, Paul Cc: Brandon, Brigette Subject: RE: Performance Matters Who is going to close the loop with Rocky? Jana Cnrfisle, 11D Chief of Staff Metro Nashville Public Schools 2501 Eransford Avenue Nashville, TN. 37204 Office -- 515-255-3734 Fro changes, Paul Sent: Tuesday, March 28, 2017 10:03 AM mn 5.0r 345 • Performance Matters would be also need to evaluate the structure of the QTI package in terms of the provision of meta data and how the elements are banked against the items (separate files, within the items themselves}. • Performance Matters supports the following item types, although the naming can vary by vendor: o Selected-response (including multi-response) o Extended text with rubric scoring o Text entry o Draw o Order o Associate o Matching o Drag-and-drop o Hotspot o Hot-text o Numeric grid o lnline choice o (math text within items) David S. Williams, Ed.D. Executive Director of Curriculum and Instruction Division of Teaching ancf Learning Metropolitan Nashville Public Schools 2607 Bransford Ave Nashville, TN 37204 Ideation l Adaptability I lntellection I Connectedness I Learner David.Wi/liams2@mnos.org (615) 259-8602 Follow us on Twitter: @mnpsinstruction 236 Reid, Nicole R From: Sent: To: Cc: Subject: Roderick Sams Friday, March 31, 2017 4:42 PM Changas, Paul patrice@performancematters.com; Carlisle, Jana L; Appenfelder, Gary; Story, Deborah; Stark, Kenneth; Amy Wieland Re: Performance Matters Implementation for 2017-18 Thanks Paul, I appreciate your note and the clarifying conversations from everyone. Performance Matters is definitely excited about our partnership and appreciate the opportunity to support teaching and learning in MNPS. Look forward to working with the team! Have a great weekend, Rocky On Tue, Mar 28, 2017 at 5:00 PM, Changas, Paul wrote: Rocky, After hearing from Kelly Wade and Shannon Black regarding recent conversations they had with you pertaining to the coming school year, I just want to make sure we are all on the same page. Our district has budgeted for the Unify assessment and analytics component and the Professional Development component for 2017-18. We are not purchasing the Evaluation module for the coming year. As I believe Shannon explained, the Tennessee Department of Education provides an evaluation platform to public school districts at no cost. And I believe Gary Appenfelder addressed in an earlier communication that the contracts we are piggybacking off for Unify and PD are not contingent upon other implementations. Feel free to contact me on my direct line, 615-259-8425, if you would like to discuss this further. We are excited about our partnership and look forward to the first assessment through Unify in selected schools in May. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization - Analytical - Learner - Relator - Responsibility 1 Roderick Sams, Ed.D. Director, Education Solutions (770) 283-4145 performance matters~ Accelerate Student and Educator Growth www.performancematters.com 2 Reid, Nicole R From: Sent: To: Cc: Subject: Fentress, Tamara Wednesday, April 19, 2017 9:29 AM Changas, Paul;Stenson, Christine M;Davis, Krista M Carlisle, Jana L Meeting Notes: Strategic Framework KPls - Baselines and Targets Good Morning, Please find my notes below for yesterday's meeting. Thank you for your time. ,.J Current Status The framework has been approved by the School Board. Finishing touches are being made on the attached file, but the Performance Measures listed on pages 21, 25, 29, and 33 are accurate. UPD Consulting will not be assisting with baselines and target setting on the overarching strategic framework measures. Dr. Joseph has shared interest in potentially hiring a statistician (he's done this in previous district(s)) to create a statistical model to inform the setting of targets. Baselines and targets are needed where available. A data planning agenda can be put into place for missing baseline information. Paul and Tina are expecting state to release performance data in October. Things to Consider How much do we want the targets to energize/stretch? Attainable, but also stretch What are the consequences based on the shifts and changes? o For instance, how aligned to the state accountability system do we want/need to be? o We could meet our own targets and then the state is coming in to take over. There is a growth model used by the state. The metrics used can be a little harder to explain. The state is moving away from gaps. o They are looking at how the subgroups are performing • The super subgroup at the min perf gate (not ED, ..... ) • Percent of students moving from below to approaching .... • Look at how students are moving on track and above ... • There will be subgroup level TVAAS growth data ...... If you look at bringing everybody up - and you need to bring one up faster than the other - it gets to be very difficult to close the gap. We must be sure to close the gap, but not bring down achievement... .. State cut scores for end of course considers 72-75 th percentile "on track" for college and career readiness. o The state has gone above the ACT bar. o Jana mentioned: When we show the ACT benchmarks, include where we are and how the state is showing performance ..... . Next Steps/Action Items Baselines and Targets are needed for the performance measures. Tamara o Take a first pass at determining what other departments (e.g. Student Health, HR, Student Support Services, etc.) own some ofthe other data points. o Draft template for collecting initial data and other planning information. Paul, Tina & l wrote: Jana, I just wanted to let you know as a follow-up to our discussion regarding Performance Matters with ELT yesterday that we have confirmed with the company that they do not have a curriculum management component of their software. We have an email from our project manager from PM, Patrice Hartnett, confirming this. This is consistent with what Doug Renfro and Kelly Wade had heard from PM previously, but we wanted to double check after yesterday's discussion. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization -Analytical - Learner - Relator - Responsibility 289 Reid, Nicole R From: Sent: To: Subject: Attachments: Appenfelder, Gary Wednesday, June 7, 2017 11:07 AM Changas, Paul FW: Performance Matters Invoices Nashville Inv 97275rev.pdf; Nashville Inv 104217.pdf; Nashville Inv 97276.pdf Paul, The second invoice listed below is regarding the PD Planner, so not in your department for funding. We haven't opted to activate it yet, so we won't be paying the first year license now anyway. The first invoice has a PO setup and has been received against, so I have submitted the invoice to Accounts Payable. No action required on your end. The third invoice is the first year license for district-wide implementation of Unify. I assume that we still intend to do that. Are we ready to activate it yet? If not, when do you anticipate that we will be activating the district-wide rollout? I'll respond back to PM after your response. Regards, Gary Appenfelder Director of Purchasing 2601 Bransford Avenue Nashville, TN 37204 (615) 259-8533 office (615) 566-1254 mobile Garv. appenfelder@mnps. orq From: Diana Sigrist [mailto:diana.sigrist@performancematters.com] Sent: Friday, June 2, 2017 10:48 AM To: Appenfelder, Gary , Subject: Performance Matters Invoices Good afternoon Gary, I hope you're doing well. I've attached the following invoices, please let me know if you have any questions: *Invoice #97275 for $39,250 dated 12/22/16 - this is under PO 423571 for the Unify product and is very past due, please provide payment status as soon as possible. *Invoice #97276 for $469,775 dated 7/1/17 - this is the remainder of the training and the first year of licensing for Unify, the invoice is being provided a bit early so that you have time to get any necessary approvals on your side. *Invoice# 104217 for $118,060 dated 5/30/17 - this is the first invoice under the contract for Evaluation, PD and Observation. 69 $. Compensation . .;a) . C~nlmctorshaii; to bl'i!.p~Dd ~t U1$ TOO$ ~ti<.! mtes. oont$fnt~d 111 exnrt!it A; bawd U!)on lhiii! follo\~f!g,schfWule p~YftJ~n~~ a1,1d re~Jptof in;,;?.lce. .. . · ; i}. . $116;00,o upcin~fwt ofSystetn·$~ll.lp,~nffCQnflgµtafion, ,,._ -.. . . ·. .. . . .. , . ii).·· $29,51~ upon oompiattonof Site·lmpfemE;m~etlon·and successful ~·fNPS am::epfartoo 1es:ting (lei.Ung m!'tU,oootogy. lo M mutv.;;iifJ" $:gre~ct upott · ot " iui •- It~~1.~, a~~~~~~~i~::·¢i;tt Qi~:ti zi:l~tfc~lbv,s: ~it!i ~~:~r 'ertiriioYees!obsetvers deJerriltfried. tiy MNPS and 0 baleq!nted·fiS ,n . .:$1 tixt]X!rernp1oy~ fot PLi: t:,1anag~m(ttit Sy$lttm, 21 ·$} SJV~tS pflr emp_loyee rorEv:h!\mtfon, •,$105 per ol)Se!Vef fcy C~m;.ratiorl,. Thank you so much and have a wonderful weekend! Diana Sigrist Assistant Controller 480-423-0118 x1105 www.performancematters.com 70 19 8 ~~ Reid, Nicole R From: Sent: To: Cc: Subject: Changas, Paul Sunday, July 30, 2017 2:03 PM Appenfelder, Gary Gossage, Jeff L RE: Please DocuSign this document: Hanover Letter of Agreement - Metro Nashville.pdf I apologize Gary. I tried to call you on Friday right after I spoke with Jana. I spoke with Jeff and then sent my email to the two of you. I waited for a couple of hours before signing the agreement but I should have confirmed that it was OK to sign before going further. It will not happen again. On a separate note, I had a call from Rocky Sams of Performance Matters on Friday. He asked if/when we would be implementing the Evaluation module of their product. I told him I was not aware of plans to implement at this time and that teacher evaluation was not under my purview, so I would need to consult with leadership. He then said that since we bought the product utilizing Shelby County's contract, which included evaluation, we would need to renegotiate the cost ifwe do not go with this module. I told him that was not my understanding and that I was not aware of anyone indicating we would purchase the evaluation module. I said I would need to discuss this with Jana and possibly others before we could respond. IfI recall from an earlier conversation you and I had, there is nothing in the Shelby County contract that obligated us to purchase all components that they purchased. I did not go into all of this with Rocky, as I wanted to discuss this with you or, if necessary, Metro Legal first. Thank you. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization - Analytical - Learner - Relator - Responsibility From: Appenfelder, Gary Sent: Friday, July 28, 2017 4:59 PM To: Changas, Paul Cc: Gossage, Jeff L Subject: RE: Please DocuSign this document: Hanover Letter of Agreement - Metro Nashville.pdf Paul, I realize that you already signed their document. You actually should not have. The contract we prepared is the document that needs to be executed. This should not cause a critical problem. I will contact Hanover and explain that the document you signed is not legally binding and we still need to execute the contract that they already approved. As before, I need to know the full account number that the funding is to come from before we can execute the contract. Going forward, your rule of thumb is to never sign a document that a vendor sends you unless I (or Jeff, who has transitioned into my position) have reviewed it and told you it's OK to sign. Regards, 1 Gary Appenteider Director of Purchasing 2601 Eransfurd Avenue Nashville, TN 37204 615 7.5 3533 Mike mobile Gar Ene er mn s.or Fro Changas, Paul sent: Friday, iuly 23, 2017 11:37 AM To: Appenfelder, Gary Subject: RE: Please DocuSign this document: Hanover Letter nl Agreements Metro Nashvillepdf Good call. Absolutely du Lot sign it. You've been clear with them that we are not ready tu proceed, We have nothing binding in place with them, and it needs to stay that way until you've got a clear funding path. Regards, Gary Appenteldsr Director of Purchasing 2501 Avenue Nashville, TN 37204 615 2598533 office abilE From: Changes, Paul Sent: Thursday, July 27, 2017 1:23 PM .A entelder mn 5.0r Cc: Neal, Mace O Subject: FW: Please DocuSign this document: Hanover Letter of Agreement - Metro Nashville.pdf Gary, I am forwarding an earlier email regarding Hanover Research. I never signed the letter of agreement since we have not yet secured funding. Jana was going to submit a budget amendment but I do not believe anything is guaranteed at this time. Hanover has asked me to sign, as this agreement runs out after tomorrow and this could delay services. My question is whether signing this agreement would obligate us for the funding. I do not intend to sign if this is binding. Thank you. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization - Analytical - Learner - Relator - Responsibility From: Changas, Paul Sent: Friday, June 30, 2017 10:12 AM To: Appenfelder, Gary Subject: FW: Please DocuSign this document: Hanover Letter of Agreement - Metro Nashville.pdf Gary, I am forwarding the letter of agreement that Hanover sent me. We have not finalized the funding although I am pretty confident that it will get worked out soon. Hanover would like this agreement signed now in order to assign someone to us. However, I want to make sure nothing is binding in this letter. Should I hold off signing until the funding is approved and we can go forward with the contract? Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization -Analytical - Learner - Relator - Responsibility From: DocuSign System [mailto:dse na2@docusign.net] Sent: Thursday, June 29, 2017 1:37 PM To: Changas, Paul Subject: Please DocuSign this document: Hanover Letter of Agreement - Metro Nashville.pdf ( '"• t= \ 1,, 3 Rachel Dotter sentyou a document to review and sign. REVIEW DOCUMENT Rachel Dotter rdotter@hanoverresearch.com Hi Paul, It sounds like wrapping up the contract might take longer than expected. We can work on the final details after the holiday, but in the interim, here is a Letter of Agreement for you to sign electronically (from your phone or computer). This Letter of Agreement will enable us to assign staff to MNPS in the same cycle as other large, urban districts that also plan to focus on program evaluation. Thanks! We're excited to work with you! Rachel Powered bYDocu~r.i,. Do Not Share This Email This email contains a secure link to DocuSign. Please do not share this email, link, or access code with others. Alternate Signing Method Visit DocuSign.com, click 'Access Documents', and enter the security code: 781EDE52983741AF9CA2FC789F25AE782 About DocuSign Sign documents electronically in just minutes. It's safe, secure, and legally binding. Whether you're in an office, at home, on-the-go -- or even across the 4 globe -- DocuSign provides a professional trusted solution for Digital Transaction Management™. Questions about the Document? If you need to modify the document or have questions about the details in the document, please reach out to the sender by emailing them directly. If you are having trouble signing the document, please visit the Help with Signing page on our Support Center. .'! Download the DocuSign App This message was sent to you by Rachel Dotter who is using the DocuSign Electronic Signature Service. If you would rather not receive email from this sender you may contact the sender with your request. 5 Reid Nicole From: Appenfelder, Gary Sent: Sunday, July 30, 2017 9:i4 PM To: Changes, Paul Cc: Gossage, left Subject: RE: Please DocuSign this document: Hanover Letterot Agreement . Metro Nashvillepdt Jeff and I switched out phones in the middle of last week and temporarily lost contact with the world. My phone [now lettsl would not audibly ring for incoming calls. Fixed now. On the first, don't be concerned. This is easy to correct course on. To do that, i do need the account number that will be used. You answered Rocky exactly correctly. We very carefully did n_ot commit to the hill set of services thatShelby County did. All pieces are Liand when we decide to order. For any and all price and commitment issues/questions that Rocky (or anyone else at Performance Matters) may have, you should referthem toleff and me. Raga rds, Gary Appenfeider Director of Purchasing 2601 Bransford Avenue Nashville, TN 37204 (615) 2598533 office _wbile en elder mn s,or From changas, Paul Sent: Sunday, luly 30, 2u17 2:03 PM To: Appentelder, Gary Paul Paul Cllangas Executive Director Research, Assessment 8: Evaluation Metropolitan Nashville Public School: Office. 615e259-84-50 Strength - lndividuahzatlon Analyliul Learner -- nclatol- Responsi lliry From ppenfelder, Gary Sent: Friday, July 28, 2017 4:59 PM as run my mn sor Subject: RE: Please DocuSign this document: Hanover Letter ongVeement- Metro Nashvillepdt Paul, I realize that you already signed their document. Vou actually should not have. The contract we prepared is the documentthat needs to be executed. This should not cause a critical problem. contact Hanover and explain that the document you signed is not legally and we still need to execute the contractthat they already approved. As before, i need to know the full account number that the funding is to come from before we can execute the contract. Going forward, your rule ofthumb is to never sign a document that a vendor sends you unless lorlert, who has transitioned into my position) have reviewed itand told you it's sign Regards, Gary Appenfelder Director of Purchasing 2601 Bransford Avenue Nashville, TN 37204 From: Changes, Paul Sent: Friday, July 23, 2017 11:37 AM To: Appenfelder, Gary (Gar .A enfelder mn s.or Cc: Gossage, Jeff Metropolitan Nashville Public Schools omce. 615795978480 Strength:- lndiviuualization -- Analytiml Learner Rentin- . Responsibility From. ppenfelder,Garv Sent: Thursday, July 27, 2017 3:41 PM To: changes, Paul Subject: FW: Please DocuSlgn this document: Hanover Letter ongreement - Metro Nashvillepdt Gary, 1 am forwarding an earlier email regarding Hanover Research. 1 never signed the letter ofagreement since we have not yet secured funding. lana was going to submit a budget amendment but I do not believe anything is guaranteed at this time. Hanover has asked me to sign, as this agreement runs out after tomorrow and this could delay services. My question is Whether signing this agreement would obligate us for the funding, I do not intend to Sign if this is binding. Thank you, Paul Paul Changzs Executive Director Research, Assessment 8: Evaluation Metropolitan Nashville Public Schools Office: 615459--8450 individushzatiun eAnalyxianl Learner Relatoi aerponsihility hangas, Paul Sent: Friday, June 30, 2017 10:12 AM To: Apnenielder, Gary <Gary, I am forwarding the letter of agreement that Hanover sent me. We have not finalized the funding although I am pretty confident that it will get worked out soon. Hanover would like this agreement signed now in order to assign someone to us. However, I want to make sure nothing is binding in this letter. Should I hold off signing until the funding is approved and we can go forward with the contract? Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-84.'30 Strengths: Individualization -Analytical - Learner Relator - Responsibility From: DocuSign System [mailto:dse na2@docusign.net] Sent: Thursday, June 29, 2017 1:37 PM To: Changas, Paul Subject: Please DocuSign this document: Hanover Letter of Agreement - Metro Nashville.pdf Rachel Dotter rdotter@hanoverresearch.com Hi Paul, It sounds like wrapping up the contract might take longer than expected. We can work on the final details after the holiday, but in 9 the interim, here is a Letter of Agreement for you to sign electronically (from your phone or computer). This Letter of Agreement will enable us to assign staff to MNPS in the same cycle as other large, urban districts that also plan to focus on program evaluation. Thanks! We're excited to work with you! Rachel Powered byDocu)~ Do Not Share This Email This email contains a secure link to DocuSign. Please do not share this email, link, or access code with others. Alternate Signing Method Visit DocuSign.com, click 'Access Documents', and enter the security code: 781EDE52983741AF9CA2FC789F25AE782 About DocuSign Sign documents electronically in just minutes. lt's safe, secure, and legally binding. Whether you're in an office, at home, on-the-go -- or even across the globe -- DocuSign provides a professional trusted solution for Digital Transaction Management™. Questions about the Document? If you need to modify the document or have questions about the details in the document, please reach out to the sender by emailing them directly. If you are having trouble signing the document, please visit the Help with Signing page on our Support Center. ";!°:_ Download the DocuSign App This message was sent to you by Rachel Dotter who is using the DocuSlgn Electronic Signature Service. If you would rather not receive email from this sender you may contact the sender with your request. 10 Reid Nicole From: Appenfelder, Gary Sent: Monday, July 31, am 3:58 PM To: Diana Slgrisl Cc: Gossage, Jelf Wade, Kelly 5 Subject: RE: Performance Maners Invoice D'lana, we have not scheduled, ordered or activated the Management product yet, so billing is premature, Regards, Gary Appenfelder 2501 Bransfard Avenue Nashville, TN 37204 615 259 532 uffice mobile 1 2Q @mngs,org From: Diana Sigrisl Sent: Monday, July 31, 2017 12:07 PM To: Appenfelder, Gary Subject: Performance Matters Invoice Good morning Gary, I've attached the invoice for licensing ofPD Management for the amount of actual users for that module. So far Evalualion and Calibration are not ready so no users have been billed for these modules. Please let me know if you have any questions. Thank you! Diana Si grist Assistant Controller mm 480-423-0118 X1105 Reid, Nicole R Gossage, Jeff L Wednesday, August 2, 2017 3:24 PM Appenfelder, Gary Performance Matters Call From: Sent: To: Subject: Gary, I spoke with Amy Whielan (sp?) at Performance Matters, she claims to be confused by your email. I knew only a piece of this and shared with her that I did not believe we had agreed to the implementation of all 3 modules (Analytics, Evaluations, and PD). She said it has been done and we owe for it. I shared the language from contract 2-276664 that reads: Services provided under this Contract will be ordered and supplied on an as needed basis only. Nothing in this Contract shall be construed as a minimum guarantee of services to be ordered from Contractor. She was unmoved. Her phone number is (407) 462-9169 Jeff L. Gossage c.P.M. Metropolitan Nashville Public Schools 2601 Bransford Ave., Nashville, TN 37204 ph. 615-259-8533 J e-mail jeff.gossage@mnps.org ✓':iii;"';· METRO ;~/. ; 'J' ·:• '.}; . ... .t:•· f PUBLIC :. ,-.,. · '· SCHOOLS 1 Reid, Nicole R From: Sent: To: Cc: Subject: Attachments: Director of Schools Wednesday, August 16, 2017 9:16 AM 'adam.klaber@performancematters.com' 'woody.dillaha@performancematters.com';'roderick.sams@performancematters.com';'d ave.nelson@performancematters.com' Issues with Performance Matters Performance Matters Communication 8-14-17.pdf Please see the attached letter requesting a response. Thanks, Shawn Shawn Joseph, Ed.D. Director of Schools Metropolitan Nashville PublicSchools 2601 Bransford Avenue Nashville, TN 37204 615-259-8421 phone 615-214-8850 fax 391 METRO SHAWN JOSEPH, ED.D. Director of Schools 615.259.8421 PUBLIC SCHOOLS 615.214.8B50 Directo1ofsd,ools@rnnps.org @MNPSDirector August 14, 2017 Adam Klaber, Chief Executive Officer Perfonnance Matters Dear Mr. Klaber, As you know, our Technology and lnfonnation Services team recently discovered a data security vulnerability in the Unify Assessment platfo1m. MNPS users with district administrator roles were able to access student level Personally Identifiable lnfomrntion (PII) within other school districts through the "Impersonate User" function. We reported this issue to Woody Dillaha on Friday, August IL and we \Vere notified by Amy Wieland the next morning that the problem appeared to be fixed. Our team was able to confirm this morning that the process we followed previously no longer allows us access to information from other districts. We appreciate your company's timely response to this serious matter. Our team had a phone call with Dave Nelson and Nick Coniglio this morning and shared with them some questions that still remain. We would like to know when the problem was introduced, as the list of users in Unify from outside of our district recently changed significantly. It now includes about 60 users from outside of MNPS. Please provide us with a list that includes the names and roles of Performance Matters staff who are assigned to our Unify implementation and are authorized to access our data. In addition, if an audit trail can be generated, we tequest a list of individuals that have accessed our site since our stu_dent data was loaded last spring. We look forward to your timely response to the above requests. If you have specific questions regarding these requests, please direct those to Paul Changas, Executive Director of Research, Assessment and Evaluation (6 l 5-259-8425; ''-1·1I ·\-~(d: r·l1· --1•1-t<•,.··, ,_ti. .. 1t,-- .. .::.'ll' ~·....'JI'") _~. .·:: ... Thank you. Sincerely, (2 ·?"G·0'.1 :s,RiANSFORD AVENUE, NASHVILLE, TN a:,';;2.-0,4., ;..•. Reid, Nicole R From: Sent: To: Cc: Subject: Enterline, Katherine Wednesday, August 16, 2017 2:09 PM Lott, Lance;Russell, Toni M Wade, Kelly S;Changas, Paul RE: My notes from Performance Matters call today...... I have nothing additional in my notes from the call. Katy Enterline Miller Manager - Instructional Applications 615.259.8426 From: Lott, Lance Sent: Wednesday, August 16, 2017 1:57 PM To: Russell, Toni M Cc: Wade, Kelly S ; Enterline, Katherine ; Changas, Paul Subject: My notes from Performance Matters call today ...... We had a call with Performance Matters today to answer some of the questions that we left them with. Jeff? (not sure of last name) is the VP, Security and he spoke to our questions. 1. Who from PM staff has access and who should have access to MNPS data? They are sending a list of employees currently having access to Paul. They cautioned us that this is a rather long list due to an "all hands on deck" testing of their latest release. They are also telling us who should be on this list permanently to work on our account. Paul will share this list with us and we will discuss. (Note: I thought about after the fact but did not ask why so many people needed access to our account data to do testing.) 2. They opened a Security Incident Response item in their log. They will send to me the current version of the incident with all of the notes and Will update us as the incident is updated. 3. Jeff discussed with us when and how this incident was introduced. The incident was introduced on July 14th when a code update was implemented. In the backend of a SQL table a security constraint should have been checked that was not. When we reported the problem it was immediately escalated and the fix was implemented last Friday night at midnight (Mountain time). This was fixed on Aug. 11 which means the data was exposed for four weeks. He also disclosed that they have over 1,000 regression tests that they do with each release. This issue was not included in their current test cases and they have listed as an Edge case. They have included it in their suite of test cases going forward. 4. The Palm Beach user was discussed. This person was erroneously assigned to the Performance Matters security group - and was not a contractor. They stated that the user had restricted rights and would have been prohibited from logging in and seeing our data. Katy's observations supported this. 5. Lastly, we discussed the audit capability of Unify. They do have audit capability for adds and changes but as of now the product does not have an audit capability for access. They do run a Gray Log on the backend (looks at failed login attempts I believe) but this has not proven to be of use at looking who might have accessed. They are having discussions now about making a commitment to add this capability to the product. Kelly/Katy/Paul - any additions? Lance 387 Reid, Nicole R From: Sent: To: Subject: Bryant, Melissa Thursday, August 17, 2017 11 :48 AM Changas, Paul;Carlisle, Jana L;Joseph, Shawn FW: Issues with Performance Matters From: Adam Klaber [mailto:adam.klaber@performancematters.com] Sent: Wednesday, August 16, 2017 2:09 PM To: Director of Schools Cc: woody.dillaha@performancematters.com; roderick.sams@performancematters.com; dave.nelson@performancematters.com; Nick Coniglio ; Jeff Hall Subject: Re: Issues with Performance Matters Shawn, I have been very aware of the issue you described in your letter since it was identified by your team last week . We have a formal security incident report documenting the problem and the actions we have and are taking. Through that report process we will get back to you on the specifics of your questions which the team this morning discussed as well. We all at Performance Matters very much value your business and regret the occun-ence of this issue. Protecting personally identifiable infonnation is a company-wide priority for us and we are committed to protecting your information. As we come to closure with this issue and back to school calms down, I look forward to meet you and members of your team to debrief on this topic and more importantly discuss ways we can best work together to enhance student performance. I'll be in touch to arrange that session. Adam J. J(laber ChiefExecuti\'e Officer perfo.rmarfr:~ matters,~ A.«dni~_u;,.~nt.t."ldlf~~~G!'m.~· 914.954.9282 www.performancematters.com 385 On Wed, Aug 16, 2017 at 8:16 AM, Director of Schools wrote: Please see the attached letter requesting a response. Thanks, Shawn Shawn Joseph, Ed.D. Director of Schools Metropolitan Nashville PublicSchools 2601 Bransford A venue Nashville, TN 37204 615-259-8421 phone 615-214-8850 fax www.mnps.org 386 Reid, Nicole R From: Sent: To: Subject: Attachments: Wade, Kelly S Monday, August 28, 2017 6:28 PM Renfro, Douglas;Changas, Paul FW: Performance Matters Invoices Nashville Inv 104217.pdf; Nashville Inv 97276.pdf; Nashville Inv 132095.pdf Doug - 2 of these invoices are yours. Paul - one is yours. KeHy S, Wade (formerly McKinney) Infinite Campus/Filebound/HealthOffice/Schoolnet Administrator 2601 Bransford Avenue, Nashville, TN 37204 0 Building kelly. wade@mnps.org From: Diana Sigrist [mailto:diana.sigrist@performancematters.com] Sent: Monday, August 28, 2017 5:22 PM To: Wade, Kelly S ; Appenfelder, Gary Cc: Roderick Sams Subject: Performance Matt~rs Invoices Good afternoon Kelly and Gary, I hope you're doing well. I was wondering if you can provide a payment status for the attached invoices. Invoice# 104217 and 97276 are past due. Invoice#132095 is due this Thursday. I appreciate your time on this. Thank you so much! Diana Sigrist Assistant Controller pe . . r111a·~ct matters•.~ Acc.eforatli Shtdenland ~duciiforGrowth www.performancematters.com . 480-423-0118 xl 105 351 Invoice Performance Matters LLC 8860 East Chaparral Road Suite 100 Scottsdale, AZ 85250 Phone: (480) 423-0118 x1105 Date 5/30/2017 Invoice# 104217 PO# Terms Net 30 Due Date 6/29/2017 Bill To Metropolitan Nashville Public Schools 2601 Bransford Avenue Nashville TN 37204 Quantity Description Start of System Setup and Configuration Total Amount Due Amount 118,060.00 118,060.00 $118,060.00 Wire and ACH Instructions: Account Number: 3300975888 Routing/ASA Number: 121140~99 SWIFT#: SVBKUS6S Bank Name: Silicon Valley Bank 3003 Tasman Drive Pasadena CA 95054 L.', .. L.,.:., .. . : ..... : V':~nr.y Bonk .,.'"·' ,Jsrnan Drive t:•2};0,0;:_ma CA 95054 .;_,:;• Invoice Performance Matters LLC 8860 East Chaparral Road Suite 100 Scottsdale, AZ 85250 Phone: (480) 423-0118 x1105 Date 7/1/2017 Invoice# 97276 PO# Contract 2-276664-01 Terms Net 30 Due Date 7/31/2017 Bill To Metropolitan Nashville Public Schools 2601 Bransford Avenue Nashville TN 37204 Quantity Description One-hour Webinar Amount 3,575.00 11 Onsite Training 15 36,000.00 Onsite Certification Training Class 10 43,200.00 86000 387,000.00 Unify Assessment and Analytics - District Wide July 1, 2017 - June 30, 2018 Total Amount Due Wire and ACH Instructions: Account Number: 3300975888 Routing/ASA Number: 121140399 SWIFT#: SVBKUS6S Bank-Name: Silicon Valley Bank 3003 Tasman Drive Pasadena CA 95054 ,,· ,, . . .,.;;1~. . -~1:.-; ·~ ~:rivt'! . ~. ,.::;\ HSCSli 469,775.00 $469,775.00 Invoice erf r atters, Performance Matters LLC 8860 East Chaparral Road Suite 100 Scottsdale, AZ 85250 Phone: (480) 423-0118 x1105 Date 7/31/2017 Invoice# 132095 PO# 436147 000 OH Terms Net30 Due Date 8/30/2017 Bill To Metropolitan Nashville Public Schools 2601 Bransford Avenue Nashville TN 37204 Description Annual Subscription - PD Managment System at $11.66 per user (7/1/17-6/30/18) Quantity 13,237 Total Amount Due Wire and ACH Instructions: Account Number: 3300975888 Routing/ASA Number: 121140399 · SWIFT#: SVBKUS6S -:. .,i:"•i EBank Name: 11:-:~1~:·;, Driv:::· ,:,-.:,.·,,. , •,' ~ ~., ~ (·:. Silicon Valley Bank · · ;,_v ; , . ,~ Pasadena CA 95054·;r,,:;;:, ('!, <)i;()G..; ·:.::: ,•, ... Amount 154,343.42 154,343.42 $154,343.42 Reid, Nicole R From: Sent: To: Cc: Subject: Attachments: Changas, Paul Thursday, September 14, 2017 9:25 AM Hansen, Laura M;Stovall, Molly;Thomas, John D;White, Michael P;Flowers, Karen;Luken, Beth R Zellars, Clarissa R;White, Francis E;Redmond, Bradley;Stacy, Kevin D FW: HS PLC Feedback HS Tier State Accountability Feedback-8.31.17.docx I am forwarding an email from Adrienne Battle that contains the feedback from high school principals gathered during the session we conducted at the last A&S meeting. I greatly appreciate your contribution to this session and I want to thank Kevin and Clarissa for sharing their talented staff members. I thought it was a productive session that will help us plan future PD. Sito Narcisse and the community superintendents have expressed interest in providing similar opportunities for the other tiers through A&S or quadrant meetings. The attached feedback is in bullet points and does not go into much detail, but please review the attachment and let me know if you would suggest any additions/edits to this document. Thank you again! Paul Paul Changas Executive Director Research, Assessment & Evaluation Metro Nashville Public Schools From: Battle, Adrienne R Sent: Monday, September 11, 2017 9:34 PM To: Changas, Paul Subject: HS PLC Feedback Hi Paul, Attached you will find the feedback collected from the high school principals at the last A&S meeting for your review. Please feel free to add, correct, or comment on any of the feedback received with your team. We will be using this document to guide our planning throughout the year. Thanks, Dr. Adrienne Battle Community Superintendent-Southeast Quadrant Serving the Antioch, Cane Ridge and Glencliff Clusters Office of School Improvement and Support Office: 615-259-8563 adrienne.battle@mnps.org GALLUP® 260 Learner I Responsibility I Analytical I Focus I Achiever CONFIDENTIALITY STATEMENT: This email may contain information that is privileged and confidential. Any dissemination, distribution, or copying of this message or any of its contents is strictly prohibited. If you have received this message in error, please contact Metropolitan Nashville Public Schools by e-mail at customerservice@mnps.orgor by phone at 615-259-8400. 261 HS TIER STATE ACCOUNTABILITY FEEDBACK Current Reports/ Supports · · Achievement .. • • • • • • • • • .. '-"'· • .. • • • • Relying currently on own assessments/CFA Fast Bridge Data Warehouse- class, school, subgroup=> Assessment Summary by Teacher TEAM Data of teachers MAP ACT PSAT predictor Performance Matters Advanced Academic Achievement info on Datawarehouse IB, Cambridge, AP assessments Achieve 3000 Virtual Data card Practice assessments Best practices • • • • • • • • • • • • • • • • • • • • Reliable instruments Intentional looks at how structures of planning and student work produce better meeting that support learning Common planning time Standards Based Grading Content Recovery to build students up January/March looking at Power Standards 3Vall- 3Vall Literacy Quality Tier 1 instruction aligned with instructional focus Clear definition of achievement and growth Define rigor in the content area and ensure it is embedded Classroom culture conditions for learning focus Students knowing and tracking their data Multiple feedback loops (APs, IC, Teacher Teams) Ind. scheduling based on quantitative and qualitative data Deep (collaborative data dives (large =>drill down to sub groups) Goal setting Student led conferences- ownership Targeted recruitment (1B, H, AP, Cambridge, DE) Peer-peer teaching Virtual learning Data chats (modeled, class level...) after benchmarks Additional supports • • • .• • • • • • TN Ready Aligned Assessments NOW and deconstruct standards Quality Question bank Streamline OW (see Laura for idea on IFC) District content level assessments aligned to standards and Scope & Sequence PowerPoint available with instructions on accessing OW reports/info Bubble report (with subgroup info) for intervention development Most used OW usage by reports Ensure the fidelity of Standards Based Grading District PD aligned to TEAM Rubric areas , Growth • • • • MAP (For purchase) 6-12 curriculum can set benchmarks for individual students ( national norms) In-house common assessment ( scope/ sequence) State restricted TVAAS Site ( also includes student projection to ACT) Achieve 3000 for EL Students • • • • • • • .. • • ... ·: -; ' ' ~l - -: ELPA • • S.1.O.P Training Data Warehouse - LEP folder Identification of: 0 Tl students 0 T2 students 0 T3 students 0 T4 students Identify# of years EL students received support 0 Flag identifying: • • - ....... ':' • • • • • • • • ; Google doc with questions for bell ringers for ACT Teachers in PLC monitoring Motivation sessions '. • ~-/ . Student data charts for EOC_ and courses, formative and sun:,mative assessments District purchased item bank and state Build tool for wall to wall literacy plan Intentional focus with looking for reading and writing conditions for learning ( specific system) Closely monitor attendance Teacher experience taking the ACT to know what the students are being asked to do • Proficiency level Expected Exit Date 4 years or more • • • • • • • • • • • • Co- teaching Rigorous content All teachers are aware of the proficiency level of students Identify Tl and T2 students (T3 and T4 as well) Content teachers knowing prof levels Ensuring content area teachers know strategies AMO meeting (EL Teacher presented to content level teachers) Students in alt setting 0 Have home school partner with alt principal Identify students who have opted out School wide training Use student mentors Educate students on how they can exit the program • • • • • • • • • • • • Timely data from the State including expectations common assessments from the district access to quality, aligned question bank for assessment construction People in specific positions to support. Example: Literacy, Data Warehouse support, reports timely ex: data wall Bank of more relevant text Online practice assessment with like questions Data warehouse reports organized by class District support for linking ACT projections to data Need supports for students that don't have value added data Strategies to motivate students => Exit ACHIEVE 3000 Create District Benchmarks? WIDA 0 0 15 to 20 minute questions When do students count? If they miss a portion of the test, how _does this impact accountability Exit vs. Growth EL Office=> Advocate for graduation Math class prior to Integrated Math Non-Traditional schools- where do their scores go? (Home School?) Parent engagement What are the options for documented/undocumented students? What would this mean for students/families? More support when giving the WIDA assessment • • • Non.:.Academic (Chronic ·· Absenteeism) • • • • • • -· • - • • --·· -------·-·-··--·· J\Jon--.-\<.,:i. :.·· . {.' '. ~ Readiness/Graduation . ---- .. ~\.: t~ ~ ;-· -. :·: :: • • • • • • • Tiered approach with protocol (both sides) Monthly meetings with support staff around individual students (S&I/ MTSS) Parent conferences after 5 pm( in_group) Academy team meetings Utilizing supportive resources (teacher/ relationship) to intervene Call, text, email students Restriction of privileges (clubs, etc.) Citation • Data warehouse IC • • • • Needs: More social work support • • • • • Full time social worker who knows the communities Partner led small groups Track membership/ involvement Work with case managers (EE) Root cause analysis 3 rd meal incentive with 2nds (state grant) ACT trends EPSO- IB/AP Achievement combination • At Risk Indicator Reports -Data Warehouse *Promotion/Retention * DC/IC Annual Participation/Achievement -From AON office=> Schools & Business Partners DE Annual P/A • From PS to AA to School to CTE • Annual Scholarship report • Promotion rates- internal school report • • How do we reduce time in program? (6-year impact) Conversations across tier NSA- Strategically advertising magnet programs to EL families Flexible school day (qualify) Change HS start time Add the history for CA to Data Warehouse Alternative for over age/under credit students Hospitalization Religious Holidays MTA Routes (Arrival times) Cluster support community Concerns: • How is it being calculated in IC (by min. not the day) (official day) • Enrollment centers commitment level • Courts ... • Students arriving very late (work related) • Childcare for students who are parents • • • • Generate Cohort List NOW 0 Divide and categorize- develop plan 0 Find our students 0 Engage and communicate with families 0 IC Introduce DE/DC options earlier 0 PD for teachers With Juniors- Create Senior contract Create accountability system at school • • • • • More ACT Prep strategies across all content More direct point of contact with state More information on CompetencyBased Education ACT Prep resources for Students in the community Better understanding of different diploma trades College Readiness 0 TAB on Data WH 0 • • • • j •.'•. - - - • • Non- Academic Data- Infinite Campus PSAT predictor- College Board TN Promise report 0 # applied 0 Who applied 0 FAFSA complete or not 0 To give to students ACT Super Score Option 0 Best result for each sub test Credit/Content Recovery flexibility 0 TN or MNPS restrictions Enrollment centers role in helping locate/track students • • • • • Credit/Content recovery before failure while in course Data cleaning/ Clear understanding District support($) of EPSO opps. 1st month of school, repeat conference with each and every senior Student access to both AA and CTE • • • • • • Matriculation Data Experimental Learning/ Opportunities Clear expectations/accountability for graduation counseling/coaching Definition/Calibration of Quality Instruction Student Readiness Level Report ACT lead for the district Reid, Nicole R From: Sent: To: Subject: Attachments: Changas, Paul Thursday, September 14, 2017 4:12 PM Burnside-McLaughlin, Christi (MNPS) (Christi.Burnside-McLaughlin@mnps.org) Performance Matters Invoice Performance Matters Nashville Inv 97276.pdf Christi, Attached is the invoice from Performance Matters. We will pay them the $387,000 for assessment and analytics, but they have not provided the webinar or professional development listed. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metro Nashville Public Schools 256 erfor ance e~~•t~ mat:.·t• e· r·' 5, -~.:::~~tJ Performance Matters LLC 8860 East Chaparral Road Suite 100 Scottsdale, AZ 85250 Phone: (480) 423-0118 x1105 Invoice Date 7/1/2017 Invoice# 97276 PO# Contract 2-276664-01 Terms Net 30 Due Date 7/31/2017 Bill To Metropolitan Nashville Public Schools 2601 Bransford Avenue Nashville TN 37204 Description One-hour Webinar Quantity 11 Amount 3,575.00 Onsite Training 15 36,000.00 Onsite Certification Training Class 10 43,200.00 86000 387,000.00 Unify Assessment and Analytics - District Wide July 1, 2017 - June 30, 2018 Total" Amount Due Wire and ACH Instructions: Account Number: 3300975888 Routing/ASA Number: 121140399 SWIFT#: SVBKUS6S Bank Name: Silicon Valley Bank·:,.: 3003 Tasman Drive.:- : · · · Pasadena CA 95054:- _-,.-:.. .:::::·~·-u:~ \l.;1i0:; 8t3r~-~. ,~·, 3L'O:~ ~: ~::srn2~n [Jrtv.6'.· · (~'asadens C;,;\ fH\f.t}·};f• ·. 469,775.00 $469,775.00 Reid, Nicole R From: Sent: To: Subject: McClarey, Jody Wednesday, September 6, 20171:19 PM Changas, Paul FW: Contact Question Maryland contacts are below. From: Alison Levitt [mailto:alison.levitt@nwea.org] Sent: Wednesday, September 06, 2017 11:40 AM To: McClarey, Jody Subject: RE: Contact Question Mary in Howard Co, MD would be a great resource to talk to regarding home reports for parents: Mary R. Levinsohn-Klyap, Ph.D. Mary Levinsohn-Klyap@hcpss.org Coordinator, Shared Accountability Howard County Public School System 410-313-6978 From: Alison Levitt Sent: Wednesday, September 06, 2017 12:18 PM To: McClarey, Jody Cc: Alison Levitt Subject: RE: Contact Question Here are the contacts: Montgomery County Kara Trenkamp Kara Trenkamp@mcpsmd.org Prince George's County Andrew Pruski andrew.pruski@pgcps.org If you'd like me to do an email introduction, I can do so. Thanks, Alison From: McClarey, Jody [mailto:Jody.McClarey@mnps.org l Sent: Wednesday, September 06, 2017 12:14 PM To: Alison Levitt Subject: RE: Contact Question I think Paul was trying to find out what specifically those districts have done because Dr. Joseph wants it done like those were doing it. That's the conundrum. 305 From: Alison Levitt [mailto:alison.levitt@nwea.org] Sent: Wednesday, September 06, 2017 10:59 AM To: McClarey, Jody Subject: RE: Contact Question NWEA's recommendation is to send home the Student Profile Report to parents. This report is designed with parents in mind. Beyond that, I am honestly not entirely sure what these districts use for parent reporting. I do know they both utilize Performance Matters as a data warehouse for disseminating testing information. Alison From: McClarey, Jody [mailto:Jody.McClarey@mnps.org1 Sent: Wednesday, September 06, 2017 11:35 AM To: Alison Levitt Subject: RE: Contact Question I think Paul is trying to get a better understanding of what these districts sent home to parents in terms of MAP reporting. Dr. Joseph has indicated that he wants us to send results home to parents like these two other districts have done. So, I'm not sure. Do you have any thoughts on how to proceed? Thanks, Jody From: Alison Levitt [mailto:alison.levitt@nwea.org] Sent: Tuesday, September 05, 2017 4:13 PM To: McClarey, Jody Cc: Alison Levitt Subject: RE: Contact Question Hey, Jody. While I absolutely don't mind connecting you to other districts, I am hesitant to do so with these districts because in both cases the main person responsible has left his position. I can give you the name of the new person in charge of MAP for both, but please know they are new to their roles. How do you feel about that? Do you know what he is trying to learn? MCPS came on board with MAP several years ago, but they have not done much in the way of PD beyond MAP Admins. They use MAP primarily as a growth measure. PGCPS came on board district-wide for Reading only last year after participating in a pilot the previous year. They have participated in some PD (about the same as MNPS) but are just getting started using MAP data. If you don't mind what I stated above, I would be happy to make an email introduction for Paul. Thanks, Alison 306 From: McClarey, Jody [mailto:Jody.McClarey@mnps.org1 Sent: Tuesday, September 05, 2017 4:27 PM To: Alison Levitt Subject: Contact Question Hey Alison, Paul would like to reach out to the people responsible for MAP implementation in Prince George's County and Montgomery County in MD. Could you put us in touch with those people? Thanks, Jody Jody McClarey Coordinator of District Assessments Department of Research, Assessment, and Evaluation 2601 Bransford A venue Nashville, TN 37204 (615) 259-8436 307 Reid, Nicole R From: Sent: Changas, Paul Thursday, September 7, 2017 4:55 PM High, Chad 0 RE: questions To: Subject: The residents of Copperfield subdivision are all too elderly to have school-age children. But should others ask, the intent is to have test items in Performance Matters (PM) that will allow teachers to construct formative assessments that approximate TN Ready. It allows for the use of technology enhanced items that were not available in SchoolNet, and items should be aligned to Tennessee standards. I have seen the assessment and reporting platform, but I have not actually seen the item bank, as the selection process was overseen by C&I. The upcoming PD opportunities are designed for school representatives to learn how to construct tests aligned to state standards, and - if they so choose -to construct their own items. It is my understanding that assessments can indeed be printed and that the technology allows for answer sheets to be scanned and then scored and reported through PM. Someone smarter than me will have to explain this process, however. We have a conference call with PM on Monday and hopefully we can begin scheduling PD dates after that call. We will communicate with schools as soon as we have more details. The item bank is currently being loaded into PM, but we should be able to begin training later this month. Paul " ......., . ., --· .. - -.-,···""-· ".-,..····· ···-- .. ··· ·····-----·--·· ----······.. -··-·-- From: High, Chad O Sent: Thursday, September 7, 2017 4:25 PM To: Changas, Paul Subject: questions Hi Paul, The residents of the Copperfield subdivision had some questions about Performance Matters. I don't know much about it. 1. Will the assessments mirror TN Ready? 2. Can we print off the assessments to administer? 3. Any other helpful hints? Thanks Paul! Chad Hlah, Prinelpal 5501 HIii Rd. Brentwood, TN 3702.7 615-9'33-5112 287 Reid, Nicole R Ford, John Henry Wednesday, October 4, 2017 7:07 PM Changas, Paul;Henson, Chris M;Gregory, Glenda M;Burnside-Mclaughlin, Christi L Booker, Barry;Carlisle, Jana L RE: 2170 Research and Assessment FY2017 From: Sent: To: Cc: Subject: Greetings, I am not aware of any errors in the amount shown paid to ACT. Christi, would you please clarify? Also, unless I am looking at this wrong, it looks like only $354,622.00 was paid to ACT from Dr. Changas' account for FY17. :G/L :!>ate I Addre~ I Nurrber I I,Explaiiatkin 1Lt.I , E' [ LT1 . - ~ - - - - ~I C I (:ri!dlt : 'P~il 1 Jt~e lt~~~ 0-9/02/201.6 430930 ACTINc (ACl-il. 551;00i 551.00 P . 00397136 ONiJ2/7,,0J.l.i ··43\)~'.3() ACTINC(ACHt 8.,,~!l, B,}!9 I\ · 00~971:36 oiim./20.hr 'ii1i~111.oio; f~Q.9$0 Acttr~c;(ACH} t~Mqo.oo· . 4ioilio'. Aciirk (AcH) i3;s:iioo 0+/!2/20.17, 4309l0-i ACT!NC{ACH} zpo.oo, ,:z,~(i'.00 f> 0('iil043S8 ; Gregory, Glenda M Cc: Booker, Barry ; Carlisle, Jana L; Ford, John Henry ; Burnside-McLaughlin, Christi L Subject: RE: 2170 Research and Assessment FY2017 I have copied Mr. Ford and my administrative assistant, Christi. Christi has recently been in communication with Mr. Ford recently about an apparent error in the amount shown paid to ACT. We believe that certain payments were listed twice in our system and that we actually paid significantly less than the $533,600 indicated. Christi has contacted ACT to request a breakdown of the actual payment. Paul From: Changas, Paul Sent: Wednesday, September 27, 2017 2:07 PM To: Henson, Chris M ; Gregory, Glenda M Cc: Booker, Barry ; Carlisle, Jana L Subject: RE: 2170 Research and Assessment FY2017 I was directed to add two assessment platforms into my budget last school year- NWEA Measures of Academic Progress (MAP) and Performance Matters' Unify platform - that were not budgeted prior to the school year. These were items that Dr. Joseph requested and combined account for more than the amount that I went over budget. I was able to 30 reduce my budget to accommodate only a small portion of this cost as well as cover part of the additional cost of ACT that was due to the state making a mid-year policy change that allowed students to take the test multiple times at state/district expense. As you know, we only get partially reimbursed for ACT through the BEP. The cost for ACT is higher than expected and may reflect late billing from the prior school year for reimbursement for students that received vouchers late in the 2015-16 school year. Vouchers are issued through school counselors but payment comes from my budget. I will need to look deeper into this as well as the support salary issue. However, I was. told that the district would find funds to cover the.MAP assessment for 2016-17 and Jana may want to weigh in here. Paul PaulChangas Executive Director Research, Assessment & Evaluation Metro Nashville Public Schools From: Henson, Chris M Sent: Wednesday, September 27, 2017 1:16 PM To: Gregory, Glenda M ; Changas, Paul Cc: Booker, Barry ; Carlisle, Jana L Subject: RE: 2170 Research and Assessment FY2017 Also, why did the Support Salary line (2) go over budget? From: Gregory, Glenda M Sent: Wednesday, September 27, 2017 12:59 PM To: Changas, Paul Cc: Booker, Barry ; Henson, Chris M ; Carlisle, Jana L Subject: 2170 Research and Assessment FY2017 I noticed 2170 Research and Assessment went over budget in FY2017 by $458,677. The main line accounts that created the overage is 4-Supplies and 9-Contracted Services. Looking at the detail in 4-Supplies you spent $533,600 to ACT. In the 9-Contracted Service, the two big ticket items are PO# 405165 Fastbridge for RTI and PO# 425173 to NWEA for MAP. Do you know if you adjusted your spending to accommodate the FY2018 budget'? .Functiofril # Function Name 2170 FY2017 Budget FY2017 Actual 2.416,900 2,875,577 RESEARCH, ASSESSMENT, AND EVALUATION FY2017 Budget Amount FY2017 Actual Variance Balance OTotal $ 206,500.00 $ 205,841.72 $ 1 Total 81,400.00 52,494.27 28,905.73 2 Total 704,900.00 772,508.33 (67,608.33) 3 Total 21,800.00 Sub - 658.28 21,800.00 31 .Dollars (Over) /Under $ (458,677) 4 Total 461,200.00 589,018.09 (127,818.09) 5 Total 10,000.00 7,625.12 2,374.88 6 Total 283,800.00 315,577.31 (31,777.31) 8 Total 10,000.00 4,829.00 5,171.00 9 Total 637,300.00 927,683.37 ·..·. {29,0,383.37) Grand Total $ 2,416,900.00 Account Description FY2018 Budget Amount 0Total 212,700.00 1 Total 85,300.00 2 Total 742,200.00 3 Total 21,800.00 4 Total 161,100.00 5 Total 10,000.00 6 Total 294,500.00 8 Total 10,000.00 9 Total 1,895,200.00 Grand Total 3,432,800.00 $ 2,875,577.21 . . $ (458,677.21) 32 Reid, Nicole R From: Sent: To: Cc: Subject: Joseph, Shawn Sunday, October 15, 2017 7:57 PM Bryant, Melissa Carlisle, Jana L;Changas, Paul;Narcisse, Sito J Re: Executive Briefing Request-Performance Matters Hi Melissa, Let's discuss this. I'd like to understand our plan of rolling out support to schools on this. I need to speak with Paul to see if a meeting is needed with Performance Matters. Shawn From: Roderick Sams Sent: Wednesday, October 4, 2017 4:14 PM To: Bryant, Melissa Cc: Joseph, Shawn Subject: Re: Executive Briefing Request-Performance Matters Good afternoon Melissa, Just wanted to follow up on the previous email. i will follow up with a phone call as well. Thanks, Rocky On Mon, Oct 2, 2017 at 8:46 PM, Roderick Sams wrote: Good evening Melissa, I hope all is well with you. I spoke to Dr. Joseph last week at CUBE, and we discussed the scheduling of an Executive Briefing this month. In looking at calendars for the Performance Matters team, the following dates work well: • October 13 (morning only) • October 16* • October 25 • October 26 * best date Please let me know which date works best and the time. I'm thinking to set aside at least 90 minutes for the meeting. And I will follow up this email with a telephone call tomorrow to confirm. 51 Thanks in advance, Rocky Roderick Sams, Ed.D. Director, Education Solutions (770) 283-4145 performance ' Ill'-'. matters~ Accefotate Studet1t and Edutafot Gfowt-h www.performancematters.com Ro-derick Sams, IEd.D. Director, Education Solutions (770) 283-4145 performance ' tt.ers ~:nt~!T" -.!J;.'•i· ma Aeceh:mite Student and EdrJtator Growth www.performancematters.com 52 Reid, Nicole R From: Sent: To: Subject: Black, Shannon Friday, October 20, 2017 8:49 AM Changas, Paul FW: Evaluation???? Module in True North Logic Hey Paul, This has surfaced again ... Shannon From: Carlene Kirkpatrick [mailto:carlene.kirkpatrick@performancematters.com] Sent: Friday, October 20, 2017 7:55 AM To: Black, Shannon Cc: Enterline, Katherine ; Wade, Kelly S ; Vinson, Sarah B Subject: Re: Evaluation???? Module in True North Logic Hi Shannon, That is great news! We are excited to have an initial conversation about the timeline for the roll out of the evaluation module in our system. I am available next Tuesday at 1:00 CST. I will send an calendar inivte for us to connect briefly. If this doesn't work, just let me know and I can be flexible to meet at another time. Looking forward to meeting you soon! On Wed, Oct 18, 2017 at 1:34 PM, Black, Sham1on wrote: Hi, The next few weeks are ve1y busy for me. I do have some time the afternoon of Tuesday October 24th • Let me know if that might work. Shannon From: Enterline, Katherine Sent: Wednesday, October 18, 2017 12:16 PM To: Black, Shannon ; Carlene Kirkpatrick Cc: Wade, Kelly S ; Vinson, Sarah B Subject: Evaluation???? Module in True North Logic Hey Shannon and Carlene! 42 This email serves to connect the two of you related to a function, that **I believe** that we have already purchased related to evaluation in Performance Matters/True North Logic. Carlene needs an MNPS contact related to this. Shannon- teacher evaluation and development is in your domain. Perhaps we can schedule a call for Carlene to discover with you who the best contact for this part of the product might be. Thank you, Katy Enterline Miller Manager - Instructional Applications Information & Technology Services Metro Nashville Public Schools 615.259.8426 Carlene Kirkpatric['( Director of Project Management performance . . t·.t· e rs ~){~~tit -~•· ma Attelet~ Student and Edlltat◊t Growth 801-875-1142 www.performancematters.com 43 From: Wade, Kelly 5 Sent: Friday. October 20, 2m 7 10:09 AM To: Changas, Paul Cc: Appenfelder, Gary;Gossage, Jeff L-Black, Shannon Subject: Re: Periormance Matters Shannon, Katy and were asked to do a confermce call with them to discuss a "plan". So, guess we need to tell them thal there will he no plan. Kelly S. Wade MNPS Technoloy and Information Services On Oct 20, 2017, at 10:02 AM, Changes, Paul wrote: Fro Gary is correct, we have not purthased the Evaluation module. And i am also not aware of any plan to purchase/implement this module in the near future, Paul ade, Kelly 5 Sent: Friday, Uctuber 20, 2017 9:31 AM .A enfelder mn $.0r Cc: changes, Paul Gossage, JeffL wrote: You are exactly correct. The contract makes available to us (if we choose it) the evaluation piece, but we have notelected to use that part and have not paid for it (that I'm aware of). Regards, Gary Appenfelder 2501 Eransford Avenue Nashville, TN 37204 515 25978532 office bile Gar en Elder mn s.ar 35 From: Wade, Kelly S Sent: Friday, October 20, 2017 9:04 AM To: Appenfelder, Gary Subject: Performance Matters Gary, The project manager from Performance Matters (really True North Logic) has contacted us wanting to put together a project plan for their evaluation system. We thought he did not pay for that? Thanks, Kelly Kelly S. Wade MNPS Technology and Information Services 37 Reid, Nicole R From: Sent: To: Subject: Luther, Brent Friday, October 27, 2017 9:19 AM Changas, Paul RE: Student Progress Monitoring Thank you Dr. Changas, Access to the Unify platform as well as any additional resources and/or trainings would be greatly appreciated. Brent. Brent T. Luther Mathematics Academic Chair East Nashville Magnet School 110 Gallatin Road Nashville, Tennessee 37206 Office: (615) 262-6947 x.1212 Fax: (615) 262-6656 .· -~:-) METRO ;,,~! J~thlt~' From: Changas, Paul Sent: Friday, October 27, 2017 8:29 AM To: Luther, Brent Subject: RE: Student Progress Monitoring Brent, The Performance Matters Unify platform is indeed up and running. We conducted trainings the week prior to Fall break and all but a few schools attended, but it appears that East did not have a representative. The communication about trainings was sent to principals and there was not a lot of lead time before trainings began. I will work with Performance Matters to schedule additional trainings soon and let you know when those are set. I can ask our IT department to get you access to the site, but I am not sure how useful it will be without training. We are still get used to the site but I may have a member of our team who is comfortable providing initial training. Paul From: Luther, Brent Sent: Tuesday, October 24, 2017 12:25 PM To: Changas, Paul Subject: RE: Student Progress Monitoring Greetings Dr. Changas, I am following up to see if the new assessment program is available and if so, how to access it. 13 Thank you, Brent T. Luther Mathematics Academic Chair East Nashville Magnet School 110 Gallatin Road Nashville, Tennessee 37206 Office: (615) 262-694 7 x.1212 Fax: (615) 262-6656 J[,1•·. f.,fETR 0 1;;:i fi~8t~' From: Changas, Paul Sent: Monday, July 10, 2017 4:49 PM To: Luther, Brent Cc: Ball, Steve ; Renfro, Douglas ; Williams, David S ; Enterline, Katherine Subject: RE: Student Progress Monitoring Mr. Luther,· We are indeed implementing Performance Matters as our formative assessment platform this year. The district is in the process of acquiring a new item bank to go with that platform. I am not sure when that item bank will be available and I have copied David Williams, Executive Director of Instruction, who is overseeing that acquisition. It is my understanding that our previous item bank (which was available in SchoolNet) is currently available in Performance Matters, but we would not want to construct assessments with the old bank if it is only available for a short time. I have also copied Katy Enterline, Instructional Applications Manager, who has a key role in this implementation. · I will try to provide an update soon regarding a time table for the availability of the assessment platform. Paul Paul Changas Executive Director Research, Assessment & Evaluation Metropolitan Nashville Public Schools Office: 615-259-8430 Strengths: Individualization - Analytical - Learner - Relator - Responsibility From: Luther, Brent Sent: Wednesday, July 05, 2017 11:11 AM To: Changas, Paul Cc: Ball, Steve ; Renfro, Douglas Subject: RE: Student Progress Monitoring Dr. Changas, I am interested in utilizing the performa nee matters platform in our math department at East. Are you aware of the lead of this project or how we can obtain access? 14 Brent Luther Mathematics Academic Chair East Nashville Magnet School 110 Gallafln Road Nashville, Tennessee 37205 Office: (615) 262v6947 x.1212 Fe (515) 262-6656 ETRO likHvli :3 SCHOOLS Fro Renrro, Douglas Sent: Monday, July 3, 2017 11:47 AM To: Ball, Steve Steve Ball From: Luther, Brent Sent: Tuesday, June 27, 2017 2:13 PM To: Ball, Steve Subject: Student Progress Monitoring I am interested in utilizing a software or a cloud based site to regularly monitor student progress in our department for common courses (using our common assessments: quizzes, tests, etc.}. I would desire the software to be capable to run individual student as well as holistic reports in-order to identify student deficits and measure growth (numerically and graphically}. Our current excel sheets are very limited with their diagnostics and are time consuming to update. This software would also be ideal for our RTI plan. Can you please check with your connections to see if anyone utilizes or knows of a quality student progress monitoring software? Brent T. Luther Mathematics Academic Chair East Nashville Magnet School 110 Gallatin Road Nashville, Tennessee 37206 Office: (615) 262-694 7 x.1212 Fax: (615) 262-6656 ')i ~IBI 1 '" SCHOOtS 16 Reid, Nicole R From: Sent: To: Subject: Changas, Paul Monday, December 4, 2017 12:10 PM Enterline, Katherine RE: Performance Matters Meeting Thank you for going the extra mile. From: Enterline, Katherine Sent: Monday, December 4, 2017 12:09 PM To: Changas, Paul Subject: RE: Performance Matters Meeting Sounds good. I will brush my hair in preparation ©. Katy Enterline Miller Manager - Instructional Applications 615.259.8426 From: Changas, Paul Sent: Monday, December 4, 2017 12:08 PM To: Enterline, Katherine Subject: RE: Performance Matters Meeting I don't think we need to prepare anything. Rocky set up this meeting and never shared any agenda with me, so all I know is that it is an "executive briefing." I imagine we will touch base on where things are currently and Rocky will likely ask questions about future directions with Unify. I don't know if he will bring up other products, such as their teacher evaluation platform - but I would not be surprised by anything. Paul From: Enterline, Katherine Sent: Monday, December 4, 2017 11:05 AM To: Changas, Paul Subject: Performance Matters Meeting I think I'm open during that time. What's the topic of the meeting? Need to prepare to speak to anything? Katy Enterline Miller Manager - Instructional Applications Technology & Information Services Metro Nashville Public Schools 615.259.8426 78 Reid, Nicole R From: Sent: To: Subject: Changas, Paul Sunday, December 10, 2017 11 :23 PM Black, Shannon RE: Request for a call I certainly do. I am pretty flexible in the afternoon. I was in the meeting with Rocky and Dr. Joseph. Nothing has changed, but Woody and their CEO wanted to know who to speak to regarding the district's future plans with respect to teacher evaluation. Woody was referred to you and Sharon. Paul From: Black, Shannon Sent: Sunday, December 10, 2017 8:36 PM To: Changas, Paul Subject: FW: Request for a call Have a few minutes tomorrow afternoon to chat? Shannon From: Roderick Sams [mailto:roderick.sams@performancematters.com] Sent: Saturday, December 9, 2017 7:52 AM To: Black, Shannon Subject: Request for a call Good morning Shannon, I hope all is well. We had a great meeting with Dr. Joseph and the team earlier this week. Afterwards, he suggested I follow up with you. Any time on your Monday schedule to give you a call? Let me know and I'll plan accordingly. Thanks, Rocky Dr. Roderick Sams Director, Education Solutions Perfonnance Matters (770) 283-4145 15 Reid, Nicole R From: Sent: To: Subject: Changas, Paul Monday, December 11, 2017 3:22 PM Black, Shannon RE: Request for a call I am in the office. Feel free to call (85-8425) or come by any time. Paul From: Black, Shannon Sent: Sunday, December 10, 2017 8:36 PM To: Changas, Paul Subject: FW: Request for a call Have a few minutes tomorrow afternoon to chat? Shannon From: Roderick Sams [mailto:roderick.sams@performancematters.com] Sent: Saturday, December 9, 2017 7:52 AM To: Black, Shannon Subject: Request for a call Good morning Shannon, I hope all is well. We had a great meeting with Dr. Joseph and the team earlier this week. Afterwards, he suggested I follow up with you. Any time on your Monday schedule to give you a call? Let me lmow and I'll plan accordingly. Thanks, Rocky Dr. Roderick Sams Director, Education Solutions Performance Matters (770) 283-4145 9 Reid, Nicole R From: Sent: To: Subject: Changas, Paul Tuesday, April 3, 2018 4:42 PM Michaud, Michelle;Sevier, David;Gossage, Jeff L;Narcisse, Sito J;Felder, Monique T;Renfro, Douglas;Brown, Olivia H RE: EDITS APPROVALS PLEASE Michelle, My detailed breakdown follows this paragraph, but thus far we have paid Performance Matters $407,650 for Unify and accompanying professional development. I anticipate that total will increase to $422,050 following six days of summer PD we have requested for June. Our contract for that 18-month period shows a cost of $531,865 (including anticipated PD). Our projected 18-month cost is thus $109,815 below the contract cost. Our contract for Unify specified a total amount of $88,000 for 2016-17 for implementation services (a one-time fee), the assessment platform and analytics. For 2017-18 the contract for the platform and analytics was $387,000. This does not include professional development, which is listed in the contract at a daily rate which we pay as needed. Over the course of the 30-month contract Performance Matters recommended 11 webinars and 30 on-site training classes, at a total cost of $94,775 -which would translate to $56,865 for 18 months. Thus the contract cost for 18 months for all services and PD is $531,865. We paid $20,650 to Performance Matters in 2016-17, which included $2400 for one day ofonsite training. In this 2017-18 school year we have paid $387,000 to Performance Matters and have requested six days of summer PD in June for $14,400 (6 x $2400/day). Thus we have paid a total of $407,650 thus far to Performance Matters for Unify, but we expect that total to increase to $422,050 for the 18-month period approved by the Board. Paul PaulChangas Executive Director Research, Assessment & Evaluation Metro Nashville Public Schools From: Michaud, Michelle Sent: Tuesday, April 3, 2018 3:56 PM To: Sevier, David ; Gossage, Jeff L ; Changas, Paul ; Narcisse, Sito J ; Felder, Monique T ; Renfro, Douglas ; Brown, Olivia H Subject: EDITS APPROVALS PLEASE Importance: High Please, take one last look at our answers. I'll make your changes at 7 a.m. then submit to Dr. Joseph shortly there after. Warm regards, Michelle Michaud 91 Public Information Officer 2601 Bransford Ave' Nashvme, TN 37204 615259-8497 MNPS ORG Facebook Strategic Learner Consistency Refm'm' ldenllon 92 Nicole From: Renlro, Douglas Sent: Thursday, April 5, 2018 10:36 AM To: Appenfeldel, Geri/,Gossage, Jeff L;Micnaud, Michelle:Narc'isse, Sito JiFelder, Monique Tr'Changas, Paulr'Sevier, David;Herison, Chris Cc: Brown, Olivia H;Reid. Nicole Subject: RE MEDIA ALERT Contracts Answers Attachments: nicationji NALipdf Attached is tire copy oftne termination oithe Schooinet Educator 0evelooment 1P0) Module notification. Executive ector of Learning Technology and Library Services, Gaflup-Cenified Coach, cm Offic 61572988456 Ext 2404 Ce-- From: Appenielder, Gary sent: Thursday, April 5, 2018 10:29 AM To: Gossage, Jeff Michaud, Michelle Narcisse, Sim] Felder, Monique cnangas, Paul Reid, Nicole R From: Sent: To: Cc: Subject: Felder, Monique T Thursday, April 5, 2018 3:16 PM Michaud, Michelle;Narcisse, Sito J;Changas, Paul;Sevier, David;Renfro, Douglas;Henson, Chris M;Appenfelder, Gary;Gossage, Jeff L Brown, Olivia H;Reid, Nicole R RE: MEDIA ALERT Contracts Answers Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org Office:615-259-8690 *Connectedness*Learner*Achiever*Relator*lntellection*lnput "We CClVt,, wviej/1.,evev ClV\,cl wvievevev we cvioo.se, .StA.cce.s.sftA.LL!j tel-lcvi l-lLL cviLLclvej/1., wvio.se .scviooLlVLg [.s of [Vetere.st to R,V\,OW V\,\,OYe tv,/.lV\, we 11\,tecl to G\O tvil-lt." ~ RDVt,l-lLcl SclV\,\,01/1.,G\.S !A.$. we ciLvecicl!j From: Felder, Monique T Sent: Thursday, April 5, 2018 3:09 PM To: Michaud, Michelle ; Narcisse, Sito J ; Changas, Paul ; Sevier, David ; Renfro, Douglas ; Henson, Chris M ; Appenfelder, Gary ; Gossage, Jeff L Cc: Brown, Olivia H ; Reid, Nicole R Subject: RE: MEDIA ALERT Contracts Answers Greetings, I understand clarity is still needed with regards to Bruce Taylor's contracts. I just consulted with Federal Programs again and was provided with the following: • Presented at a Summer 2016 A&S meeting and was compensated 4,633K. • • 2016-2017 contract was for his support with 3 schools for a max of 25K. He invoiced and was paid 20K. 2017-2018 contract is for 16K per school not to exceed a max of SOK in total for all schools. Bruce is currently only working with 2 schools still at a maximum of 16K each or 1,333K per month. To date/ through March, he has invoiced and has been paid $30, 662.41. Schools FY17 Budgeted Cumberland Elementary School, Gra Mar Expensed to Date $25,000 $20,000 $46,666 $30,662.41 Middle School and Whites Creek High School FY18 I. T. Creswell Middle Schools, Cumberland Elementary Services, Gra Mar Middle School, Stratford STEM - lower campus, Whites Creek High School 10 $50,662.41 TOTAL Expensed to Date (March 2018) Attached are Mr. Taylor's contracts for 16-17 and 17-18 as well as the spreadsheet Federal Programs uses to track invoices for 16-17 and 17-18. Best, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@M.NPS.org Office:615-259-8690 *Connectedness*Learner*Achiever*Relator*lntellection*lnput "We w111,, wvieV\,ever etvu:l wherever we cvioo.se, .suwe.s.sfuLLtJ teetcvi et LL cviLLlilreV\, wviose .scltlooLLVc-0 Ls RV\,OW v1-1.ore tvtetV\, we ~eli\ to do tviett." ~ Ro111,etLd SdVvtoV\,d.s of t111,tere.st to us. we etLreetO:(j From: Felder, Monique T Sent: Thursday, April 5, 2018 10:15 AM To: Michaud, Michelle ; Narcisse, Sito J ; Changas, Paul ; Sevier, David ; Renfro, Douglas ; Henson, Chris M ; Appenfelder, Gary ; Gossage, Jeff L Cc: Brown, Olivia H ; Reid, Nicole R Subject: RE: MEDIA ALERT Contracts Answers Greetings, Attached is Bruce Taylor's resume. He is also the author of Common Sense Common Core which can be found on Amazon. Additionally, last year, Bruce was compensated 25k for working with 4 schools all year. Last year and this year's compensation (I don't recall the exact amount) will equal less than 100K in the aggregate. Federal programs can provide the exact amount of his compensation as he is compensated out of Title 1 set -aside to work with schools in the bottom 10%. Please let me know if you need that figure. Thanks! Best, Monique Monique T. Felder, Ph.D. Chief Academic Officer Metro Nashville Public Schools 2601 Bransford Avenue Nashville, TN 37204 Monique.Felder@MNPS.org Office:615-259-8690 *Connectedness*Learner* Achiever*Re lator*lntellection *Input "We CCIV\,, wvie~ver etvu:l wvierever we cvioose, .succe.s.sfuLLtJ teetcvi et LL cviLLdre111, wvio.se .scviooLLV\,g Ls R,V\,OW v1-1.ore tvietV\, we 111-eelil to Gio tltlett." ~ RoV\,etLd sdv1-1.ovu:l.s of [V\,tere.st to us. we etLreetlilk:j From: Michaud, Michelle Sent: Thursday, April 5, 2018 10:02 AM To: Narcisse, Sito J ; Felder, Monique T ; Changas, Paul ; Sevier, David ; Renfro, Douglas ; 11 Henson, Chris M ; Appenfelder, Gary ; Gossage, Jeff L Cc: Brown, Olivia H ; Reid, Nicole R Subject: RE: MEDIA ALERT Contracts Answers Thank you, again, Jeff. You rock Get Outlook for Android From: Gossage, Jeff L Sent: Thursday, April 5, 2018 9:59:38 AM To: Michaud, Michelle; Narcisse, Sito J; Felder, Monique T; Changas, Paul; Sevier, David; Renfro, Douglas; Henson, Chris M; Appenfelder, Gary Cc: Brown, Olivia H; Reid, Nicole R Subject: RE: MEDIA ALERT Contracts Answers To All, Answers are in blue following each of Phil's questions. Jeff L. Gossage c.P.M. Director of Procurement Metropolitan Nashville Public Schools 2601 Bransford Ave., Nashville, TN 37204 ph. 615-259-8533 e-mail jeff.gossage@mnps.org I NH:'. "'W' (J. m . h,,. l f\V' Input/ Learner/ Positivity/ Achiever I Belief From: Michaud, Michelle Sent: Thursday, April 5, 2018 7:46 AM To: Narcisse, Sito J ; Felder, Monique T ; Changas, Paul ; Gossage, Jeff L ; Sevier, David ; Renfro, Douglas ; Henson, Chris M Cc: Brown, Olivia H ; Reid, Nicole R ; Michaud, Michelle Subject: MEDIA ALERT Contracts Answers Importance: High Good morning everyone, Please see below follow up questions from Phil. He alerted me at this morning at 6:30 a.m. his story runs TONIGHT. . Please reply to all with your answers to these questions.&[(; /~Gt we'll need thes~ 110 latgrthan 10a.m.' Warm regards, 12 are on a tight deadline, frn sorry, Michel/e Michaud Public Information Officer 2601 Bransford Aver Nashville, TN 37204 61572598497 PS ORG Facebook Strategic Learner Consistency :szm'oi' ldenllon From Wi ems, Phil [mailt Ehi williamsfiznewschanne|5.C0m Se ednesday, April 4, 2013 11:43 AM To ichaud, Michelle supplemental product to fill in where there were weaknesses in the A+ solution. I believe those weaknesses were Spanish and NAS(?). 4} How does MNPS go from $304,289 in UPRs in 2015-16 to $2.3 million in one year? By definition, UPRs reflect situations where purchasing procedures were not followed. What's the problem? 2015 was the initial year of self-reporting. The very nature of continuous improvement practices such as the use of UPRs is a deeper and more intentional dive into practices. You cannot improve what you don't measure. 5) The Board approved four contracts for the Institute for Learning. Only two are filed with the Metro Clerk. Where are the other two (for $346,747.50 and $641,410}? Again, one of those is an IDIQ. The "not to exceed" value is not present. We would need to see more that these two numbers to understand the question. In addition, I now have copies of two contracts totaling $105,000 {$80,000 and $25,000) for former actor Bruce D. Taylor from Maryland to "analyze test results and recommend specific academic areas for intervention in order to improve ACT test results." Why was Hoard approval not sought? What educational or other qualifications does Mr. Taylor have for improving ACT test results? Contracts o 2-265207-00 Contract for $24,000 Expired 6/30/17. It was approved by the BOE 3/16/17 o 2-265207-01 Contract for $80,000 Expires 6/30/18. It was approved by the BOE 8/1/18 Thanks, Phil From: Michaud, Michelle fmai1to:Miche11e.Michaud@mnps.org1 Sent: Wednesday, April 4, 2018 9:22 AM To: Williams, Phil Cc: Brown, Olivia H ; Reid, Nicole R ; Michaud, Michelle Subject: Contracts Answers Good Morning Phil, Thanks for waiting. We wanted to have well researched answers to your questions. Please see attached. Also, notice I will be sending you separate emails for the POs requested-there are so many, one email would be confusing. Stay tuned for POs for Hemphill Ed, Sharon Fogler, UPRs, POs for ANet, Edgenuity, Institute for Learning, Scholastic and finally RBT. If I've somehow missed anything, please circle back. Warm regards, 14 Michel/e Michaud Public Informatron Officer saw: 2501 Bransford Ave, Nashville, TN 37204 --C 615-259-8497 0 twittercom mngsorg Facebook facebookrcom snare-gr: Learner Consistency Refatuv weallon Scripps Media, certifies that its advertising sales agreements do not discriminate on the basis of race Dr ethnicity. All advertising sales agreements contain nondiscrimination cVauses. 15 Reid, Nicole From: Changas, Paul Sent: Monday, April is, 2018 4:49 PM To: Michaud, Mlchelle Cc: Brown, Olivia Subject: Re: Questions about Performance Matters The professional development plaiiorm ls in Doug Reniro's budget. Our PD is now tracked platform rarherchan Schoollilei. We are no: implementing or paying forthe teacher evaluation component of Performance Matters. am not sure what the calibration reference is but perhaps Doug can speakto that. Paul Semfrom my iPhone On Apr 16, 2013, at 4:24 PM, Midland, Michelle wrote: Noi sure if anyone has sent this question to you. Do you have the answers? Warm regards, Michel/e Mic/la ud Public Information Officer 2607 Eransford Ave, Nashville, TN 37204 -- 615-259-8497 MNPS ORG Facebook Srrateg/r Learner Consistency Refutar Mention From Williams, Phil [mailto Se ridav, April 13, 2013 11:49 AM To. Brown, Olivia Michaud, Michelle The Performance Matters professional development contract has charges of $11.66 per user for the "PD management system," another $17.83 per user for "evaluation," and $105 per observer for "calibration." Can someone please give me a brief explainer about what those three categories mean? I'd like to get it by Monday, if I could. Thanks! Phil Phil Williams, Chief Investigative Reporter WTVF-TV, NewsChannel 5 474 James Robertson Pkwy., Nashville TN 37219 Voice: 615-248-5390 Website: http://www.newschannel5.com/news/investigates Facebook: http://www.facebook.com/PhilWilliamsNCS Twitter: http://www.twitter.com/NCSPhilWilliams Scripps Media, Inc., certifies that its advertising sales agreements do not discriminate on the basis of race or ethnicity. All advertising sales agreements contain nondiscrimination clauses. 53 From: Michaud, Michelle Sent: Tuesday, April 17, 2018 2:31 PM To: Renfro, DDuglas,'Changas, Paul;Black Shannon Cc: Brown, Olivia Subject: RE: Questions about Performance Matters Thank you, Doug. We'll wait for Shannon to weigh in Warm regards, Michel/e Michaud Public Information Olflcer I 2601 Blansford Ave. Nashville, TN 37204 615-259-8497 0 MN PSORG Facebook Strategic LEBl'her Consistency Refatoi' Mention From Renfru, Douglas Sent: Tuesday, April 17, 2013 2:15 PM To: Mlchaud, Michelle Changas, Paul Black, Shannon Cc: Brown, Olivla Subject: RE: Questions about Performance Matters Michelle, 511,55 per user--this is the cost forthe use oithe professional development registration and tracking software implemented in the district. $17.83 per user'lhis was a portion afthe tool that could be used bythe Human Resources department to conduct and track evaluations torteachers --Ihls portlan Is not implemented in MNPS-- the district is using a system provided by the state 5105 calibration rthis portion ofthe tool was to have the system review evaluation scores and then use that information, plus the data in the professional development catalog to make recommendations to teachers and administration around proiessional development. -- This pan'inn o! the tool is not be Implemented 43 Reid. Nicole From: Black, Shannon Sent: Tuesday, April 17, 2018 2:46 PM To: Michaud, Michelle;Renfro, Douglaschangas, Paul Cc: Brown, Olivia Subject: Re: Questions about Performance Matteis Good afiemoorh We don't use Performamce Matters for evaluations of certificated staff. Shannon Shannon Black Executive Director, Talent Management Human Resources and Organizational Development Men-o Nashville Public Schools From: Michaud, Michelle Sent: Tuesday, Aprll17, 2013 2:30:30 PM To: Renfru, Douglas; Changes, Paul; Black, Shannon Cc: Brown, Olivia Subject: :Questinns about Performance Matters Thank you. Doug. We'll wait for Shannon to weigh in. Warm regards, Michel/e Michaud Public Information Officer 2601 Bransiord Ave. Nashville, TN 37204 515-259-8497 0 MNPSORG Facebook Strategic Learner Consistency Refutor [dc-alien Fro Renfro, Douglas Sent: Tuesday, April 17, 2018 2:15 PM 39 To: Michaud, Michelle Changes, Paul Black, shannon Cc: orown, olivia subject: RE: Questions about Periormance Matters Michelle, $11.66 per user--this is the castforthe use of the professional development registration and tracking software implemented in the district. $17.33 per user; Renfro, Douglas MNPSORG Facebook Strategic Learner Consistency Refatm' Mention Fro hangas, Paul Sent: Monday, April 16, 2018 4:49 PM To: Michaud, Michelle mil 5.0r Cc: Brown, Olivia 2601 Bransford Ave. Nashville, TN 37204 -- 515--259--8497 0 MNP ORG Facebook Strategic Learner Consistency ldenlion in; Williams, Phil [mail 2 Sent: Friday, April 13, 2018 :49 AM To: Brown, Michaud, Michelle Olivia, Michelle The Performance Matters professional development contract has charges of $11.66 per user for the "PD management system," another $17.83 per user for "evaluation," and $105 per observer for "calibration." Can someone please give me a brief explainer about what those three categories mean? I'd like to get it by Monday, if I could. Thanks! Phil Phil Williams, Chief Investigative Reporter WTVF-TV, NewsChannel 5 474 James Robertson Pkwy., Nashville TN 37219 Voice: 615-248-5390 Website: http:ljwww.newschannelS.com/news/investigates Facebook: http://www.facebook.com/PhilWilliamsNCS Twitter: http://www.twitter.com/NC5Phi1Williams Scripps Media, Inc., certifies that its advertising sales agreements do not discriminate on the basis of race or ethnicity. All advertising sales agreements contain nondiscrimination clauses. 42 Reid. ole From: changas, Paul Sent: Tuesday, April 17, 2018 4:07 PM To: Michaud, Michelie:Ren1m, Dauglas;Blacl ca: Brown, Olivia Subject: RE: Questions abnut Pertorrnance Matters Olivia, are you Okay with sending this along to the media? Warm regards, Michel/e Mic/laud Public information Officer am 2601 Eransford Ave. Nashville, TN 37204 --C 615259-8497 MNPSORG Facebook Strategic Learner Consistency Realtor Median 31 From Renrro, Douglas Sent: Tuesday, April 17, 2013 2:15 PM To: Michaud, Michelle changas, Paul Black, Shannon Cc: Brown, Olivia 2501 Bransford Aver TN 37204 61525978497 0 MNPS ORG Fa cebook Strategic Learner Consistency Refatov Mention Fro hangas, Paul Sent:Mondav,Aprll15,2018 4:49 PM mn 5.0r Cc: Brown, Olivia H 2601 Bransford Aver NashVIlle, TN 37204 B'l 57259--8497 0 PSORG Face book Strategic Learner Consistency Realtor wenuon 33 From: Williams, Phil [mailto:phil.williams@newschannelS.com] Sent: Friday, April 13, 2018 11:49 AM To: Brown, Olivia H ; Michaud, Michelle Subject: Questions about Performance Matters Olivia, Michelle The Performance Matters professional development contract has charges of $11.66 per user for the "PD management system," another $17.83 per user for "evaluation," and $105 per observer for "calibration." Can someone please give me a brief explainer about what those three categories mean? I'd like to get it by Monday, if I could. Thanks! Phil Phil Williams, Chief Investigative Reporter WTVF-TV, NewsChannel 5 474 James Robertson Pkwy., Nashville TN 37219 Voice: 615-248-5390 Website: http://www.newschannel5.com/news/investigates Facebook: http://www.facebook.com/Phi1Wil1iamsNC5 Twitter: http://www.twitter.com/NC5Phi1Williams Scripps Media, Inc., certifies that its advertising sales agreements do not discriminate on the basis of race or ethnicity. All advertising sales agreements contain nondiscrimination clauses. 34 I am including Shannon Black ln the discussion who may be able to provide additional intormation. Again the only portion otthe Performance Matters PD system is the one that provides registration and tracking ordistrict personnel professional development at an annual castcf$11.66 per user. Doug Renfm douglasJenfronnEsntg Executive Director of Learning Technology and Library Services, Gallup-Certified Coach, CETL Office: Sis-29878456 Ext: 2404 Cell:515-543-6110 From: Michaud, Michelle Sent: Tuesday, April 17, 2013 1:40 PM To: changas, Paul Renfro, Douglas Cc: Brown, Olivia The professional development platrorm is in Doug Renfro's budget. PD is now tracked in this platform ratherthan SchoolNet. We are not implementing or paying furthe teacher evaluation component of Performance Matters. I am not sure what the calibration reference is but perhaps Doug can speakto that. Paul Sent from my lPthe On Apr 16,1018, at 4:24 PM, Michaud, Michelle wrote: Not sure lfanyone has sent this question to you. Do you have the answers? Warm regards, Michel/e Ml'chaud Pu biic information Officer 260i Bransford Ave TN 37204 B'l5 59-84970 @Nl hM MNPS ORG Facebook Strategic Learner Consistency Refator Ideallon From Williams, Phil riday, April 13, 2018 11:49 AM mwrl, Olivia Subject: Questions about Performance Matters Olivia, Michelle -- The Performance Matters professional development contract has charges argues per userfor the management system," another $17.33 per userfor"evaluation," and $105 per observerfor "ca librarian Can someone please give me a brief explainer about what those three categories mean? I'd like to get it by Monday, if I could. Thanks! Phil 37 Phil Williams, Chief Investigative Reporter WTVF-TV, NewsChannel 5 474 James Robertson Pkwy., Nashville TN 37219 Voice: 615-248-5390 Website: http:Uwww.newschannel5.com/news/investigates Facebook: http://www.facebook.com/PhilWilliamsNC5 Twitter: http://www.twitter.com/NC5Phi1Wi11iams Scripps Media, Inc., certifies that its advertising sales agreements do not discriminate on the basis of race or ethnicity. All advertising sales agreements contain nondiscrimination clauses. 38