IMPAQInternational 1 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
CASTLECOMPLEXJune1,2017–May30,2018
ImprovingLiteracy,Math,Science,andTechnologyinCastleComplexSchools
HeleneJ.O.Tom,ProjectDirectorCecilyChun,ProjectEvaluator
IMPAQInternational 2 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
Hawai‘i21stCCLCEvaluationReport-CastleComplexSY2017-18OVERVIEW
Toassistsubgranteeswithmeetingstateevaluationrequirements,forSY2017-18theHIDOEisimplementingastandardizedtemplateforevaluationsofthe21stCCLCprograms.EachsubgranteeisrequiredtocompletethistemplatewithSY2017-18information.Thechecklistbelowservesasalistofrequiredelementsandprovidesatrackingtoolforcompletion.EvaluationElement Complete?
1. GeneralInformation ý Exhibit1:BasicInformationTable ý Exhibit2:CenterInformationTable ý
2. ExecutiveSummary ý 3. ProgramDescription ý
3.A.ProgramDescription ý 3.B.1Goals ý 3.B.2Objectives ý Exhibit3:StudentsServed ý AttendanceDiscussion ý Exhibit4:CharacteristicsofStudentsServed ý Exhibit5:Race/EthnicityofStudentsServed ý 3.D.SummerandIntersessionProgramming ý Exhibit6:StudentsServedDuringSummer ý 3.E.1ProgramMaterials ý 3.E.2Resources ý 3.F.StaffandOthersInvolvedintheProgram ý Exhibit7:NumberofStaffbyPosition ý Exhibit8:AverageHoursperWeekbyPosition ý Exhibit9:Partners ý PartnershipDescription ý 3.H.Parent/FamilyInvolvement ý
4. Evaluation ý 4.A.1.EvaluationDesignOverview ý 4.A.2.ImplementationEvaluation ý 4.A.3.OutcomesEvaluation ý 4.B.1.ImplementationofEvaluationResults ý Exhibit10:PerformanceonKPIObjective1–TurninginHomeworkandClassroomParticipation ý Exhibit11:PerformanceonKPIObjective1–StudentClassroomBehavior ý KPIObjective1Discussion ý Exhibit12:PerformanceonKPIObjective2–CoreEducationalServices ý CoreEducationalServices ý Exhibit13:PerformanceonKPIObjective2–EnrichmentActivities ý
IMPAQInternational 3 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
EvaluationElement Complete?
4.B.3.KeyPerformanceIndicators–Objective2 ý Exhibit14:PerformanceonKPIObjective2–ServicestoParentsandFamilyMembers ý Parent/FamilyServices ý Exhibit15:PerformanceonKPIObjective2–HoursperWeek ý Exhibit16:PerformanceonKPIObjective4–AcademicImprovementinReading/LanguageArts ý Exhibit17:PerformanceonKPIObjective4–AcademicImprovementinMath ý KPIObjective4Discussion ý
4.B.5.AchievementofProgram-SpecificObjectives ý Exhibit18:ProgressonProgram-SpecificObjectives ý AchievementofProgram-SpecificObjectivesDiscussion ý 4.C.1.SuccessStories ý 4.C.2BestPractices ý 4.C.3Student,Teacher,Parent,Staff,orCommunityInput ý 4.C.4Pictures ý
5. SustainabilityPlan ý 5.A.OriginalSustainabilityPlan ý 5.B.UpdatedSustainabilityPlan ý
6. ConclusionsandRecommendations ý 6.A.Conclusions ý 6.B.Recommendations ý 6.C.EvaluationDissemination ý
IMPAQInternational 4 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
1. GeneralInformationPleaseretainthepre-setformattingof12pt.fontfornarrativesectionsofthereportand10pt.inthetablesthroughoutthisdocument.
Exhibit1:BasicInformationTableRequiredInformation EnterInformation
DateEvaluationReportSubmitted November15,2018GranteeName CastleComplexProgramDirectorName HeleneTomProgramDirectorEmail [email protected] CecilyChunEvaluatorEmail [email protected] 2017-2018
Exhibit2:CenterInformationTableCenter NameofCenter GradeLevelsServed
Center1 BenjaminParkerElementarySchool Grades3-6Center2 CastleHighSchool Grades9-12Center3 HeeiaElementarySchool GradesK-6Center4 KahaluuElementarySchool Grades1-5Center5 KapunahalaElementarySchool GradesK-6Center6 KingIntermediateSchool Grades7-8Movingforward,pleaseenterthecentersinthesameorderforthetablestocome.
IMPAQInternational 5 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
2. ExecutiveSummaryThissectionofthereportisabriefoverviewoftheevaluation,explainingwhyitwasconductedandlistingitsmajorconclusionsandrecommendations.Althoughtheexecutivesummaryisplacedfirst,itistypicallythesectionthatyouwritelast.Includeabriefsummary(nomorethan2pages,12pt.)ofthekeypointsfromeachsectionofthereport:1. Programdescription2. EvaluationDesign3. EvaluationResults4. ConclusionsandRecommendations
ProgramDescriptionTheCAFÉProjectcombined1)academicinstructionandtheuseoftechnologytoincreasemathandreadingachievement,2)enrichmentactivitiestoengagestudentsandfosterpositivelearningbehaviorandlearningachievement,3)collegeandcareerawarenessprograms,4)transitionprograms,and5)familylearningactivitiestodevelopparentunderstandingoftheCAFÉprogramandcurriculumtosupporttheirchild’slearning.TheCAFÉprogram21stCCLCProjectimplementedinthegrantapplicationprovidedaqualityacademicenrichmentprogramfocusedonacceleratingacademicachievementoftargetedstudentsinmathandreading.Asplanned,on-linereadingandmathprograms(Achieve3000andIXL)wereimplemented,providingscientifically-baseddifferentiatedinstructionalprogramstosupportandenhancethestandards-basedcurriculumoftheafterschoolprogramandensureacademicaccelerationintheareasofreadingandmath.Inaddition,Roboticsandotherenrichmentprogramswereaddedtoenhancestudentlearningandengagestudentsinareasofstudentinterest.Achieve3000assessmentandtheIXLon-linemathprogramassessmentwereimplementedtoprovideaclearerpictureofthestudents’skilldevelopmentgains,enablingstudents,teachers,andparentstomonitorandevaluatestudentlearningprogress.Inaddition,theiReadyprogramwasalsoimplemented.TheiReadyprogramutilizesdiagnosticassessmentstodeliverindividualizedinstructiontostudents.TheCAFÉProjectDirectorplannedandimplementedtheprogrambudget,hiringandschedulingofstaff,andoperationalpoliciesandpracticesfortheafter-schoolprogramincooperationwithcommunitypartnerships,siteschooladministrators,staff,youthandfamilies.
EvaluationDesignInanefforttomeasurestudentlearningconsistentlyandhaveavalidmeansofmeasuringstudentachievement,CAFÉimplementedastandardizedassessmentacrossallCAFÉsites.ThiswasusedinmeasuringmathandreadingachievementtodeterminelearningachievementgainsaswellasdeterminetheimpactoftheCAFÉprogramonlearningprogressandachievement.Programimpactwasmeasuredbyutilizingthe21stCenturyTeacher
IMPAQInternational 6 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
Survey,ParentSurveyandStudentSurvey,aswellasavailabledateonprogramimplementation.AssessmentanddatacollectionprocedureswereimplementedtopreteststudentsatthebeginningoftheprogramandposttestattheendoftheprogramacrossallCAFÉprogramsitesthroughtheuseoftheSTARstandardizedtestori-Readyassessment.On-goingassessmentwasalsoconductedusingthesupplementaryassessmentsusedtomonitorstudentprogressduringtheprogram.Parentsurveys,studentsurveys,andteachersurveyswereconductedattheendoftheprogramyear.Tomaintainandsustainfidelityofthecurriculum,scheduledobservationswereimplementedandconductedbytheProjectDirector,ImplementationManager,andSiteCoordinatorsthroughouttheCAFÉyear.
EvaluationResultsBasedontheobjectivesoutlinedintheCastleComplex21stCenturyGrant:Readingassessmentresultsshowed83%ofstudentsincreasedtheirreadingscores,surpassingtheAPRObjectiveof60%.MathAchievement:Mathassessmentresultsshowed88%ofstudentsincreasedtheirmathscores,surpassingtheAPRObjectiveof60%.AcademicAchievement:94%ofCAFÉregularstudentsimprovedinacademicperformance,whichisanincreaseof6%fromthepreviousyear.Basedontheteachersurveysreceived;5.88%showednoimprovement,28.61%showedaslightimprovement,39.84%showedamoderateimprovementand25.67%showedsignificantimprovement.100%ofcentersofferedhighqualityservicesinatleastonecoreacademicareaandimprovedstudentachievement.
ConclusionsTheCAFÉProjectsuccessfullydeliveredaneffectiveprogramof1)academicinstructionthattargetedreadingandmathachievement,2)engagingenrichmentactivitiesthatfosteredpositivelearningbehaviorsandlearningachievement,and3)familylearningactivitiestosupportstudentlearning.TheCAFÉProjectservedatotalof906studentsingradesK-12,ofwhich421werereportablestudents(attended30+days).Thisisanincreaseof60studentsor7.09%inthenumberofallstudentsservedascomparedtothedatareportedinschoolyear2016-2017.
Recommendations
1. Ensurethateachsiteenrollsstudentswhoareabletoattendfor30ormoredaysofinstructioninidentifiedclassesorprograms.
2. Developaplantosustainafterschoolsupportswhenfundingfromthegrantsubsides.
IMPAQInternational 7 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
3. ProgramDescription3.A. PROGRAMDESCRIPTIONProvideabriefdescriptionoftheprogram,includingthefollowingbulletpoints:• Describetheorganizationoperatingthegrantprogram.• Providethegrantyear(i.e.,Year1,Year2,Year3,etc.).• Describethecommunityandschoolsinvolvedintheprogram,includingevidencethatthese
arehigh-povertycommunities.• Didtheorganizationofferanyafterschoolprogrammingpriortothegrant?Ifso,whenwas
suchprogrammingfirstoffered?TheCastleComplexChildandFamilyEnrichmentprogramiscomprisedofsixDepartmentofEducationSchools.Inschoolyear2017-2018,CastleComplexwasinYear4ofthecurrentgrantperiod.UnderthedirectionoftheComplexAreaSuperintendentandProjectDirector,thegrantwasimplementedintheseschools.Priortothismostrecentgrant,theCastleComplexSchoolsreceivedfederalfundingundertheprevious21stCenturyGrantforeightyears.Priortotheimplementationofthe21stCenturyGrantprograms,afterschoolprogrammingwasofferedattheelementaryschoollevelthroughA+programswhichbeganin1999inanefforttoreducethehighincidenceoflatchkeychildreninHawaiibyprovidingasafe,secure,nurturingenvironment.Thegrantwasinitiatedinordertotargettheeducationallydisadvantagedstudentscharacterizedbycriticalneeds:1)speciallearnerneeds,2)chronicattendanceneeds,3)at-riskstudentsandfamiliesand4)minimalreadingandmathgrowth.Basedoninformationreceivedonreportablestudents,25%oftheCastleComplexstudentswereonfreeorreducedlunch,56%oftheCastleComplexstudentshadnoinformationreported,and19%werenotonfreeandreducedlunch.Inparticular,CastleHighSchoolhad30%eligible,KingIntermediatehad51%eligible,andParkerElementaryhad75%eligible.Nofree/reducedluncheligibledatawasreportedforHe'eia,Kahalu'u,andKapunhalaElementary.Additionally,30%offamilieswereclassifiedas“atrisk”,havingonlyoneparent.StudentswerestrugglingwithaStriveHIscoreof250orless.CastleComplexschoolsalsohadalargespecialeducationpopulation,recordedtwotimesthestateaverageof10%.“Chronicabsenteeism”wasparticularlynotedforHe`eia(18%),Kahalu`u(29%)andBenParker(20%). 3.B. PROGRAMGOALSANDOBJECTIVESAllHawai‘i21stCCLCgrantprogramsareaccountabletothestate’sKeyPerformanceIndicators(KPIs)–seeSection4B:EvaluationResults.InadditiontotheseKPIs,subgranteesmustarticulatetheirownprogram-specificgoalsandobjectives.
IMPAQInternational 8 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
• Goalsarebrief,generalstatementsaboutwhattheprogramhopestoachieve.• Objectivesaremoredetailed,specificstatementsthatarticulateexactlywhatwillchangeas
aresultoftheprogram.• Measuresmustalsobeidentifiedthatwillbeusedtoassessprogresstowardeach
objective.Goals,objectivesandmeasuresshouldbeclearlylinked.Seebelowforguidance.3.B.1. GoalsWhataretheoverallgoalsofyourparticularprogram?Pleasenumbereachmajorgoal.Seeexampleingrey.Itisnotnecessarytohavefivegoals,butspaceisprovidedincaseyoudo.1. SAMPLE:Improveacademicachievementinmath1. Increasethenumberofstudentswhoreceiveacademiclearningsupportafterschool.2. Expandtheexistingafterschooloptionstoengagemorestudentsandfamilies.3. Developacomprehensiveafterschoolprogramframeworkthatencouragescollaborationandcontinuity
amongafterschooloptions.4. Increasethenumberofstudentsmeetingstatereading,math,andsciencestandardsateachofthe
participatingschools.
3.B.2. ObjectivesWhatspecificmeasurableobjectivesarebeingusedtoaddressyourprogram’sgoals?Itisnotnecessarytohavefourobjectivespergoal,butspaceisprovidedjustincase.Linkobjectivestothespecificgoalsarticulatedaboveinsection3.B.1.Seeexamplesingreybelow.Enterallthatapply.Goal Objective Measure
1.
SAMPLE:1.150%ormoreofstudentsparticipatingatleast30daysinthe21stCCLCprogramwillimprovetheircoursemarksinmathfromfalltospring.
CourseMarks
SAMPLE:1.2Thegapinmathachievementbetweenlow-incomeandmiddleorhigh-incomestudentswillbereducedbyatleast5percentagepointsasmeasuredbytheSmarterBalancedAssessment.
SmarterBalancedAssessment
1.1.1100%ofcenterswillofferhighqualityservicesinatleastonecoreacademicarea.
DocumentationofServices,ProgramSummary
2.
2.1100%ofcenterswillofferenrichmentandsupportactivitiessuchasnutritionandhealth,art,music,technology,andrecreation.
DocumentationofServices,ProgramSummary
2.2100%ofthecenterswillofferservicesat10-15hoursperweekonaverage.
DocumentationofServices,ProgramSummary
3.3.1Complexwillestablishandmaintainpartnershipswithinthecommunitythatcontinuetoincreaselevelsofcommunitycollaborationinplanning,implementing,andsustainingprograms.
ListofPartnerships,DocumentationofPartnerships
4.
4.160%ofCastleComplexregularstudentswillincreasetheirmathandreadingassessmentscoresfromfalltospring.
Pre-andpost-STARori-Readyassessment
4.270%oftheCastleComplexregularstudentswillshowimprovementinacademicperformanceasshowninthe21stCCLCteachersurvey.
21stCenturyCCLCTeacherSurvey
IMPAQInternational 9 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
3.C. PARTICIPANTSINVOLVEDINTHEPROGRAM3.C.1. Attendance
Exhibit3:StudentsServedin2017-18(includingsummer)
Center
2017-18Enrollment–
Total
2017-18Enrollment–Regular* GradeLevels
BenjaminParkerElementarySchool 81 67 Grades3-6CastleHighSchool 199 44 Grades9-12HeeiaElementarySchool 137 44 GradesK-6KahaluuElementarySchool 117 58 Grades2-5KapunahalaElementarySchool 370 122 GradesK-6KingIntermediateSchool 263 86 Grades7-8
SubgranteeTotal 1167 421 *Regularattendeesarethosewhohaveattendedtheprogramfor30ormoredays.
AttendanceDiscussionDescribeattendanceateachcenterandatthesubgranteelevel.Doyouhaveanychallengeswithattendance?Howhaveyouencouragedattendance?TheCAFÉProjectservedatotalof1167studentsingradesK-12beginninginJune,2017andendinginMay,2018,ofwhich421wereregularattendees(attended30+days).Thisisanincreaseof321studentsor37.49%inthenumberofallstudentsservedascomparedtothedatareportedforallstudentsinthespringofschoolyear2017-2018.Theregularattendeenumberofstudentsserveddecreasedslightlyby95studentsor18.14%ascomparedtothedatareportedinschoolyear2016-2017.Inanefforttoincreaseregularattendeenumbers,siteshaveofferedadditionalenrichmentprogramsandadjustedsitehours.ProjectDirectorwillcontinuetoworkwitheachsitetodeterminehowtoincreasethenumbersofregularattendees.Decreaseinregularattendeenumberscouldbeattributedtoavarietyoffactors,whichinclude,lackofcommitmenttoattendprogramregularly,otheroutsideextracurricularactivities,andextensionoftheschoolday(studentsattendingprogrambeyonda6hourschoolday).3.C.2 ParticipantCharacteristicsWhatarethecharacteristicsofprogramparticipants–usethefollowingtwotablestoindicateforeachsitethecharacteristicsofprogramparticipantsincluding:• F/RLunch• SpecialNeeds• EnglishLanguageLearners
• Gender• Race/ethnicity
Thetablewillautomaticallycomputetotalsinthefinalrow.
IMPAQInternational 10 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
Exhibit4:CharacteristicsofStudentsServed*
Center F/RLunchSpecialNeeds ELL Male Female
BenjaminParkerElementarySchool 50 62% 14 17% 0 0% 32 40% 49 60%
CastleHighSchool 26 13% 29 15% 1 1% 88 44% 111 56%
HeeiaElementarySchool 0 0% 20 15% 4 4% 61 45% 76 55%
KahaluuElementarySchool 0 0% 13 11% 6 5% 60 51% 57 49%
KapunahalaElementarySchool 10 3% 4 1% 0 0% 187 51% 183 49%
KingIntermediateSchool 121 46% 20 8% 1 1% 120 46% 143 54%
SubgranteeTotal 207 100 12 548 619 *Informationisbasedonavailabledata.Schoolprivacylawsmaypreventaccessofinformation.Percentage(%)iscalculatedbasedonthetotalnumberofstudentswhoattendedthesiteduringsummer,fall,andspring
Exhibit5:Race/EthnicityofStudentsServed*Center #
AI/AN%
AI/AN#
Asian%
Asian#
NH/PI%
NH/PI#
Black%
Black#
Latino%
Latino#
White%
White#2+
%2+
#UK
%UK
BenjaminParkerElementarySchool
0 0% 3 4% 22 27% 0 0% 2 2% 4 5% 50 62% 0 0%
CastleHighSchool
0 0% 30 15% 39 20% 2 1% 0 0% 14 7% 92 46% 22 11%
HeeiaElementarySchool
0 0% 17 12% 75 55% 1 1% 0 0% 28 20% 3 2% 13 9%
KahaluuElementarySchool
0 0% 9 8% 96 82% 0 0% 0 0% 12 10% 0 0% 0 0%
KapunahalaElementarySchool
1 0% 47 13% 20 5% 1 0% 2 1% 11 3% 0 0% 288 78%
KingInter.School
0 0% 59 22% 51 19% 0 0% 1 0% 32 12% 107 41% 13 5%
SubgranteeTotal
1 165 303 4 5 101 252 336
Note:AI/ANreferstoAmericanIndian/AlaskaNatives;NH/PIreferstoNativeHawaiian/PacificIslander,2+referstoTwoormoreethnicities;UKreferstounknownordatawasnotavailable.*Informationisbasedonavailabledata.Schoolprivacylawsmaypreventaccessofinformation.
3.D SUMMERANDINTERSESSIONPROGRAMMINGDescribeactivitiesofferedduringsummerandintersession.Eachsiteofferedprogramstoenhancecorecurriculum(literacyandmath).Achieve3000,IXL,andReadingPlusareexamplesofweb-basedprogramsimplementedthathelpstudentsdevelopskillsneededinordertobeproficientreaders.Sitesalsoofferedintegrated,hands-on,mathandlanguageartslessons.EnrichmentactivitiesofferedatsitesincludeSTEMproject-basedlessons,cooking,drama,art,andphysicaleducation.Atthesecondarylevel,highschool,studentsparticipatedintransitionactivitiestohelpgetorientedfromintermediateschooltohighschoolinanefforttobuildrelationshipswithteachersandpeermentors.
IMPAQInternational 11 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
Inthetablebelow,provideenrollmentnumbersandgradelevels.Thetablewillautomaticallycomputetotalenrollment.
Exhibit6:StudentsServedDuringSummer
CenterSummerEnrollment
–Total GradeLevelsBenjaminParkerElementarySchool 20 Grades4-6CastleHighSchool 118 Grades9-12HeeiaElementarySchool 27 Grades3-6KahaluuElementarySchool 68 Grades1-6KapunahalaElementarySchool 82 GradesK-5KingIntermediateSchool 41 Grades7-8
SubgranteeTotal 356
3.E. CHARACTERISTICSOFPROGRAMMATERIALSANDRESOURCES3.E.1. ProgramMaterialsWhatprogrammaterialswereused(e.g.,curriculum,onlineprograms,readingmaterials,hands-onmaterials,equipment,tools)?On-LineReading-Achieve3000:Aninternetaccessed,differentiatedreadingfluencyprogramscientificallyproventoincreasereadingfluency,comprehension,vocabulary,andwritingproficiency;showntodramaticallyimpacthigh-stakestestscoresforstudents.On-LineMath–IXL:Amathfluencydevelopmentprogramwherestudentsfindthatmathismorethanjustnumbersandlearningcanbefun.Robotics:StudentslearnedhowtobuildandprogramrobotsusingVEXIQsystems.VEXIQisaprogrammableroboticsplatformdesignedtotransformSTEMlearning.CAFÉleadersusedahands-onapproachtoscience,math,technology,andliteracy.Y4YProject-BasedScience:On-linetoolsaccessibleforschoolprograms.Providesanoverviewofproject-basedlearning,thebenefitsofauthenticprojects,andprovidesawealthofengagingprojectswherestudentsareimmersedintheinquiry-process.3.E.2 ResourcesWhatresources(e.g.,grantfunds,physicalfacilities,in-kindpersonnel,communitypartnerships)wereavailable?Thefollowingresourceswereutilized:
a. Othergrantfunds:Title1b. Physicalfacilitiesandadministrativeplanning/implementationsupportfromCastle
Complex’s6DOESchools:CastleHighSchool,KingIntermediate,He`eiaElementarySchool,Kahalu`uElementarySchool,KapunahalaElementarySchool,andParkerElementarySchool.
c. Communitypartnerships
IMPAQInternational 12 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
3.F. STAFFANDOTHERSINVOLVEDINTHEPROGRAMProvideabriefdescriptionofstaffandroles.Completethefollowingtablesastheyapplytoyourprogram.Totalswillbeautomaticallycomputed.
ThestaffincludedaProjectDirector(1),ImplementationManager(1),AccountClerk(1),SiteCoordinators(4),and47classroomleaders,subcontractedstaff,and/orvolunteersduringtheschoolyear.Inthesummer(June-July,2017),thestaffincludedaProjectDirector(1),SiteCoordinators(3),DataManagers(3)and32classroomleaders,subcontractedstaff,and/orvolunteers.
Exhibit7.NumberofStaffbyPosition
Center Adminis-trators
CollegeStudents
CommunityMembers
HighSchoolStudents
Parents SchoolDayTeachers
Non-Teaching
SchoolStaff
Sub-contracted
Staff
Other
Paid Vol Paid Vol Paid Vol Paid Vol Paid Vol Paid Vol Paid Vol Paid Vol Paid Vol
BenjaminParkerElementarySchool
0 0 0 0 0 0 0 0 0 0 7 0 0 1 2 0 4 0
CastleHighSchool 1 0 0 0 0 0 0 0 0 0 6 0 0 0 6 0 0 0
HeeiaElementarySchool
1 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0
KahaluuElementarySchool
1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 1 0
KapunahalaElementarySchool
1 0 0 0 0 0 0 0 0 0 7 0 0 0 1 0 1 0
KingIntermediateSchool
0 0 0 0 0 0 0 0 0 0 0 0 0 0 8 0 0 0
SubgranteeTotal 4 0 0 0 0 0 0 0 0 0 28 0 1 1 17 0 6 0
IMPAQInternational 13 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
Exhibit8.AverageHoursperWeekbyPositionCenter Adminis-
tratorsCollegeStudents
CommunityMembers
HighSchoolStudents
Parents SchoolDay
Teachers
Non-Teaching
SchoolStaff
Sub-contracted
Staff
Other
BenjaminParkerElementarySchool 10 0 0 0 0 8 4 0 10
CastleHighSchool 10 0 0 0 0 8 0 10 0HeeiaElementarySchool
10 0 0 0 0 10 0 0 10
KahaluuElementarySchool
13 0 0 0 0 8 8 0 0
KapunahalaElementarySchool
11 0 0 0 0 6 4 6 4
KingIntermediateSchool
0 0 0 0 0 0 0 15 0
SubgranteeTotal 54 0 0 0 0 40 16 31 24
3.G. PARTNERSHIPSPartnershipDataEntersubgrantee-levelpartnershipdataintheappropriatefieldsinthetablebelow.
Exhibit9:PartnersPartnerContributions TotalNumberofPartners
ContributionType #PaidPartners
#UnpaidPartners
Provideevaluationservices 0 0
Raisefunds 0 0
Provideprogramming/activityrelatedservices(CHSPartners,GirlScouts,ASAS) 7 1
Providegoods 0 0
Providevolunteerstaffing 0 0
ProvidePaidStaffing(KingASAS,Uplink) 1 1
Other(D.O.E.,PACT) 0 2
SubgranteeTotal 8 4
PartnershipDescriptionProvideabriefdescriptionofsuccesseswithpartnerships.HawaiiInstituteofMarineBiology-StudentsatCastleHighreceivedanintroductiontotheHawaiiInstituteofMarineBiologyresearchandhistory,scientificmethodology,reefmonitoring,UAS/Droneuseincoastalresearchandmonitoring,3-Dimagingofcoralreefsandtheassociatedcomputerdataprocessing.Studentsparticipatedinsmallresearchteamsinordertocompleteproject-basedlearningactivities.
IMPAQInternational 14 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
Kako’oiwi-StudentsatCastleHighweretaughtHawaiianculturalpracticesintheformofchantandstoryalongwithbasicfarmknowledgeandpractice.KeyProject-StudentsatCastleHighwereinvolvedinwatershedobservations,cleanup,andrestoration.Studentsalsolearnedaboutthenativeo’opuanobservedo’opuinthestream.PaepaeO’He’eia-StudentsatCastleHighweretaughtculturallyrelevantandacademicallyrigorousstudiesaimedatbridgingtraditionalandcontemporaryknowledgesystems.PapahanaKualoa-StudentsatCastleHighweretaughtamodelofinnovativeeconomicdevelopmentthatisenvironmentallysustainableandculturallyminded.WaikaluaLokoFishpond:StudentsatCastleHighparticipatedinhands-onoutdooractivitiesinenvironmentalscience.Lessonsarefocusedonscientificandecologicallearningexperiences.Provideabriefdescriptionofchallengeswithpartnerships.Partnershipsweredevelopedtoprovideincreasedopportunitiesforstudentsandparents.Theonlychallenge(althoughminimal)wastheextensiveamountoftimetocoordinateserviceswithoutsideagencies.Projectdirectorattendedmultiplemeetingstoensurethateachpartnershipwasasuccess.3.H. PARENT/FAMILYINVOLVEMENTProvideabriefdescriptionofyourprogram’sparent/familyinvolvementcomponent,includingcommunicationsandoutreachtoparentsandfamilies,familyprogrammingandevents,challengesandsuccesses.Toensurethatallsitesengagedinsustained,plannedfamilyactivities,thesitecoordinatorsateachsiteworkedcloselywithadministrators,teachers,andotherpartnerships(i.e.TitleOne)todevelopaseriesoffamilyactivities.AnexampleoftheseactivitiesincludedSTEMfamilynightsandrobotics.Thefamilyactivitiesweredocumentedandpresentedtotheimplementationmanagerandprojectdirectoratthebeginningoftheyear.Eachsitekeptacommunityoutreachlogintheirsitebindertodocumentandrecordparentphonecallsandupdatesonstudents.Inaddition,theclassroomleaders/sitecoordinatorssentoutquarterlyprogressreportstoparentstoupdatethemonstudentprogressandchallenges.Thisensuredthatparentswerefullyawareoftheirchild’sparticipationintheprogram.
IMPAQInternational 15 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
4. Evaluation4.A. EVALUATIONPLAN4.A.1. EvaluationDesignOverviewProvideaone-paragraphbriefoverviewoftheevaluationdesign.EvaluationwasconductedtoassesstheimplementationandtheimpactoftheCAFÉprogramsonstudentachievementatthesixCastleComplex21stCCLCschool-basedcenters.Programimpactwasmeasuredbytheincreaseinstudentsimprovinginmathandreadinggrades,mathandreadingachievement,andlearningbehaviors,falltospring.Programimpactonstudentachievementwasmeasuredbythemathandreadingpre-postassessmentscoresfromfalltospring.Pre-postreadingassessmentwasconductedusingtheSTARAssessmentori-Ready.Pre-postmathassessmentwasconductedusingSTARAssessmentori-Ready.The21stCCLCTeacherSurveywasusedatallcenterstomeasureimprovementinstudentlearningbehaviorwhichincludedturninginhomework,improvementinclassparticipation,improvementinbehavior,andimprovementinacademicperformance. 4.A.2. ImplementationEvaluationDescribehowprogramimplementationisbeingdocumented.
SampleImplementationQuestions:§ Hastheprogrambeenimplementedasplannedinthegrantapplication?Ifno,whatchangesweremade,
andwhy?§ Whatchallengeshavebeenfacedinimplementingtheprogram,andhowarethosechallengesbeing
addressed?§ Whichcommunity-basedpartnerships,asplannedinthegrantapplication,havebeenestablishedand
maintained,andwhichoneswerenot?Why?§ Areprogramactivitiesinterestingandvaluabletostudents,teachers,administrators,andcommunity
partners?§ Whataretheplanstoensureeffectiveprogramimplementationnextyear?
Whatimplementationquestionsarebeinganswered?
1. Hastheprogrambeenimplementedasplannedinthegrant
application?2. Whatchallengeshavebeenfacedinimplementingtheprogram
andhowarethesechallengesbeingaddressed?3. Whichcommunity-basedpartnershipsasplannedinthegrant
applicationhavebeenestablishedandmaintained?4. Areprogramactivitiesinterestingandvaluabletostudents,
teachers,administratorsandcommunitypartners?5. Whataretheplanstoensureeffectiveprogramimplementation
nextyear?
IMPAQInternational 16 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
Whatdatacollectionmethodsarebeingused(e.g.interviews,observations)?
SiteCoordinatorsconductedon-goingobservations;Leadersconductedtheclassesandadministeredtheassessments;SiteCoordinatorscollectedthesitedata;andtheDataManagergathered,organized,formatted/inputted,documented,andreportedthedata.
Whatisthetimingofdatacollection?
Achievementobjectivesweremeasuredpre(beginningoftheschoolyear)andpost(attheendoftheschoolyear).On-goingdata(weeklyreportsandclassroomobservations)wascollectedduringtheschoolyeartoimproveinstructionandprovidefeedbackontheprogramsateachsite.
Inaddition,thefollowingcomponentswereutilizedtoensuredatacollectionandfeedbackforevaluation:1.ParentSurveyandStudentSurveyresponsetotheCAFÉProgramwereadministeredattheendoftheschoolyear.2.CAFÉProgramoperationswithregardstoAPRObjectivesweredocumentedduringtheschoolyearandassessedattheendoftheCAFÉProgramyear.4.A.3. OutcomesEvaluationDescribehowprogramoutcomesarebeingevaluated.SampleOutcomesQuestions:• Towhatextentdostudentswhoparticipateintheprogramshowimprovementsinbehavior?• Towhatextentdostudentswhoparticipateintheprogramsshowacademicgains?• Towhatextenthastheprogramachieveditsobjectives?• Whatfactorshaveaffectedprogramsuccess?
Whatoutcomesquestionsarebeinganswered?
1. Towhatextentdostudentswhoparticipateintheprogramshowimprovementsinbehavior?
2. Towhatextentdostudentswhoparticipateintheprogramsshowacademicgains?
3. Whatfactorshaveaffectedprogramsuccess?Foreachoutcome,whatmeasuresanddatacollectionmethodsarebeingused(e.g.attendance,grades,behaviorincidents)?
STAR(readingandmath)standardizedassessmentori-Readystandardizedassessment.The21stCCLCTeacherSurveyofstudentimprovementinhomeworkcompletion,classparticipation,behavior,andacademicperformance.
Whatisthetimingofdatacollection?
Pre-assessmentdatawascollectedatthebeginningandpost-assessmentwascollectedattheendoftheschoolyear.Teachersurveywasadministeredattheendoftheyear.
IMPAQInternational 17 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
Inaddition,thefollowingcomponentswereutilizedtoensuredatacollectionandfeedbackforevaluation:1.CaféProgressReportsweresenthometwiceayeartoprovidecommunicationwithschooldayteachersandprogramteachersontheperformanceofthestudents.2.Programmonitoringobservationsweredonemonthlytoensurethatprogramtargetedacademicgains.4.B. EVALUATIONRESULTS4.B.1. ImplementationEvaluationResultsDescribetheresultsoftheimplementationevaluation,addressingtheimplementationquestionsdescribedinyourresponsetoSection4.A.2above.
1. Hastheprogrambeenimplementedasplannedinthegrantapplication?
TheCAFÉprogram21stCCLCProjectwasimplementedasplannedinthegrantapplicationandprovidedaqualityacademicenrichmentprogramfocusedonacceleratingacademicachievementoftargetedstudentsinmathandreading.Asplanned,on-linereadingandmathprograms(Achieve3000andIXL)wereimplemented,providingscientifically-baseddifferentiatedinstructionalprogramstosupportandenhancethestandards-basedcurriculumoftheafterschoolprogramandensureacademicaccelerationintheareasofreadingandmath.Inaddition,Roboticsandotherenrichmentprogramswereaddedtoenhancestudentlearningandengagestudentsinareasofstudentinterest.Achieve3000assessmentandtheIXLon-linemathprogramassessmentwereimplementedtoprovideaclearerpictureofthestudents’skilldevelopmentgains,enablingstudents,teachers,andparentstomonitorandevaluatestudentlearningprogress.
Inanefforttomeasurestudentlearningconsistentlyandhaveavalidmeansofmeasuringstudentachievement,CAFÉimplementedastandardizedassessmentacrossallCAFÉsites.ThiswasusedinmeasuringmathandreadingachievementtodeterminelearningachievementgainsaswellasdeterminestheimpactoftheCAFÉprogramonlearningprogressandachievement.
2. Whatchallengeshavebeenfacedinimplementingtheprogramandhowarethese
challengesbeingaddressed?a.Accessingstudentprofiledatawasachallengeduetostudentprivacylaws.CAFÉcontinuestomeetwithschooladministratorstodiscuss21stCCLCdatarequirementsandplanwaysCAFÉcanaccessstudentidentificationinformation.TheimplementationofiResultsinthe2018-2019schoolyearshouldassistinensuringpristine,accuratedataisobtained.
IMPAQInternational 18 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
b.Ensuringthatstudentsatthesubgranteesitesobtainaminimumof30ormoredaysintheprogram.CAFÉwillcontinuetoworkwithprincipalsandteacherstomaximizeattendanceforallstudents.Sitesmaychoosetoopenorofferservicesearlierinordertoprovidemoreopportunitiesforstudentstoattend30ormoreinstructionaldays.
3. Whichcommunity-basedpartnershipsasplannedinthegrantapplicationhavebeenestablishedandmaintained?WindwardCommunityCollege:Courseswereofferedtohighschoolstudentsinordertoobtaincollegecredits.
Parents&ChildrenTogether–KaneoheCommunityFamilyCenter(PACT–KCFC):Programming/activity-relatedservices;materials;volunteerstaffingandpaidstaffing.ParentsandChildrenTogetherprovidedhigh-qualityparentandchildcommunityprograms.CAFEwillcontinuetoassistPACT–KCFCwiththeirfamilyengagementeventsand5Rsprograms.
GirlScoutsofHawaii:Inpartnershipwithidentifiedelementaryschools,studentsengagedinCommonCoreStateStandardactivitiesandprogramstoexposegirlstoGirlScoutleadershipexperiencesonkeyleadershipfactors.
Title1:PartnershipwiththeTitle1coordinatortopresenteventsandfamilyengagementeventstofocusonpromotingadultliteracy.PacificAmericanFoundation:InpartnershipwithCastleRedesignProject,thePacificAmericanFoundationcontinuedtosupportCastleHighSchoolStudentsintheHo’ouluOpioprogram.DepartmentofEducation:PartnershipwithDepartmentofEducationSchoolstousefacilitiesandDepartmentofEducationSchoolFoodServicesprovidedsnackstostudents.`ŌleloCommunityMedia–WindwardCommunityMediaCenter:Olelowasabletoprovidemediaandtechnologysupportstostudentsinthe21stCenturyGrantPrograms.
4. Areprogramactivitiesinterestingandvaluabletostudents,teachers,administratorsandcommunitypartners?TheCAFÉProjectcombined1)academicinstructionandassistancewhichincreasedmathandreadingachievement,2)engagingenrichmentactivitiesthatsupportedpositivelearningbehaviorandlearningachievement,and3)familylearningactivitiesthatfosteredparentunderstandingoftheCAFÉprogramandcurriculumtosupporttheirchild’slearning.TheprojectdirectorincreasedtheCAFÉprogramwithnewprogramsaddedtoeachsite:robotics,coding,andothersenhancedtheprograms.
IMPAQInternational 19 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
ParentsrespondedfavorablytotheCAFÉProgram;97%ofparentsfelttheCAFÉprogramhelpedtheirchilddobetterinschool.StudentsrespondedfavorablytotheCAFÉProgram;88%ofstudentsfelttheCAFÉprogramhelpedthemdobetterinschool.
5. Whataretheplanstoensureeffectiveprogramimplementationnextyear?ImplementationplansincludingplanningmeetingsandcoordinationwithCastleComplex21stCCLCprojectsiteprincipalsareinplaceandstepshavebeentakentoensurethatCAFÉprogramsarestartedatthebeginningoftheschoolyearandplansensurethatstudentsintheprogramattend30+days.Asystemforstafftraining,staffsupport,andstaffandprogramsupervisionisinplace.Thesystemincludeson-sitecoachingtoprovidecurriculum/instructionalguidanceandfeedbacksupporttoincreaseeffectivenessofinstructionalongwithsitecoordinatorobservationsusinganobservationinstrument.TheCAFÉprogramhasalsoprovidedtrainingopportunitiesincodingwhichwillcontinuetobeimplementedinthe2018-2019schoolyear.CAFÉwillcontinuetodevelopandmaintainasustainabilityplanandworktowardsprogramsustainabilityoverthegrantperiod.
4.B.2 KeyPerformanceIndicators(KPIs)–Objective1Objective1:Participantswilldemonstrateeducationalandsocialbenefitsandexhibitpositivebehavioralchanges.Exhibit10:PerformanceonKPIObjective1–TurninginHomeworkandClassroomParticipationObjective1.2:PercentageofREGULARprogramparticipantswithteacher-reportedimprovementsinturninginhomeworkandparticipatinginclass.
Center
PercentageofREGULARprogramparticipantswithteacher-reportedimprovementinturninginhomeworkandclassroomparticipation(INSERTONLYONEPERCENTAGEFOREACHCENTER)
BenjaminParkerElementarySchool 91%
CastleHighSchool 88%
HeeiaElementarySchool 68%
KahaluuElementarySchool 90%
KapunahalaElementarySchool 96%
KingIntermediateSchool 89%
IMPAQInternational 20 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
Exhibit11:PerformanceonKPIObjective1–StudentClassroomBehaviorObjective1.2:PercentageofREGULARprogramparticipantswithteacher-reportedimprovementinstudentclassroombehavior.
CenterPercentageofREGULARprogramparticipantswithteacher-reportedimprovementinteacher-reportedstudentclassroombehavior
BenjaminParkerElementarySchool 96%
CastleHighSchool 88%
HeeiaElementarySchool 72%
KahaluuElementarySchool 96%
KapunahalaElementarySchool 97%
KingIntermediateSchool 89%
KPIObjective1DiscussionPleasedescribeparticularsuccessesrelatedtoObjective1.Whatdata/evidencearethesesuccessandchallengesbasedon?Basedonthetotalamountofteachersurveysreceived,thefollowingresultswereprovidedforthecomplex.Turninginhisorherhomeworkintotheteacher’ssatisfaction:26.2%showedsignificantimprovement,32.35%showedmoderateimprovement,30.48%showedslightimprovementand10.96%showednoimprovement.IImprovementinclassparticipation:28.34%showedsignificantimprovement,40.91%showedmoderateimprovement,24.6%showedslightimprovementand6.15%showednoimprovement.Challengeswerenotedfor“noimprovement”inhighschoolduetostudents’failingordroppingoutoftheprogram.Evidenceofsuccesseswasnotedintheresultsoftheteachersurvey,thecomplexshowedanoverwhelmingamountofimprovement.PleasedescribeparticularchallengesrelatedtoObjective1.Whatdata/evidencearethesesuccessandchallengesbasedon?Basedonthetotalamountofteachersurveys,thefollowingresultswereprovided:Improvementinbehavior:25.4%showedsignificantimprovement,31.02%showedmoderateimprovement,33.16%showedslightimprovementand10.43%showednoimprovement.Improvementinacademicperformance:25.67%showedsignificantimprovement,39.84%showedmoderateimprovement,28.61%showedslightimprovementand5.88%showednoimprovement.Teachersnotedthatstudentsoverallimprovedormaintainedappropriateschoolbehaviorasnotedintheresultsoftheteachersurvey.Challengeswerenotedwhenstudentsdidnotcomplywithappropriateschoolbehaviors(i.e.comingtoschoolontime)whichwasnotassociatedwithgrantimplementationandonlyaffectedasmallgroupofstudents.
IMPAQInternational 21 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
4.B.3 KeyPerformanceIndicators–Objective2Objective2:21stCenturyCommunityLearningCenterswillofferarangeofhigh-qualityeducational,developmental,andrecreationalservices.
Exhibit12:PerformanceonKPIObjective2–CoreEducationalServicesObjective2.1:Centerswillofferhigh-qualityservicesinatleastonecoreacademicarea,suchasreadingandliteracy,mathematics,orscience.(ClickYesorNoforeachacademicarea)
CenterReading&Literacy Math
Science&Technology Other(specify)
BenjaminParkerElementarySchool Y Y Y
CastleHighSchool Y Y Y
HeeiaElementarySchool Y Y Y KahaluuElementarySchool Y Y Y
KapunahalaElementarySchool Y Y Y
KingIntermediateSchool
Y Y Y
CoreEducationalServicesDiscussionProvideabriefdescriptionofevidencethattheseservicesareofhighquality.
TechnologyBasedMathandReadingProgram,IXL,isanevidence-basedprogramthatcraftshigh-qualitycontentacross6,000skills.Theefficacystudiesin12statesshowedthatschoolsusingIXLoutperformedotherschoolprograms.TechnologyBasedReadingProgram,Achieve3000,isanevidence-basedprogramthathasprovenresults.Researchfromtheprogramlookedattheachievementof1,221,690studentsin6,153schools.ResultsshowedthatstudentsusingAchieve3000tripledtheirexpectedreadinggainswithregularprogramuse.
Exhibit13:PerformanceonKPIObjective2–EnrichmentActivitiesObjective2.2:Centerswillofferenrichmentandsupportactivitiessuchasacademicassistance,remediationandenrichment,nutritionandhealth,art,music,technology,andrecreation.(ClickYesorNoforeachenrichmentarea.)Center Arts&
MusicPhysicalActivity
CommunityService
Leadership Tutoring/Homework
Help
Other(Specify)
BenjaminParkerElementarySchool
Y Y N N Y
CastleHighSchool Y Y N Y Y
HeeiaElementarySchool Y Y N Y Y KahaluuElementarySchool
N N N N Y
KapunahalaElementarySchool
N Y Y N Y
KingIntermediateSchool Y Y Y Y Y
IMPAQInternational 22 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
Exhibit14:PerformanceonKPIObjective2-ServicestoParentsandFamilyMembersObjective2.3:Centerswillofferservicestoparentsandotherfamilymembersofstudentsenrolledintheprogram.Center Numberof
parents/family
membersparticipating
Descriptionofservicestoparentsandotherfamilymembers.
BenjaminParkerElementarySchool
79
ThefocusofBenjaminParkerElementarySchool’sfamilyactivitiesweretoinvolvefamiliesonhowtoassisttheirchildreninmeetingScienceandMathcommoncorestatestandards.Targetedactivitieshelpedparentsdevelopawarenessonthestandardsandinformationwasprovidedonhoweachparentcouldsupporttheirchildathome.
CastleHighSchool
111
Familieswereactivelyinvolvedintheshowcasingofstudentachievementatthehighschoollevel.CastleHighconductedtwofamilyinvolvementactivities,NaKanakaO’KoolaupokoandaHo’ikeShowcase.Theseactivitieswerespecificallygearedtowardencouragingfamiliestolearnabouttheirstudentsandcelebrateaccomplishments.
HeeiaElementarySchool
61
HeeiaElementaryhadaseriesofsustainedfamilyinvolvementactivitiesthatprovidedfamilieswithactivitiesthatdirectlycorrelatedwiththecurriculumintheschoolday.Activitiesincludedartprojects,scienceexperiments,anddevelopingsimplerobotics.
KahaluuElementarySchool
22
FamiliesparticipatedinSTEM(Science,Technology,Engineering,andMath)activities.Thefamiliesandstudentswereabletoexperiencehands-onactivities,whichweredirectlylinkedtothecommoncorestatestandards.
KapunahalaElementarySchool
63
Familypartnershipstargetedparentalinvolvementinrobotics,healthawareness,andnutrition.Roboticsactivitiesweregearedatinvolvingfamiliesinthedevelopmentanduseoftechnology.FamiliesalsoparticipatedinactivitiesfortheBlueZonesproject(acommunity-widewell-beingimprovementinitiativetohelpmakehealthychoicesinthecommunity)andparticipatedinactivitiesthatencouragedhealthylivingbyusingsustainableingredientsfromthegardenoncampus.
KingIntermediateSchool
66
Eachquarter,inpartnershipwithKingAfterschoolAllStars,familyinvolvementnightswereplannedandimplemented.Activitiesrangedfromcelebrationsofstudentactivitiestofamilymovienights.
IMPAQInternational 23 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
Parent/FamilyServicesDiscussionProvideabriefdescriptionofsuccessesinprovidingservicestoparentsandotherfamilymembers.AllCastleComplex21stCenturyProgramSitesofferedbothenrichingandengagingfamilyactivities.Forsitesthatcollectedevaluationsorsurveys,responseswerefavorableandfamiliesexpressedappreciationforbeingprovidedlearningopportunitiesasafamily.Specificcommentsfromfamiliesincluded,“Buildingandlearningthingswereawesome.Handoutsweregoodtounderstandtheimportanceofscienceforthefuture,”“Itexplainswhatmychildshouldknowateachlevel,”“Ageappropriate,thought-provoking,stimulating,andfun,”and“TeachesmethingsIdidn’tknow”.Qualitativedataobtainedfromtheseresponsesareindicativeofsuccessesinprovidingservicestoparentsandotherfamilymembers.Provideabriefdescriptionofchallengesinprovidingservicestoparentsandotherfamilymembers.Althoughallsiteswererequiredtopresentopportunitiesforfamilyinvolvementandparticipation,thenumberoffamilieswhoattendedtheactivitieswasstillconsideredlow.Siteswillcontinuetorecruitparentstoattendandparticipateinfamilyactivitiesintheupcomingyear.
Exhibit15:PerformanceonKPIObjective2–HoursperWeekObjective2.4:Centerswillofferservicesfor12hoursormoreperweek,andprovideserviceswhenschoolisnotinsession,suchasduringthesummerandholidays.
Center
Numberofhoursperweekservicesofferedduringthe
schoolyear
Numberofhoursperweekservicesofferedduringsummerandholidays
BenjaminParkerElementarySchool 10 20
CastleHighSchool 10 20
HeeiaElementarySchool 10 20
KahaluuElementarySchool 13 20
KapunahalaElementarySchool 11 15
KingIntermediateSchool 15 20
[KeyPerformanceIndicators(KPIs)–Objective3Objective3-21stCenturyCommunityLearningCenterswillservechildrenandcommunitymemberswiththegreatestneedforexpandedlearningopportunities.(Notincludedhere-CommunitiesarealreadydescribedinSection3.Aabove.)]
IMPAQInternational 24 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
4.B.4 KeyPerformanceIndicators(KPIs)–Objective4Objective4:Regularparticipantsin21stCenturyCommunityLearningCenterswilldemonstrateacademicimprovementbasedonformativeandsummativeassessmentsgiventhroughouttheschoolyear.
Exhibit16:PerformanceonKPIObjective4–AcademicImprovementinReading/LanguageArts
Objective4.1:Participantsin21stCenturyCommunityLearningCenterswilldemonstrateacademicimprovementinreading/languagearts.Center Percentageofregularprogram
participantswithIMPROVEMENTinreading/languageartsfromfalltospring
PrimarySourceofDataonImprovement:Grades/
Coursemarks?Assessment/TestScores?
TeacherSurveys
BenjaminParkerElementarySchool
78%☐ ý ☐
CastleHighSchool 38% ☐ ý ☐ HeeiaElementarySchool
89%☐ ý ☐
KahaluuElementarySchool
100%☐ ý ☐
KapunahalaElementarySchool
95%☐ ý ☐
KingIntermediateSchool
71%☐ ý ☐
Exhibit17:PerformanceonKPIObjective4–AcademicImprovementinMath
Objective4.2:Participantsin21stCenturyCommunityLearningCenterswilldemonstrateacademicimprovementinmath.Center Percentageofregularprogram
participantswithIMPROVEMENTinmathfromfalltospring
SourceofDataonImprovement:Grades/
Coursemarks?Assessment/TestScores?
TeacherSurveys
BenjaminParkerElementarySchool
97%☐ ý ☐
CastleHighSchool 28% ☐ ý ☐ HeeiaElementarySchool
84%☐ ý ☐
KahaluuElementarySchool
100%☐ ý ☐
KapunahalaElementarySchool
98%☐ ý ☐
KingIntermediateSchool
43%☐ ý ☐
IMPAQInternational 25 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
KPIObjective4DiscussionPleasedescribeparticularsuccessesorchallengesrelatedtoKPIObjective4.Inanefforttomeasurestudentlearningconsistentlyandhaveavalidmeansofmeasuringstudentachievement,CAFÉimplementedastandardizedassessmentacrossallCAFÉsites.Fiveoutofthesixsitesusedthesameassessment(STAR)withonesiteusinganothervalidatedassessment(iReady).Theseassessmentswereusedinmeasuringmathandreadingachievementandtodeterminelearningachievementgains,aswellasdeterminetheimpactoftheCAFÉprogramonlearningprogressandachievement.Atthehighschoollevel,itappearedtobemoredifficultforteacherstoobtainstandardizedreadingandmathassessmentresults,thusresultinginalowersamplesize.ProjectDirectorwillcontinuetoworkwiththehighschoolsitecoordinatorandstafftohelprefineprocedures.4.B.5 AchievementofProgram-SpecificObjectivesPleasedescribeachievementoftheprogram-specificobjectivesdescribedearlierinSection3.B.2.1. Objective-Statethespecificmeasurableobjective2. Measure–statethetypeofdatacollectedtomeasurethisobjective3. Results-Summarizeevaluationfindingsrelatedtothisobjective4. Met/Notmet–foreachobjectivespecifyoneofthefollowing:• Met• Notmet• Progress
• Noprogress• Unabletomeasure
Copyobjectivesandmeasuresfromthetableinsection3.B.2intoExhibit19below.Makesuretoselectthewholetextboxbyclickingonthethreeverticaldotstotheupperleftofthebox.Completetheexhibitwithresultsandthestatustowardmeetingtheobjective.Sampleingrey.
Exhibit18:ProgressonProgram-SpecificObjectivesObjective Measure Results Met/NotMet
1.2Reducethegapinmathachievement(percentageofstudentsmeetinggradelevelstandard)betweenlow-incomevs.middleorhighincomestudentswillbereducedbyatleast5percentagepoints.
SmarterBalancedAssessment Thegapbetweenpercentageoflow-incomevs.middleorhighincomestudentsmeetingstandardin2017-18was9%comparedto15%in2016-17
Met
1.1100%ofcenterswillofferhighqualityservicesinatleastonecoreacademicarea.
DocumentationofServices,ProgramSummary-Initialprincipal,SiteCoordinator,ImplementationManager,ProjectDirector,LeadershipTeammeetingbeforeCAFEProjectbeginsyearlyateachsite.
100%ofcentersofferedhighqualityservicesinatleastonecoreacademicarea.
Met
IMPAQInternational 26 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
2.1100%ofcenterswillofferenrichmentandsupportactivitiessuchasnutritionandhealth,art,music,technology,andrecreation.
DocumentationofServices,ProgramSummary
100%ofcentersofferedenrichmentandsupportactivitiessuchasnutritionandhealth,art,music,technology,andrecreation.
Met
2.2100%ofthecenterswillofferservicesat10-15hoursperweekonaverage.
Assessment:Documentationofhoursofservices-SiteCoordinator(SC)tosubmitevidence-ImplementationManagerobservedandrecordeddata-WeeklySCsummariesdocumentedhoursofservicesoffered
100%ofthecentersofferedservicesat10-15hoursperweekonaverage.
Met
3.1Complexwillestablishandmaintainpartnershipswithinthecommunitythatcontinuetoincreaselevelsofcommunitycollaborationinplanning,implementing,andsustainingprograms.
ListofPartnerships,DocumentationofPartnerships
Complexhasestablishedandmaintainedpartnershipswithinthecommunitythatcontinuetoincreaselevelsofcommunitycollaborationinplanning,implementing,andsustainingprograms.
Met
4.160%ofCastleComplexregularstudentswillincreasetheirmathandreadingassessmentscoresfromfalltospring.
ReadingAssessmentInstrument:STARpre-andpost-assessmentwillbeadministeredwithcontinuousprogressmonitoring
MathAssessmentInstrument:STARpre-andpost-assessmentwillbeadministeredwithcontinuousprogressmonitoring
83%ofCastleComplexregularstudentsincreasedtheirreadingassessmentscoresfromfalltospring.88%ofCastleComplexregularstudentsincreasedtheirmathassessmentscoresfromfalltospring.*Dataisbasedonstudentswhowereadministeredareadingandmathassessment
Met
4.270%oftheCastleComplexregularstudentswillshowimprovementinacademicperformanceasshowninthe21stCCLCteachersurvey.
21stCenturyCCLCTeacherSurvey
94%oftheCastleComplexregularstudentsshowedimprovementinacademicperformanceasshowninthe21stCCLCteachersurvey.
Met
IMPAQInternational 27 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
AchievementofProgram-SpecificObjectivesDiscussionDescribewhetherobjectiveshavechangedsincelastyearandparticularsuccessandchallengesinmeetingprogram-specificobjectives.Achievementandprogram-specificobjectivesremainedthesameduringthe2017-18schoolyear,ascomparedtothepreviousschoolyear.Thespecificactivitiesimplementedwereexpandedtoincludemultipleenrichmentopportunities(Objective2.1)andtrainingforteachers.Duringthe2017-18schoolyear,staffreceivedtrainingfromanexperiencedcomputersciencefacilitator.Theworkshopprovidedanintroductiontocomputerscience,pedagogy,overviewoftheonlinecurriculum,teacherdashboard,andstrategiesforteaching“unplugged”classroomactivities.Inaddition,staffreceivedin-serviceandweb-basedtrainingonincorporatingOzobotsasanenrichmentactivityforstudents.Ozobotsaresmallrobotsthathelpstudentslearnsimplecodelanguageanddeductivereasoningbycreatingpathwaysthatcontrolmovementsandspeedindifferentdirections.4.C. ADDITIONALDATA4.C.1 SuccessStoriesThisyeartheCastleComplex21stCenturyGrantutilizedAltinoCodingattwosites.KapunahalaElementaryandCastleHighSchoolbothhadopportunitiestodevelopandrefineskillsinAltinoCoding.Altinoisarevolutionarycodingplatform,whichisaimedtobringeducationreformtoallK-12schoolsinHawai’i.Altinocomprisesofamultitudeofsystemlanguages(suchas:Android,Arduino,andC++),whichcanbeeffectivelyutilizedinlessonplanstomakecode-learninginteractive,inspiring,andfun.AspartoftheinitiativetointroduceScience,Technology,andEngineeringintotheschools,CastleComplexmetthatinitiativeandstudentsinboththeelementaryschoolandhighschoolhadopportunitiestoshowcasetheseskills.Inaddition,thehighschoolstudentspresentedanAltinoCodingdemonstrationata5RCommunityEvent.4.C.2 BestPracticesCastleComplex21stCenturyGrantimplementedthefollowingbestpracticesatthesites:Positivereinforcementandencouragement:Thispracticewasreadilyseenanddocumentedinprojectsiteobservationreports.Theuseofthistypeofreinforcementwaskeyininstillingself-confidenceandself-worthinthestudents.Allowingstudentstoprogressattheirownrate:Thispracticeprovidedstudentswithopportunitiestocompleteindividualassignmentsattheirownlevel.AnexampleofthistypeofprogrammingwasseeninIXLandKidBizprogramswhereeachassignmentisindividualizedtothestudent.
IMPAQInternational 28 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
Project-BasedLearning:Thispracticeprovidedstudentswithanopportunitytolearnandapplyknowledgethroughengagingexperiencesthatallowedfordeeperlearninginskillstiedtocollegeandcareerreadiness. 4.C.3 Student,Teacher,Parent,StafforCommunityInput–[ifyouusedsurvey(s)please
includeinstrumentasanattachmentandincluderesultsinthenarrative.]Eachsiteadministeredateacherandparentsurveyasanevaluationinstrumenttodetermineprogrameffectivenessandimpactonstudentachievement.Theresultsofthesurveyindicatedthattheprogramswereanoverwhelmingsuccess.ParentsreportedthattheirchildlookedforwardtocomingtotheCAFÉprogram(97%),theCAFÉprogramhelpedtheirchildbecomeabetterreader(97%),theCAFÉprogramhelpedtheirchildbecomeabettermathstudent(97%),theCAFÉprogramhelpedtheirchilddobetterinschool(97%),theCAFÉteacherscaredaboutthestudents(100%)andtheywouldenrolltheirchildintheCAFÉprogramagain(100%).StudentsrespondedfavorablytotheCAFÉProgram;theylookforwardtocomingtotheprogram(98%).StudentsfelttheCAFEprogramhelpedthembecomeabetterreader(76%)andbetterinmath(60%).TheyalsofelttheCAFÉprogramhelpedthemdobetterinschool(88%).StudentsfelttheCAFÉteacherscaredaboutthem(100%)andtheywouldwanttocometotheCAFÉprogramagain(85%).
IMPAQInternational 29 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
4.C.4 PicturesFeelfreetoshareanypicturesyoumighthavethatshowyour21stCenturyCommunityLearningCentersinprogress.
IMPAQInternational 30 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
5. SustainabilityPlan5.A ORIGINALSUSTAINABILITYPLANDescribetheoriginalsustainabilityplanasindicatedinthegrantapplication.Ifsuccessisactualizedinexemplaryprograms,thentheseprogramsshouldbereplicatedandsustainedtoensuretheacceleratedlearningofallstudents,longafterthefundingexpires.Tothisend,theCAFÉProjectwillmakecontinuouseffortstosustainextendinglearningopportunitiesforstudents.Principalswillmeetyearlytodiscussandstrategizeeffortstosustainextendedlearningopportunitieswithbestpracticesandprograms.5.B UPDATEDSUSTAINABILITYPLANDescribehowprogramminglevelswillbesustainedafterthegrantends,including:• Whatchangesweremadefromtheoriginalsustainabilityplan?• Whatcommunitypartnershavebeenadded?• Whatcommunitypartnershavedroppedoff?• Describeanyadditionalfundingsources.Theprojectdirector,principals,andpartnershipsarecurrentlyworkingonrefiningthesustainabilityplaninordertoensurecontinuedsuccess.Inordertoensurethatasustainabilityplanisdiscussedwitheachprincipal,awrittendocumentationplanisrecordedatthebeginningoftheschoolyear.Thecurrentcommunitypartnersaslistedinthegrantapplicationhaveremainedconsistent.Currentlytherearenoadditionalfundingsourcesattheelementaryschoollevel.AttheIntermediatelevel,out-of-schooltimeprogramfundingisbeingconsidered,forexample,UplinkandR.E.A.C.H.Eachsitewilllookattheiracademicandfinancialplanstoprioritizefundingforafterschoolsupports.Oncebudgetsaredefined,theindividualsiteswillbeabletoallocatefundingbasedonneed.
IMPAQInternational 31 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
6. ConclusionsandRecommendations6.A CONCLUSIONS
1. TheCAFÉProjectsuccessfullydeliveredaneffectivecomprehensiveprogramof
academicinstruction,engagingproject-basedenrichmentactivitiesandmeaningfulfamilylearningactivitiesdesignedtosupportthelearningofthestudents.
2. TheCAFÉProjectsuccessfullyfosteredpositivelearningbehaviorsandlearningachievement,collegeandcareerreadinessskills,andtransitionactivities.TheCAFÉProjectservedatotalof1167studentsingradesK-12,ofwhich421werereportablestudents(attended30+days).CAFÉserved356studentsduringthesummerintercession(June1,2016–July15,2017),whichisanincreaseof64studentsor21.92%ascomparedtotheprevioussummer.Allsitesofferedacademicandenrichmentsummerprogramsascomparedtothepreviousyearinwhichonly4sitesofferedsummerprograms.
3. CAFÉwasabletocontinuetoimplementstandardizedpre-posttestingtomeasure
learninggainsandestablishvalidityandreliabilityinmathandreadingassessmentacrossallCAFÉsites.
4. TheProjectDirector,ImplementationManager,andAccountClerkhaveremained
withtheCAFÉprogramforthepast12years.Thishelpedtoensureconsistencyinoperationsandprovidedasmoothtransitionfromyeartoyear.Thereisalsoalowturnoverinreturningstaff(sitecoordinatorsandclassroomleaders),thishelpedtoensurethatpoliciesandproceduresimplementedthroughouttheyear.
5. Ninetypercentoftheclassroomleadersarealsofull-timeclassroomteachers;
therefore,therearehighqualityclassroomengagementactivitiesandlessonsimplementeddailyaswellasexcellentbehaviormanagementsystemsinplaceforoptimalstudentlearning.
6. ProgramdatashowedtheCAFÉprogramfosteredpositivelearningbehavior,learning
achievement,andbothparentsandstudentsrespondedpositivelytotheprogram.
7. Thesitebindersforeachsiteprovidedthevehiclefordocumentationofprojectactivitiesandparticipants.
IMPAQInternational 32 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex
6.B RECOMMENDATIONSFORPROGRAMIMPROVEMENT
1. ContinuetoworkwithCastleComplexCAFÉsiteschools/principalstodocumentCAFÉstudentswiththegreatestneedforexpandedlearningopportunities.CAFÉprojectdirectorshouldcontinuetomeetwithprincipalstoidentifytargetedstudents,thosescoringbelowbenchmark.
2. Developaseriesofplanned,intentionalworkshopstobeofferedasacomplextoassistwithparentandcommunityeducationandtrainings.Developknowledgeorskill(s)tobuildcapacityofparentsto1)superviseandsupporttheirchild’slearningathomeand2)encouragepositivelearningbehaviorsbothathomeandatschool.Considerlearningopportunitiesforfurtheringeducationordevelopingcareerskills.
3. TheCAFÉprogramshouldcontinuetodevelopandmaintainasustainabilityplanthat
workstowardsprogramsustainabilityafterthegrantsubsides.
6.C EVALUATIONDISSEMINATION
1. Resultswillbepostedonthe21stCCLCCAFÉProjectwebsite:castlecomplexcafe.com.
2. CopyoftheevaluationresultsisexplainedandprovidedtotheSiteCoordinatorsandbinderdistributed.SiteCoordinatorsandprojectdirectorssharedatawiththePrincipals.Parentswillbeprovidedwithabriefsummaryoftheevaluationresults.
3. Parentswillreceivetheevaluationformsinaflyerformthatwillhighlightboththestrengthsandrecommendationsoftheprogram.