castle complex 21st cclc evaluation report final – sy2017 · implementation of evaluation results...

IMPAQInternational 1 Hawai‘i21stCCLCSY2017-18EvaluationCastleComplex

CASTLECOMPLEXJune1,2017–May30,2018

ImprovingLiteracy,Math,Science,andTechnologyinCastleComplexSchools

HeleneJ.O.Tom,ProjectDirectorCecilyChun,ProjectEvaluator


Hawai‘i21stCCLCEvaluationReport-CastleComplexSY2017-18OVERVIEW

Toassistsubgranteeswithmeetingstateevaluationrequirements,forSY2017-18theHIDOEisimplementingastandardizedtemplateforevaluationsofthe21stCCLCprograms.EachsubgranteeisrequiredtocompletethistemplatewithSY2017-18information.Thechecklistbelowservesasalistofrequiredelementsandprovidesatrackingtoolforcompletion.EvaluationElement Complete?

1. GeneralInformation ý Exhibit1:BasicInformationTable ý Exhibit2:CenterInformationTable ý

2. ExecutiveSummary ý 3. ProgramDescription ý

3.A.ProgramDescription ý 3.B.1Goals ý 3.B.2Objectives ý Exhibit3:StudentsServed ý AttendanceDiscussion ý Exhibit4:CharacteristicsofStudentsServed ý Exhibit5:Race/EthnicityofStudentsServed ý 3.D.SummerandIntersessionProgramming ý Exhibit6:StudentsServedDuringSummer ý 3.E.1ProgramMaterials ý 3.E.2Resources ý 3.F.StaffandOthersInvolvedintheProgram ý Exhibit7:NumberofStaffbyPosition ý Exhibit8:AverageHoursperWeekbyPosition ý Exhibit9:Partners ý PartnershipDescription ý 3.H.Parent/FamilyInvolvement ý

4. Evaluation ý 4.A.1.EvaluationDesignOverview ý 4.A.2.ImplementationEvaluation ý 4.A.3.OutcomesEvaluation ý 4.B.1.ImplementationofEvaluationResults ý Exhibit10:PerformanceonKPIObjective1–TurninginHomeworkandClassroomParticipation ý Exhibit11:PerformanceonKPIObjective1–StudentClassroomBehavior ý KPIObjective1Discussion ý Exhibit12:PerformanceonKPIObjective2–CoreEducationalServices ý CoreEducationalServices ý Exhibit13:PerformanceonKPIObjective2–EnrichmentActivities ý


EvaluationElement Complete?

4.B.3.KeyPerformanceIndicators–Objective2 ý Exhibit14:PerformanceonKPIObjective2–ServicestoParentsandFamilyMembers ý Parent/FamilyServices ý Exhibit15:PerformanceonKPIObjective2–HoursperWeek ý Exhibit16:PerformanceonKPIObjective4–AcademicImprovementinReading/LanguageArts ý Exhibit17:PerformanceonKPIObjective4–AcademicImprovementinMath ý KPIObjective4Discussion ý

4.B.5.AchievementofProgram-SpecificObjectives ý Exhibit18:ProgressonProgram-SpecificObjectives ý AchievementofProgram-SpecificObjectivesDiscussion ý 4.C.1.SuccessStories ý 4.C.2BestPractices ý 4.C.3Student,Teacher,Parent,Staff,orCommunityInput ý 4.C.4Pictures ý

5. SustainabilityPlan ý 5.A.OriginalSustainabilityPlan ý 5.B.UpdatedSustainabilityPlan ý

6. ConclusionsandRecommendations ý 6.A.Conclusions ý 6.B.Recommendations ý 6.C.EvaluationDissemination ý


1. GeneralInformationPleaseretainthepre-setformattingof12pt.fontfornarrativesectionsofthereportand10pt.inthetablesthroughoutthisdocument.

Exhibit1:BasicInformationTableRequiredInformation EnterInformation

DateEvaluationReportSubmitted November15,2018GranteeName CastleComplexProgramDirectorName HeleneTomProgramDirectorEmail [email protected] CecilyChunEvaluatorEmail [email protected] 2017-2018

Exhibit2:CenterInformationTableCenter NameofCenter GradeLevelsServed

Center1 BenjaminParkerElementarySchool Grades3-6Center2 CastleHighSchool Grades9-12Center3 HeeiaElementarySchool GradesK-6Center4 KahaluuElementarySchool Grades1-5Center5 KapunahalaElementarySchool GradesK-6Center6 KingIntermediateSchool Grades7-8Movingforward,pleaseenterthecentersinthesameorderforthetablestocome.


2. ExecutiveSummaryThissectionofthereportisabriefoverviewoftheevaluation,explainingwhyitwasconductedandlistingitsmajorconclusionsandrecommendations.Althoughtheexecutivesummaryisplacedfirst,itistypicallythesectionthatyouwritelast.Includeabriefsummary(nomorethan2pages,12pt.)ofthekeypointsfromeachsectionofthereport:1. Programdescription2. EvaluationDesign3. EvaluationResults4. ConclusionsandRecommendations

ProgramDescriptionTheCAFÉProjectcombined1)academicinstructionandtheuseoftechnologytoincreasemathandreadingachievement,2)enrichmentactivitiestoengagestudentsandfosterpositivelearningbehaviorandlearningachievement,3)collegeandcareerawarenessprograms,4)transitionprograms,and5)familylearningactivitiestodevelopparentunderstandingoftheCAFÉprogramandcurriculumtosupporttheirchild’slearning.TheCAFÉprogram21stCCLCProjectimplementedinthegrantapplicationprovidedaqualityacademicenrichmentprogramfocusedonacceleratingacademicachievementoftargetedstudentsinmathandreading.Asplanned,on-linereadingandmathprograms(Achieve3000andIXL)wereimplemented,providingscientifically-baseddifferentiatedinstructionalprogramstosupportandenhancethestandards-basedcurriculumoftheafterschoolprogramandensureacademicaccelerationintheareasofreadingandmath.Inaddition,Roboticsandotherenrichmentprogramswereaddedtoenhancestudentlearningandengagestudentsinareasofstudentinterest.Achieve3000assessmentandtheIXLon-linemathprogramassessmentwereimplementedtoprovideaclearerpictureofthestudents’skilldevelopmentgains,enablingstudents,teachers,andparentstomonitorandevaluatestudentlearningprogress.Inaddition,theiReadyprogramwasalsoimplemented.TheiReadyprogramutilizesdiagnosticassessmentstodeliverindividualizedinstructiontostudents.TheCAFÉProjectDirectorplannedandimplementedtheprogrambudget,hiringandschedulingofstaff,andoperationalpoliciesandpracticesfortheafter-schoolprogramincooperationwithcommunitypartnerships,siteschooladministrators,staff,youthandfamilies.

EvaluationDesignInanefforttomeasurestudentlearningconsistentlyandhaveavalidmeansofmeasuringstudentachievement,CAFÉimplementedastandardizedassessmentacrossallCAFÉsites.ThiswasusedinmeasuringmathandreadingachievementtodeterminelearningachievementgainsaswellasdeterminetheimpactoftheCAFÉprogramonlearningprogressandachievement.Programimpactwasmeasuredbyutilizingthe21stCenturyTeacher


Survey,ParentSurveyandStudentSurvey,aswellasavailabledateonprogramimplementation.AssessmentanddatacollectionprocedureswereimplementedtopreteststudentsatthebeginningoftheprogramandposttestattheendoftheprogramacrossallCAFÉprogramsitesthroughtheuseoftheSTARstandardizedtestori-Readyassessment.On-goingassessmentwasalsoconductedusingthesupplementaryassessmentsusedtomonitorstudentprogressduringtheprogram.Parentsurveys,studentsurveys,andteachersurveyswereconductedattheendoftheprogramyear.Tomaintainandsustainfidelityofthecurriculum,scheduledobservationswereimplementedandconductedbytheProjectDirector,ImplementationManager,andSiteCoordinatorsthroughouttheCAFÉyear.

EvaluationResultsBasedontheobjectivesoutlinedintheCastleComplex21stCenturyGrant:Readingassessmentresultsshowed83%ofstudentsincreasedtheirreadingscores,surpassingtheAPRObjectiveof60%.MathAchievement:Mathassessmentresultsshowed88%ofstudentsincreasedtheirmathscores,surpassingtheAPRObjectiveof60%.AcademicAchievement:94%ofCAFÉregularstudentsimprovedinacademicperformance,whichisanincreaseof6%fromthepreviousyear.Basedontheteachersurveysreceived;5.88%showednoimprovement,28.61%showedaslightimprovement,39.84%showedamoderateimprovementand25.67%showedsignificantimprovement.100%ofcentersofferedhighqualityservicesinatleastonecoreacademicareaandimprovedstudentachievement.

ConclusionsTheCAFÉProjectsuccessfullydeliveredaneffectiveprogramof1)academicinstructionthattargetedreadingandmathachievement,2)engagingenrichmentactivitiesthatfosteredpositivelearningbehaviorsandlearningachievement,and3)familylearningactivitiestosupportstudentlearning.TheCAFÉProjectservedatotalof906studentsingradesK-12,ofwhich421werereportablestudents(attended30+days).Thisisanincreaseof60studentsor7.09%inthenumberofallstudentsservedascomparedtothedatareportedinschoolyear2016-2017.

Recommendations

1. Ensurethateachsiteenrollsstudentswhoareabletoattendfor30ormoredaysofinstructioninidentifiedclassesorprograms.

2. Developaplantosustainafterschoolsupportswhenfundingfromthegrantsubsides.


3. ProgramDescription3.A. PROGRAMDESCRIPTIONProvideabriefdescriptionoftheprogram,includingthefollowingbulletpoints:• Describetheorganizationoperatingthegrantprogram.• Providethegrantyear(i.e.,Year1,Year2,Year3,etc.).• Describethecommunityandschoolsinvolvedintheprogram,includingevidencethatthese

arehigh-povertycommunities.• Didtheorganizationofferanyafterschoolprogrammingpriortothegrant?Ifso,whenwas

suchprogrammingfirstoffered?TheCastleComplexChildandFamilyEnrichmentprogramiscomprisedofsixDepartmentofEducationSchools.Inschoolyear2017-2018,CastleComplexwasinYear4ofthecurrentgrantperiod.UnderthedirectionoftheComplexAreaSuperintendentandProjectDirector,thegrantwasimplementedintheseschools.Priortothismostrecentgrant,theCastleComplexSchoolsreceivedfederalfundingundertheprevious21stCenturyGrantforeightyears.Priortotheimplementationofthe21stCenturyGrantprograms,afterschoolprogrammingwasofferedattheelementaryschoollevelthroughA+programswhichbeganin1999inanefforttoreducethehighincidenceoflatchkeychildreninHawaiibyprovidingasafe,secure,nurturingenvironment.Thegrantwasinitiatedinordertotargettheeducationallydisadvantagedstudentscharacterizedbycriticalneeds:1)speciallearnerneeds,2)chronicattendanceneeds,3)at-riskstudentsandfamiliesand4)minimalreadingandmathgrowth.Basedoninformationreceivedonreportablestudents,25%oftheCastleComplexstudentswereonfreeorreducedlunch,56%oftheCastleComplexstudentshadnoinformationreported,and19%werenotonfreeandreducedlunch.Inparticular,CastleHighSchoolhad30%eligible,KingIntermediatehad51%eligible,andParkerElementaryhad75%eligible.Nofree/reducedluncheligibledatawasreportedforHe'eia,Kahalu'u,andKapunhalaElementary.Additionally,30%offamilieswereclassifiedas“atrisk”,havingonlyoneparent.StudentswerestrugglingwithaStriveHIscoreof250orless.CastleComplexschoolsalsohadalargespecialeducationpopulation,recordedtwotimesthestateaverageof10%.“Chronicabsenteeism”wasparticularlynotedforHe`eia(18%),Kahalu`u(29%)andBenParker(20%). 3.B. PROGRAMGOALSANDOBJECTIVESAllHawai‘i21stCCLCgrantprogramsareaccountabletothestate’sKeyPerformanceIndicators(KPIs)–seeSection4B:EvaluationResults.InadditiontotheseKPIs,subgranteesmustarticulatetheirownprogram-specificgoalsandobjectives.


• Goalsarebrief,generalstatementsaboutwhattheprogramhopestoachieve.• Objectivesaremoredetailed,specificstatementsthatarticulateexactlywhatwillchangeas

aresultoftheprogram.• Measuresmustalsobeidentifiedthatwillbeusedtoassessprogresstowardeach

objective.Goals,objectivesandmeasuresshouldbeclearlylinked.Seebelowforguidance.3.B.1. GoalsWhataretheoverallgoalsofyourparticularprogram?Pleasenumbereachmajorgoal.Seeexampleingrey.Itisnotnecessarytohavefivegoals,butspaceisprovidedincaseyoudo.1. SAMPLE:Improveacademicachievementinmath1. Increasethenumberofstudentswhoreceiveacademiclearningsupportafterschool.2. Expandtheexistingafterschooloptionstoengagemorestudentsandfamilies.3. Developacomprehensiveafterschoolprogramframeworkthatencouragescollaborationandcontinuity

amongafterschooloptions.4. Increasethenumberofstudentsmeetingstatereading,math,andsciencestandardsateachofthe

participatingschools.

3.B.2. ObjectivesWhatspecificmeasurableobjectivesarebeingusedtoaddressyourprogram’sgoals?Itisnotnecessarytohavefourobjectivespergoal,butspaceisprovidedjustincase.Linkobjectivestothespecificgoalsarticulatedaboveinsection3.B.1.Seeexamplesingreybelow.Enterallthatapply.Goal Objective Measure

1.

SAMPLE:1.150%ormoreofstudentsparticipatingatleast30daysinthe21stCCLCprogramwillimprovetheircoursemarksinmathfromfalltospring.

CourseMarks

SAMPLE:1.2Thegapinmathachievementbetweenlow-incomeandmiddleorhigh-incomestudentswillbereducedbyatleast5percentagepointsasmeasuredbytheSmarterBalancedAssessment.

SmarterBalancedAssessment

1.1.1100%ofcenterswillofferhighqualityservicesinatleastonecoreacademicarea.

DocumentationofServices,ProgramSummary

2.

2.1100%ofcenterswillofferenrichmentandsupportactivitiessuchasnutritionandhealth,art,music,technology,andrecreation.


2.2100%ofthecenterswillofferservicesat10-15hoursperweekonaverage.


3.3.1Complexwillestablishandmaintainpartnershipswithinthecommunitythatcontinuetoincreaselevelsofcommunitycollaborationinplanning,implementing,andsustainingprograms.

ListofPartnerships,DocumentationofPartnerships

4.

4.160%ofCastleComplexregularstudentswillincreasetheirmathandreadingassessmentscoresfromfalltospring.

Pre-andpost-STARori-Readyassessment

4.270%oftheCastleComplexregularstudentswillshowimprovementinacademicperformanceasshowninthe21stCCLCteachersurvey.

21stCenturyCCLCTeacherSurvey


3.C. PARTICIPANTSINVOLVEDINTHEPROGRAM3.C.1. Attendance

Exhibit3:StudentsServedin2017-18(includingsummer)

Center

2017-18Enrollment–

Total

2017-18Enrollment–Regular* GradeLevels

BenjaminParkerElementarySchool 81 67 Grades3-6CastleHighSchool 199 44 Grades9-12HeeiaElementarySchool 137 44 GradesK-6KahaluuElementarySchool 117 58 Grades2-5KapunahalaElementarySchool 370 122 GradesK-6KingIntermediateSchool 263 86 Grades7-8

SubgranteeTotal 1167 421 *Regularattendeesarethosewhohaveattendedtheprogramfor30ormoredays.

AttendanceDiscussionDescribeattendanceateachcenterandatthesubgranteelevel.Doyouhaveanychallengeswithattendance?Howhaveyouencouragedattendance?TheCAFÉProjectservedatotalof1167studentsingradesK-12beginninginJune,2017andendinginMay,2018,ofwhich421wereregularattendees(attended30+days).Thisisanincreaseof321studentsor37.49%inthenumberofallstudentsservedascomparedtothedatareportedforallstudentsinthespringofschoolyear2017-2018.Theregularattendeenumberofstudentsserveddecreasedslightlyby95studentsor18.14%ascomparedtothedatareportedinschoolyear2016-2017.Inanefforttoincreaseregularattendeenumbers,siteshaveofferedadditionalenrichmentprogramsandadjustedsitehours.ProjectDirectorwillcontinuetoworkwitheachsitetodeterminehowtoincreasethenumbersofregularattendees.Decreaseinregularattendeenumberscouldbeattributedtoavarietyoffactors,whichinclude,lackofcommitmenttoattendprogramregularly,otheroutsideextracurricularactivities,andextensionoftheschoolday(studentsattendingprogrambeyonda6hourschoolday).3.C.2 ParticipantCharacteristicsWhatarethecharacteristicsofprogramparticipants–usethefollowingtwotablestoindicateforeachsitethecharacteristicsofprogramparticipantsincluding:• F/RLunch• SpecialNeeds• EnglishLanguageLearners

• Gender• Race/ethnicity

Thetablewillautomaticallycomputetotalsinthefinalrow.


Exhibit4:CharacteristicsofStudentsServed*

Center F/RLunchSpecialNeeds ELL Male Female

BenjaminParkerElementarySchool 50 62% 14 17% 0 0% 32 40% 49 60%

CastleHighSchool 26 13% 29 15% 1 1% 88 44% 111 56%

HeeiaElementarySchool 0 0% 20 15% 4 4% 61 45% 76 55%

KahaluuElementarySchool 0 0% 13 11% 6 5% 60 51% 57 49%

KapunahalaElementarySchool 10 3% 4 1% 0 0% 187 51% 183 49%

KingIntermediateSchool 121 46% 20 8% 1 1% 120 46% 143 54%

SubgranteeTotal 207 100 12 548 619 *Informationisbasedonavailabledata.Schoolprivacylawsmaypreventaccessofinformation.Percentage(%)iscalculatedbasedonthetotalnumberofstudentswhoattendedthesiteduringsummer,fall,andspring

Exhibit5:Race/EthnicityofStudentsServed*Center #

AI/AN%

AI/AN#

Asian%

Asian#

NH/PI%

NH/PI#

Black%

Black#

Latino%

Latino#

White%

White#2+

%2+

#UK

%UK

BenjaminParkerElementarySchool

0 0% 3 4% 22 27% 0 0% 2 2% 4 5% 50 62% 0 0%

CastleHighSchool

0 0% 30 15% 39 20% 2 1% 0 0% 14 7% 92 46% 22 11%

HeeiaElementarySchool

0 0% 17 12% 75 55% 1 1% 0 0% 28 20% 3 2% 13 9%

KahaluuElementarySchool

0 0% 9 8% 96 82% 0 0% 0 0% 12 10% 0 0% 0 0%

KapunahalaElementarySchool

1 0% 47 13% 20 5% 1 0% 2 1% 11 3% 0 0% 288 78%

KingInter.School

0 0% 59 22% 51 19% 0 0% 1 0% 32 12% 107 41% 13 5%

SubgranteeTotal

1 165 303 4 5 101 252 336

Note:AI/ANreferstoAmericanIndian/AlaskaNatives;NH/PIreferstoNativeHawaiian/PacificIslander,2+referstoTwoormoreethnicities;UKreferstounknownordatawasnotavailable.*Informationisbasedonavailabledata.Schoolprivacylawsmaypreventaccessofinformation.

3.D SUMMERANDINTERSESSIONPROGRAMMINGDescribeactivitiesofferedduringsummerandintersession.Eachsiteofferedprogramstoenhancecorecurriculum(literacyandmath).Achieve3000,IXL,andReadingPlusareexamplesofweb-basedprogramsimplementedthathelpstudentsdevelopskillsneededinordertobeproficientreaders.Sitesalsoofferedintegrated,hands-on,mathandlanguageartslessons.EnrichmentactivitiesofferedatsitesincludeSTEMproject-basedlessons,cooking,drama,art,andphysicaleducation.Atthesecondarylevel,highschool,studentsparticipatedintransitionactivitiestohelpgetorientedfromintermediateschooltohighschoolinanefforttobuildrelationshipswithteachersandpeermentors.


Inthetablebelow,provideenrollmentnumbersandgradelevels.Thetablewillautomaticallycomputetotalenrollment.

Exhibit6:StudentsServedDuringSummer

CenterSummerEnrollment

–Total GradeLevelsBenjaminParkerElementarySchool 20 Grades4-6CastleHighSchool 118 Grades9-12HeeiaElementarySchool 27 Grades3-6KahaluuElementarySchool 68 Grades1-6KapunahalaElementarySchool 82 GradesK-5KingIntermediateSchool 41 Grades7-8

SubgranteeTotal 356

3.E. CHARACTERISTICSOFPROGRAMMATERIALSANDRESOURCES3.E.1. ProgramMaterialsWhatprogrammaterialswereused(e.g.,curriculum,onlineprograms,readingmaterials,hands-onmaterials,equipment,tools)?On-LineReading-Achieve3000:Aninternetaccessed,differentiatedreadingfluencyprogramscientificallyproventoincreasereadingfluency,comprehension,vocabulary,andwritingproficiency;showntodramaticallyimpacthigh-stakestestscoresforstudents.On-LineMath–IXL:Amathfluencydevelopmentprogramwherestudentsfindthatmathismorethanjustnumbersandlearningcanbefun.Robotics:StudentslearnedhowtobuildandprogramrobotsusingVEXIQsystems.VEXIQisaprogrammableroboticsplatformdesignedtotransformSTEMlearning.CAFÉleadersusedahands-onapproachtoscience,math,technology,andliteracy.Y4YProject-BasedScience:On-linetoolsaccessibleforschoolprograms.Providesanoverviewofproject-basedlearning,thebenefitsofauthenticprojects,andprovidesawealthofengagingprojectswherestudentsareimmersedintheinquiry-process.3.E.2 ResourcesWhatresources(e.g.,grantfunds,physicalfacilities,in-kindpersonnel,communitypartnerships)wereavailable?Thefollowingresourceswereutilized:

a. Othergrantfunds:Title1b. Physicalfacilitiesandadministrativeplanning/implementationsupportfromCastle

Complex’s6DOESchools:CastleHighSchool,KingIntermediate,He`eiaElementarySchool,Kahalu`uElementarySchool,KapunahalaElementarySchool,andParkerElementarySchool.

c. Communitypartnerships


3.F. STAFFANDOTHERSINVOLVEDINTHEPROGRAMProvideabriefdescriptionofstaffandroles.Completethefollowingtablesastheyapplytoyourprogram.Totalswillbeautomaticallycomputed.

ThestaffincludedaProjectDirector(1),ImplementationManager(1),AccountClerk(1),SiteCoordinators(4),and47classroomleaders,subcontractedstaff,and/orvolunteersduringtheschoolyear.Inthesummer(June-July,2017),thestaffincludedaProjectDirector(1),SiteCoordinators(3),DataManagers(3)and32classroomleaders,subcontractedstaff,and/orvolunteers.

Exhibit7.NumberofStaffbyPosition

Center Adminis-trators

CollegeStudents

CommunityMembers

HighSchoolStudents

Parents SchoolDayTeachers

Non-Teaching

SchoolStaff

Sub-contracted

Staff

Other

Paid Vol Paid Vol Paid Vol Paid Vol Paid Vol Paid Vol Paid Vol Paid Vol Paid Vol


0 0 0 0 0 0 0 0 0 0 7 0 0 1 2 0 4 0

CastleHighSchool 1 0 0 0 0 0 0 0 0 0 6 0 0 0 6 0 0 0


1 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0


1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 1 0


1 0 0 0 0 0 0 0 0 0 7 0 0 0 1 0 1 0

KingIntermediateSchool

0 0 0 0 0 0 0 0 0 0 0 0 0 0 8 0 0 0

SubgranteeTotal 4 0 0 0 0 0 0 0 0 0 28 0 1 1 17 0 6 0


Exhibit8.AverageHoursperWeekbyPositionCenter Adminis-

tratorsCollegeStudents

CommunityMembers

HighSchoolStudents

Parents SchoolDay

Teachers

Non-Teaching

SchoolStaff

Sub-contracted

Staff

Other

BenjaminParkerElementarySchool 10 0 0 0 0 8 4 0 10

CastleHighSchool 10 0 0 0 0 8 0 10 0HeeiaElementarySchool

10 0 0 0 0 10 0 0 10


13 0 0 0 0 8 8 0 0


11 0 0 0 0 6 4 6 4


0 0 0 0 0 0 0 15 0

SubgranteeTotal 54 0 0 0 0 40 16 31 24

3.G. PARTNERSHIPSPartnershipDataEntersubgrantee-levelpartnershipdataintheappropriatefieldsinthetablebelow.

Exhibit9:PartnersPartnerContributions TotalNumberofPartners

ContributionType #PaidPartners

#UnpaidPartners

Provideevaluationservices 0 0

Raisefunds 0 0

Provideprogramming/activityrelatedservices(CHSPartners,GirlScouts,ASAS) 7 1

Providegoods 0 0

Providevolunteerstaffing 0 0

ProvidePaidStaffing(KingASAS,Uplink) 1 1

Other(D.O.E.,PACT) 0 2

SubgranteeTotal 8 4

PartnershipDescriptionProvideabriefdescriptionofsuccesseswithpartnerships.HawaiiInstituteofMarineBiology-StudentsatCastleHighreceivedanintroductiontotheHawaiiInstituteofMarineBiologyresearchandhistory,scientificmethodology,reefmonitoring,UAS/Droneuseincoastalresearchandmonitoring,3-Dimagingofcoralreefsandtheassociatedcomputerdataprocessing.Studentsparticipatedinsmallresearchteamsinordertocompleteproject-basedlearningactivities.


Kako’oiwi-StudentsatCastleHighweretaughtHawaiianculturalpracticesintheformofchantandstoryalongwithbasicfarmknowledgeandpractice.KeyProject-StudentsatCastleHighwereinvolvedinwatershedobservations,cleanup,andrestoration.Studentsalsolearnedaboutthenativeo’opuanobservedo’opuinthestream.PaepaeO’He’eia-StudentsatCastleHighweretaughtculturallyrelevantandacademicallyrigorousstudiesaimedatbridgingtraditionalandcontemporaryknowledgesystems.PapahanaKualoa-StudentsatCastleHighweretaughtamodelofinnovativeeconomicdevelopmentthatisenvironmentallysustainableandculturallyminded.WaikaluaLokoFishpond:StudentsatCastleHighparticipatedinhands-onoutdooractivitiesinenvironmentalscience.Lessonsarefocusedonscientificandecologicallearningexperiences.Provideabriefdescriptionofchallengeswithpartnerships.Partnershipsweredevelopedtoprovideincreasedopportunitiesforstudentsandparents.Theonlychallenge(althoughminimal)wastheextensiveamountoftimetocoordinateserviceswithoutsideagencies.Projectdirectorattendedmultiplemeetingstoensurethateachpartnershipwasasuccess.3.H. PARENT/FAMILYINVOLVEMENTProvideabriefdescriptionofyourprogram’sparent/familyinvolvementcomponent,includingcommunicationsandoutreachtoparentsandfamilies,familyprogrammingandevents,challengesandsuccesses.Toensurethatallsitesengagedinsustained,plannedfamilyactivities,thesitecoordinatorsateachsiteworkedcloselywithadministrators,teachers,andotherpartnerships(i.e.TitleOne)todevelopaseriesoffamilyactivities.AnexampleoftheseactivitiesincludedSTEMfamilynightsandrobotics.Thefamilyactivitiesweredocumentedandpresentedtotheimplementationmanagerandprojectdirectoratthebeginningoftheyear.Eachsitekeptacommunityoutreachlogintheirsitebindertodocumentandrecordparentphonecallsandupdatesonstudents.Inaddition,theclassroomleaders/sitecoordinatorssentoutquarterlyprogressreportstoparentstoupdatethemonstudentprogressandchallenges.Thisensuredthatparentswerefullyawareoftheirchild’sparticipationintheprogram.


4. Evaluation4.A. EVALUATIONPLAN4.A.1. EvaluationDesignOverviewProvideaone-paragraphbriefoverviewoftheevaluationdesign.EvaluationwasconductedtoassesstheimplementationandtheimpactoftheCAFÉprogramsonstudentachievementatthesixCastleComplex21stCCLCschool-basedcenters.Programimpactwasmeasuredbytheincreaseinstudentsimprovinginmathandreadinggrades,mathandreadingachievement,andlearningbehaviors,falltospring.Programimpactonstudentachievementwasmeasuredbythemathandreadingpre-postassessmentscoresfromfalltospring.Pre-postreadingassessmentwasconductedusingtheSTARAssessmentori-Ready.Pre-postmathassessmentwasconductedusingSTARAssessmentori-Ready.The21stCCLCTeacherSurveywasusedatallcenterstomeasureimprovementinstudentlearningbehaviorwhichincludedturninginhomework,improvementinclassparticipation,improvementinbehavior,andimprovementinacademicperformance. 4.A.2. ImplementationEvaluationDescribehowprogramimplementationisbeingdocumented.

SampleImplementationQuestions:§ Hastheprogrambeenimplementedasplannedinthegrantapplication?Ifno,whatchangesweremade,

andwhy?§ Whatchallengeshavebeenfacedinimplementingtheprogram,andhowarethosechallengesbeing

addressed?§ Whichcommunity-basedpartnerships,asplannedinthegrantapplication,havebeenestablishedand

maintained,andwhichoneswerenot?Why?§ Areprogramactivitiesinterestingandvaluabletostudents,teachers,administrators,andcommunity

partners?§ Whataretheplanstoensureeffectiveprogramimplementationnextyear?

Whatimplementationquestionsarebeinganswered?

1. Hastheprogrambeenimplementedasplannedinthegrant

application?2. Whatchallengeshavebeenfacedinimplementingtheprogram

andhowarethesechallengesbeingaddressed?3. Whichcommunity-basedpartnershipsasplannedinthegrant

applicationhavebeenestablishedandmaintained?4. Areprogramactivitiesinterestingandvaluabletostudents,

teachers,administratorsandcommunitypartners?5. Whataretheplanstoensureeffectiveprogramimplementation

nextyear?


Whatdatacollectionmethodsarebeingused(e.g.interviews,observations)?

SiteCoordinatorsconductedon-goingobservations;Leadersconductedtheclassesandadministeredtheassessments;SiteCoordinatorscollectedthesitedata;andtheDataManagergathered,organized,formatted/inputted,documented,andreportedthedata.

Whatisthetimingofdatacollection?

Achievementobjectivesweremeasuredpre(beginningoftheschoolyear)andpost(attheendoftheschoolyear).On-goingdata(weeklyreportsandclassroomobservations)wascollectedduringtheschoolyeartoimproveinstructionandprovidefeedbackontheprogramsateachsite.

Inaddition,thefollowingcomponentswereutilizedtoensuredatacollectionandfeedbackforevaluation:1.ParentSurveyandStudentSurveyresponsetotheCAFÉProgramwereadministeredattheendoftheschoolyear.2.CAFÉProgramoperationswithregardstoAPRObjectivesweredocumentedduringtheschoolyearandassessedattheendoftheCAFÉProgramyear.4.A.3. OutcomesEvaluationDescribehowprogramoutcomesarebeingevaluated.SampleOutcomesQuestions:• Towhatextentdostudentswhoparticipateintheprogramshowimprovementsinbehavior?• Towhatextentdostudentswhoparticipateintheprogramsshowacademicgains?• Towhatextenthastheprogramachieveditsobjectives?• Whatfactorshaveaffectedprogramsuccess?

Whatoutcomesquestionsarebeinganswered?

1. Towhatextentdostudentswhoparticipateintheprogramshowimprovementsinbehavior?

2. Towhatextentdostudentswhoparticipateintheprogramsshowacademicgains?

3. Whatfactorshaveaffectedprogramsuccess?Foreachoutcome,whatmeasuresanddatacollectionmethodsarebeingused(e.g.attendance,grades,behaviorincidents)?

STAR(readingandmath)standardizedassessmentori-Readystandardizedassessment.The21stCCLCTeacherSurveyofstudentimprovementinhomeworkcompletion,classparticipation,behavior,andacademicperformance.

Whatisthetimingofdatacollection?

Pre-assessmentdatawascollectedatthebeginningandpost-assessmentwascollectedattheendoftheschoolyear.Teachersurveywasadministeredattheendoftheyear.


Inaddition,thefollowingcomponentswereutilizedtoensuredatacollectionandfeedbackforevaluation:1.CaféProgressReportsweresenthometwiceayeartoprovidecommunicationwithschooldayteachersandprogramteachersontheperformanceofthestudents.2.Programmonitoringobservationsweredonemonthlytoensurethatprogramtargetedacademicgains.4.B. EVALUATIONRESULTS4.B.1. ImplementationEvaluationResultsDescribetheresultsoftheimplementationevaluation,addressingtheimplementationquestionsdescribedinyourresponsetoSection4.A.2above.

1. Hastheprogrambeenimplementedasplannedinthegrantapplication?

TheCAFÉprogram21stCCLCProjectwasimplementedasplannedinthegrantapplicationandprovidedaqualityacademicenrichmentprogramfocusedonacceleratingacademicachievementoftargetedstudentsinmathandreading.Asplanned,on-linereadingandmathprograms(Achieve3000andIXL)wereimplemented,providingscientifically-baseddifferentiatedinstructionalprogramstosupportandenhancethestandards-basedcurriculumoftheafterschoolprogramandensureacademicaccelerationintheareasofreadingandmath.Inaddition,Roboticsandotherenrichmentprogramswereaddedtoenhancestudentlearningandengagestudentsinareasofstudentinterest.Achieve3000assessmentandtheIXLon-linemathprogramassessmentwereimplementedtoprovideaclearerpictureofthestudents’skilldevelopmentgains,enablingstudents,teachers,andparentstomonitorandevaluatestudentlearningprogress.

Inanefforttomeasurestudentlearningconsistentlyandhaveavalidmeansofmeasuringstudentachievement,CAFÉimplementedastandardizedassessmentacrossallCAFÉsites.ThiswasusedinmeasuringmathandreadingachievementtodeterminelearningachievementgainsaswellasdeterminestheimpactoftheCAFÉprogramonlearningprogressandachievement.

2. Whatchallengeshavebeenfacedinimplementingtheprogramandhowarethese

challengesbeingaddressed?a.Accessingstudentprofiledatawasachallengeduetostudentprivacylaws.CAFÉcontinuestomeetwithschooladministratorstodiscuss21stCCLCdatarequirementsandplanwaysCAFÉcanaccessstudentidentificationinformation.TheimplementationofiResultsinthe2018-2019schoolyearshouldassistinensuringpristine,accuratedataisobtained.


b.Ensuringthatstudentsatthesubgranteesitesobtainaminimumof30ormoredaysintheprogram.CAFÉwillcontinuetoworkwithprincipalsandteacherstomaximizeattendanceforallstudents.Sitesmaychoosetoopenorofferservicesearlierinordertoprovidemoreopportunitiesforstudentstoattend30ormoreinstructionaldays.

3. Whichcommunity-basedpartnershipsasplannedinthegrantapplicationhavebeenestablishedandmaintained?WindwardCommunityCollege:Courseswereofferedtohighschoolstudentsinordertoobtaincollegecredits.

Parents&ChildrenTogether–KaneoheCommunityFamilyCenter(PACT–KCFC):Programming/activity-relatedservices;materials;volunteerstaffingandpaidstaffing.ParentsandChildrenTogetherprovidedhigh-qualityparentandchildcommunityprograms.CAFEwillcontinuetoassistPACT–KCFCwiththeirfamilyengagementeventsand5Rsprograms.

GirlScoutsofHawaii:Inpartnershipwithidentifiedelementaryschools,studentsengagedinCommonCoreStateStandardactivitiesandprogramstoexposegirlstoGirlScoutleadershipexperiencesonkeyleadershipfactors.

Title1:PartnershipwiththeTitle1coordinatortopresenteventsandfamilyengagementeventstofocusonpromotingadultliteracy.PacificAmericanFoundation:InpartnershipwithCastleRedesignProject,thePacificAmericanFoundationcontinuedtosupportCastleHighSchoolStudentsintheHo’ouluOpioprogram.DepartmentofEducation:PartnershipwithDepartmentofEducationSchoolstousefacilitiesandDepartmentofEducationSchoolFoodServicesprovidedsnackstostudents.`ŌleloCommunityMedia–WindwardCommunityMediaCenter:Olelowasabletoprovidemediaandtechnologysupportstostudentsinthe21stCenturyGrantPrograms.

4. Areprogramactivitiesinterestingandvaluabletostudents,teachers,administratorsandcommunitypartners?TheCAFÉProjectcombined1)academicinstructionandassistancewhichincreasedmathandreadingachievement,2)engagingenrichmentactivitiesthatsupportedpositivelearningbehaviorandlearningachievement,and3)familylearningactivitiesthatfosteredparentunderstandingoftheCAFÉprogramandcurriculumtosupporttheirchild’slearning.TheprojectdirectorincreasedtheCAFÉprogramwithnewprogramsaddedtoeachsite:robotics,coding,andothersenhancedtheprograms.


ParentsrespondedfavorablytotheCAFÉProgram;97%ofparentsfelttheCAFÉprogramhelpedtheirchilddobetterinschool.StudentsrespondedfavorablytotheCAFÉProgram;88%ofstudentsfelttheCAFÉprogramhelpedthemdobetterinschool.

5. Whataretheplanstoensureeffectiveprogramimplementationnextyear?ImplementationplansincludingplanningmeetingsandcoordinationwithCastleComplex21stCCLCprojectsiteprincipalsareinplaceandstepshavebeentakentoensurethatCAFÉprogramsarestartedatthebeginningoftheschoolyearandplansensurethatstudentsintheprogramattend30+days.Asystemforstafftraining,staffsupport,andstaffandprogramsupervisionisinplace.Thesystemincludeson-sitecoachingtoprovidecurriculum/instructionalguidanceandfeedbacksupporttoincreaseeffectivenessofinstructionalongwithsitecoordinatorobservationsusinganobservationinstrument.TheCAFÉprogramhasalsoprovidedtrainingopportunitiesincodingwhichwillcontinuetobeimplementedinthe2018-2019schoolyear.CAFÉwillcontinuetodevelopandmaintainasustainabilityplanandworktowardsprogramsustainabilityoverthegrantperiod.

4.B.2 KeyPerformanceIndicators(KPIs)–Objective1Objective1:Participantswilldemonstrateeducationalandsocialbenefitsandexhibitpositivebehavioralchanges.Exhibit10:PerformanceonKPIObjective1–TurninginHomeworkandClassroomParticipationObjective1.2:PercentageofREGULARprogramparticipantswithteacher-reportedimprovementsinturninginhomeworkandparticipatinginclass.

Center

PercentageofREGULARprogramparticipantswithteacher-reportedimprovementinturninginhomeworkandclassroomparticipation(INSERTONLYONEPERCENTAGEFOREACHCENTER)

BenjaminParkerElementarySchool 91%

CastleHighSchool 88%

HeeiaElementarySchool 68%

KahaluuElementarySchool 90%

KapunahalaElementarySchool 96%

KingIntermediateSchool 89%


Exhibit11:PerformanceonKPIObjective1–StudentClassroomBehaviorObjective1.2:PercentageofREGULARprogramparticipantswithteacher-reportedimprovementinstudentclassroombehavior.

CenterPercentageofREGULARprogramparticipantswithteacher-reportedimprovementinteacher-reportedstudentclassroombehavior

BenjaminParkerElementarySchool 96%

CastleHighSchool 88%

HeeiaElementarySchool 72%

KahaluuElementarySchool 96%

KapunahalaElementarySchool 97%

KingIntermediateSchool 89%

KPIObjective1DiscussionPleasedescribeparticularsuccessesrelatedtoObjective1.Whatdata/evidencearethesesuccessandchallengesbasedon?Basedonthetotalamountofteachersurveysreceived,thefollowingresultswereprovidedforthecomplex.Turninginhisorherhomeworkintotheteacher’ssatisfaction:26.2%showedsignificantimprovement,32.35%showedmoderateimprovement,30.48%showedslightimprovementand10.96%showednoimprovement.IImprovementinclassparticipation:28.34%showedsignificantimprovement,40.91%showedmoderateimprovement,24.6%showedslightimprovementand6.15%showednoimprovement.Challengeswerenotedfor“noimprovement”inhighschoolduetostudents’failingordroppingoutoftheprogram.Evidenceofsuccesseswasnotedintheresultsoftheteachersurvey,thecomplexshowedanoverwhelmingamountofimprovement.PleasedescribeparticularchallengesrelatedtoObjective1.Whatdata/evidencearethesesuccessandchallengesbasedon?Basedonthetotalamountofteachersurveys,thefollowingresultswereprovided:Improvementinbehavior:25.4%showedsignificantimprovement,31.02%showedmoderateimprovement,33.16%showedslightimprovementand10.43%showednoimprovement.Improvementinacademicperformance:25.67%showedsignificantimprovement,39.84%showedmoderateimprovement,28.61%showedslightimprovementand5.88%showednoimprovement.Teachersnotedthatstudentsoverallimprovedormaintainedappropriateschoolbehaviorasnotedintheresultsoftheteachersurvey.Challengeswerenotedwhenstudentsdidnotcomplywithappropriateschoolbehaviors(i.e.comingtoschoolontime)whichwasnotassociatedwithgrantimplementationandonlyaffectedasmallgroupofstudents.


4.B.3 KeyPerformanceIndicators–Objective2Objective2:21stCenturyCommunityLearningCenterswillofferarangeofhigh-qualityeducational,developmental,andrecreationalservices.

Exhibit12:PerformanceonKPIObjective2–CoreEducationalServicesObjective2.1:Centerswillofferhigh-qualityservicesinatleastonecoreacademicarea,suchasreadingandliteracy,mathematics,orscience.(ClickYesorNoforeachacademicarea)

CenterReading&Literacy Math

Science&Technology Other(specify)

BenjaminParkerElementarySchool Y Y Y

CastleHighSchool Y Y Y

HeeiaElementarySchool Y Y Y KahaluuElementarySchool Y Y Y

KapunahalaElementarySchool Y Y Y


Y Y Y

CoreEducationalServicesDiscussionProvideabriefdescriptionofevidencethattheseservicesareofhighquality.

TechnologyBasedMathandReadingProgram,IXL,isanevidence-basedprogramthatcraftshigh-qualitycontentacross6,000skills.Theefficacystudiesin12statesshowedthatschoolsusingIXLoutperformedotherschoolprograms.TechnologyBasedReadingProgram,Achieve3000,isanevidence-basedprogramthathasprovenresults.Researchfromtheprogramlookedattheachievementof1,221,690studentsin6,153schools.ResultsshowedthatstudentsusingAchieve3000tripledtheirexpectedreadinggainswithregularprogramuse.

Exhibit13:PerformanceonKPIObjective2–EnrichmentActivitiesObjective2.2:Centerswillofferenrichmentandsupportactivitiessuchasacademicassistance,remediationandenrichment,nutritionandhealth,art,music,technology,andrecreation.(ClickYesorNoforeachenrichmentarea.)Center Arts&

MusicPhysicalActivity

CommunityService

Leadership Tutoring/Homework

Help

Other(Specify)


Y Y N N Y

CastleHighSchool Y Y N Y Y

HeeiaElementarySchool Y Y N Y Y KahaluuElementarySchool

N N N N Y


N Y Y N Y

KingIntermediateSchool Y Y Y Y Y


Exhibit14:PerformanceonKPIObjective2-ServicestoParentsandFamilyMembersObjective2.3:Centerswillofferservicestoparentsandotherfamilymembersofstudentsenrolledintheprogram.Center Numberof

parents/family

membersparticipating

Descriptionofservicestoparentsandotherfamilymembers.


79

ThefocusofBenjaminParkerElementarySchool’sfamilyactivitiesweretoinvolvefamiliesonhowtoassisttheirchildreninmeetingScienceandMathcommoncorestatestandards.Targetedactivitieshelpedparentsdevelopawarenessonthestandardsandinformationwasprovidedonhoweachparentcouldsupporttheirchildathome.

CastleHighSchool

111

Familieswereactivelyinvolvedintheshowcasingofstudentachievementatthehighschoollevel.CastleHighconductedtwofamilyinvolvementactivities,NaKanakaO’KoolaupokoandaHo’ikeShowcase.Theseactivitieswerespecificallygearedtowardencouragingfamiliestolearnabouttheirstudentsandcelebrateaccomplishments.


61

HeeiaElementaryhadaseriesofsustainedfamilyinvolvementactivitiesthatprovidedfamilieswithactivitiesthatdirectlycorrelatedwiththecurriculumintheschoolday.Activitiesincludedartprojects,scienceexperiments,anddevelopingsimplerobotics.


22

FamiliesparticipatedinSTEM(Science,Technology,Engineering,andMath)activities.Thefamiliesandstudentswereabletoexperiencehands-onactivities,whichweredirectlylinkedtothecommoncorestatestandards.


63

Familypartnershipstargetedparentalinvolvementinrobotics,healthawareness,andnutrition.Roboticsactivitiesweregearedatinvolvingfamiliesinthedevelopmentanduseoftechnology.FamiliesalsoparticipatedinactivitiesfortheBlueZonesproject(acommunity-widewell-beingimprovementinitiativetohelpmakehealthychoicesinthecommunity)andparticipatedinactivitiesthatencouragedhealthylivingbyusingsustainableingredientsfromthegardenoncampus.


66

Eachquarter,inpartnershipwithKingAfterschoolAllStars,familyinvolvementnightswereplannedandimplemented.Activitiesrangedfromcelebrationsofstudentactivitiestofamilymovienights.


Parent/FamilyServicesDiscussionProvideabriefdescriptionofsuccessesinprovidingservicestoparentsandotherfamilymembers.AllCastleComplex21stCenturyProgramSitesofferedbothenrichingandengagingfamilyactivities.Forsitesthatcollectedevaluationsorsurveys,responseswerefavorableandfamiliesexpressedappreciationforbeingprovidedlearningopportunitiesasafamily.Specificcommentsfromfamiliesincluded,“Buildingandlearningthingswereawesome.Handoutsweregoodtounderstandtheimportanceofscienceforthefuture,”“Itexplainswhatmychildshouldknowateachlevel,”“Ageappropriate,thought-provoking,stimulating,andfun,”and“TeachesmethingsIdidn’tknow”.Qualitativedataobtainedfromtheseresponsesareindicativeofsuccessesinprovidingservicestoparentsandotherfamilymembers.Provideabriefdescriptionofchallengesinprovidingservicestoparentsandotherfamilymembers.Althoughallsiteswererequiredtopresentopportunitiesforfamilyinvolvementandparticipation,thenumberoffamilieswhoattendedtheactivitieswasstillconsideredlow.Siteswillcontinuetorecruitparentstoattendandparticipateinfamilyactivitiesintheupcomingyear.

Exhibit15:PerformanceonKPIObjective2–HoursperWeekObjective2.4:Centerswillofferservicesfor12hoursormoreperweek,andprovideserviceswhenschoolisnotinsession,suchasduringthesummerandholidays.

Center

Numberofhoursperweekservicesofferedduringthe

schoolyear

Numberofhoursperweekservicesofferedduringsummerandholidays

BenjaminParkerElementarySchool 10 20

CastleHighSchool 10 20

HeeiaElementarySchool 10 20

KahaluuElementarySchool 13 20

KapunahalaElementarySchool 11 15

KingIntermediateSchool 15 20

[KeyPerformanceIndicators(KPIs)–Objective3Objective3-21stCenturyCommunityLearningCenterswillservechildrenandcommunitymemberswiththegreatestneedforexpandedlearningopportunities.(Notincludedhere-CommunitiesarealreadydescribedinSection3.Aabove.)]


4.B.4 KeyPerformanceIndicators(KPIs)–Objective4Objective4:Regularparticipantsin21stCenturyCommunityLearningCenterswilldemonstrateacademicimprovementbasedonformativeandsummativeassessmentsgiventhroughouttheschoolyear.

Exhibit16:PerformanceonKPIObjective4–AcademicImprovementinReading/LanguageArts

Objective4.1:Participantsin21stCenturyCommunityLearningCenterswilldemonstrateacademicimprovementinreading/languagearts.Center Percentageofregularprogram

participantswithIMPROVEMENTinreading/languageartsfromfalltospring

PrimarySourceofDataonImprovement:Grades/

Coursemarks?Assessment/TestScores?

TeacherSurveys


78%☐ ý ☐

CastleHighSchool 38% ☐ ý ☐ HeeiaElementarySchool

89%☐ ý ☐


100%☐ ý ☐


95%☐ ý ☐


71%☐ ý ☐

Exhibit17:PerformanceonKPIObjective4–AcademicImprovementinMath

Objective4.2:Participantsin21stCenturyCommunityLearningCenterswilldemonstrateacademicimprovementinmath.Center Percentageofregularprogram

participantswithIMPROVEMENTinmathfromfalltospring

SourceofDataonImprovement:Grades/

Coursemarks?Assessment/TestScores?

TeacherSurveys


97%☐ ý ☐

CastleHighSchool 28% ☐ ý ☐ HeeiaElementarySchool

84%☐ ý ☐


100%☐ ý ☐


98%☐ ý ☐


43%☐ ý ☐


KPIObjective4DiscussionPleasedescribeparticularsuccessesorchallengesrelatedtoKPIObjective4.Inanefforttomeasurestudentlearningconsistentlyandhaveavalidmeansofmeasuringstudentachievement,CAFÉimplementedastandardizedassessmentacrossallCAFÉsites.Fiveoutofthesixsitesusedthesameassessment(STAR)withonesiteusinganothervalidatedassessment(iReady).Theseassessmentswereusedinmeasuringmathandreadingachievementandtodeterminelearningachievementgains,aswellasdeterminetheimpactoftheCAFÉprogramonlearningprogressandachievement.Atthehighschoollevel,itappearedtobemoredifficultforteacherstoobtainstandardizedreadingandmathassessmentresults,thusresultinginalowersamplesize.ProjectDirectorwillcontinuetoworkwiththehighschoolsitecoordinatorandstafftohelprefineprocedures.4.B.5 AchievementofProgram-SpecificObjectivesPleasedescribeachievementoftheprogram-specificobjectivesdescribedearlierinSection3.B.2.1. Objective-Statethespecificmeasurableobjective2. Measure–statethetypeofdatacollectedtomeasurethisobjective3. Results-Summarizeevaluationfindingsrelatedtothisobjective4. Met/Notmet–foreachobjectivespecifyoneofthefollowing:• Met• Notmet• Progress

• Noprogress• Unabletomeasure

Copyobjectivesandmeasuresfromthetableinsection3.B.2intoExhibit19below.Makesuretoselectthewholetextboxbyclickingonthethreeverticaldotstotheupperleftofthebox.Completetheexhibitwithresultsandthestatustowardmeetingtheobjective.Sampleingrey.

Exhibit18:ProgressonProgram-SpecificObjectivesObjective Measure Results Met/NotMet

1.2Reducethegapinmathachievement(percentageofstudentsmeetinggradelevelstandard)betweenlow-incomevs.middleorhighincomestudentswillbereducedbyatleast5percentagepoints.

SmarterBalancedAssessment Thegapbetweenpercentageoflow-incomevs.middleorhighincomestudentsmeetingstandardin2017-18was9%comparedto15%in2016-17

Met

1.1100%ofcenterswillofferhighqualityservicesinatleastonecoreacademicarea.

DocumentationofServices,ProgramSummary-Initialprincipal,SiteCoordinator,ImplementationManager,ProjectDirector,LeadershipTeammeetingbeforeCAFEProjectbeginsyearlyateachsite.

100%ofcentersofferedhighqualityservicesinatleastonecoreacademicarea.

Met


2.1100%ofcenterswillofferenrichmentandsupportactivitiessuchasnutritionandhealth,art,music,technology,andrecreation.


100%ofcentersofferedenrichmentandsupportactivitiessuchasnutritionandhealth,art,music,technology,andrecreation.

Met

2.2100%ofthecenterswillofferservicesat10-15hoursperweekonaverage.

Assessment:Documentationofhoursofservices-SiteCoordinator(SC)tosubmitevidence-ImplementationManagerobservedandrecordeddata-WeeklySCsummariesdocumentedhoursofservicesoffered

100%ofthecentersofferedservicesat10-15hoursperweekonaverage.

Met

3.1Complexwillestablishandmaintainpartnershipswithinthecommunitythatcontinuetoincreaselevelsofcommunitycollaborationinplanning,implementing,andsustainingprograms.

ListofPartnerships,DocumentationofPartnerships

Complexhasestablishedandmaintainedpartnershipswithinthecommunitythatcontinuetoincreaselevelsofcommunitycollaborationinplanning,implementing,andsustainingprograms.

Met

4.160%ofCastleComplexregularstudentswillincreasetheirmathandreadingassessmentscoresfromfalltospring.

ReadingAssessmentInstrument:STARpre-andpost-assessmentwillbeadministeredwithcontinuousprogressmonitoring

MathAssessmentInstrument:STARpre-andpost-assessmentwillbeadministeredwithcontinuousprogressmonitoring

83%ofCastleComplexregularstudentsincreasedtheirreadingassessmentscoresfromfalltospring.88%ofCastleComplexregularstudentsincreasedtheirmathassessmentscoresfromfalltospring.*Dataisbasedonstudentswhowereadministeredareadingandmathassessment

Met

4.270%oftheCastleComplexregularstudentswillshowimprovementinacademicperformanceasshowninthe21stCCLCteachersurvey.

21stCenturyCCLCTeacherSurvey

94%oftheCastleComplexregularstudentsshowedimprovementinacademicperformanceasshowninthe21stCCLCteachersurvey.

Met


AchievementofProgram-SpecificObjectivesDiscussionDescribewhetherobjectiveshavechangedsincelastyearandparticularsuccessandchallengesinmeetingprogram-specificobjectives.Achievementandprogram-specificobjectivesremainedthesameduringthe2017-18schoolyear,ascomparedtothepreviousschoolyear.Thespecificactivitiesimplementedwereexpandedtoincludemultipleenrichmentopportunities(Objective2.1)andtrainingforteachers.Duringthe2017-18schoolyear,staffreceivedtrainingfromanexperiencedcomputersciencefacilitator.Theworkshopprovidedanintroductiontocomputerscience,pedagogy,overviewoftheonlinecurriculum,teacherdashboard,andstrategiesforteaching“unplugged”classroomactivities.Inaddition,staffreceivedin-serviceandweb-basedtrainingonincorporatingOzobotsasanenrichmentactivityforstudents.Ozobotsaresmallrobotsthathelpstudentslearnsimplecodelanguageanddeductivereasoningbycreatingpathwaysthatcontrolmovementsandspeedindifferentdirections.4.C. ADDITIONALDATA4.C.1 SuccessStoriesThisyeartheCastleComplex21stCenturyGrantutilizedAltinoCodingattwosites.KapunahalaElementaryandCastleHighSchoolbothhadopportunitiestodevelopandrefineskillsinAltinoCoding.Altinoisarevolutionarycodingplatform,whichisaimedtobringeducationreformtoallK-12schoolsinHawai’i.Altinocomprisesofamultitudeofsystemlanguages(suchas:Android,Arduino,andC++),whichcanbeeffectivelyutilizedinlessonplanstomakecode-learninginteractive,inspiring,andfun.AspartoftheinitiativetointroduceScience,Technology,andEngineeringintotheschools,CastleComplexmetthatinitiativeandstudentsinboththeelementaryschoolandhighschoolhadopportunitiestoshowcasetheseskills.Inaddition,thehighschoolstudentspresentedanAltinoCodingdemonstrationata5RCommunityEvent.4.C.2 BestPracticesCastleComplex21stCenturyGrantimplementedthefollowingbestpracticesatthesites:Positivereinforcementandencouragement:Thispracticewasreadilyseenanddocumentedinprojectsiteobservationreports.Theuseofthistypeofreinforcementwaskeyininstillingself-confidenceandself-worthinthestudents.Allowingstudentstoprogressattheirownrate:Thispracticeprovidedstudentswithopportunitiestocompleteindividualassignmentsattheirownlevel.AnexampleofthistypeofprogrammingwasseeninIXLandKidBizprogramswhereeachassignmentisindividualizedtothestudent.


Project-BasedLearning:Thispracticeprovidedstudentswithanopportunitytolearnandapplyknowledgethroughengagingexperiencesthatallowedfordeeperlearninginskillstiedtocollegeandcareerreadiness. 4.C.3 Student,Teacher,Parent,StafforCommunityInput–[ifyouusedsurvey(s)please

includeinstrumentasanattachmentandincluderesultsinthenarrative.]Eachsiteadministeredateacherandparentsurveyasanevaluationinstrumenttodetermineprogrameffectivenessandimpactonstudentachievement.Theresultsofthesurveyindicatedthattheprogramswereanoverwhelmingsuccess.ParentsreportedthattheirchildlookedforwardtocomingtotheCAFÉprogram(97%),theCAFÉprogramhelpedtheirchildbecomeabetterreader(97%),theCAFÉprogramhelpedtheirchildbecomeabettermathstudent(97%),theCAFÉprogramhelpedtheirchilddobetterinschool(97%),theCAFÉteacherscaredaboutthestudents(100%)andtheywouldenrolltheirchildintheCAFÉprogramagain(100%).StudentsrespondedfavorablytotheCAFÉProgram;theylookforwardtocomingtotheprogram(98%).StudentsfelttheCAFEprogramhelpedthembecomeabetterreader(76%)andbetterinmath(60%).TheyalsofelttheCAFÉprogramhelpedthemdobetterinschool(88%).StudentsfelttheCAFÉteacherscaredaboutthem(100%)andtheywouldwanttocometotheCAFÉprogramagain(85%).


4.C.4 PicturesFeelfreetoshareanypicturesyoumighthavethatshowyour21stCenturyCommunityLearningCentersinprogress.


5. SustainabilityPlan5.A ORIGINALSUSTAINABILITYPLANDescribetheoriginalsustainabilityplanasindicatedinthegrantapplication.Ifsuccessisactualizedinexemplaryprograms,thentheseprogramsshouldbereplicatedandsustainedtoensuretheacceleratedlearningofallstudents,longafterthefundingexpires.Tothisend,theCAFÉProjectwillmakecontinuouseffortstosustainextendinglearningopportunitiesforstudents.Principalswillmeetyearlytodiscussandstrategizeeffortstosustainextendedlearningopportunitieswithbestpracticesandprograms.5.B UPDATEDSUSTAINABILITYPLANDescribehowprogramminglevelswillbesustainedafterthegrantends,including:• Whatchangesweremadefromtheoriginalsustainabilityplan?• Whatcommunitypartnershavebeenadded?• Whatcommunitypartnershavedroppedoff?• Describeanyadditionalfundingsources.Theprojectdirector,principals,andpartnershipsarecurrentlyworkingonrefiningthesustainabilityplaninordertoensurecontinuedsuccess.Inordertoensurethatasustainabilityplanisdiscussedwitheachprincipal,awrittendocumentationplanisrecordedatthebeginningoftheschoolyear.Thecurrentcommunitypartnersaslistedinthegrantapplicationhaveremainedconsistent.Currentlytherearenoadditionalfundingsourcesattheelementaryschoollevel.AttheIntermediatelevel,out-of-schooltimeprogramfundingisbeingconsidered,forexample,UplinkandR.E.A.C.H.Eachsitewilllookattheiracademicandfinancialplanstoprioritizefundingforafterschoolsupports.Oncebudgetsaredefined,theindividualsiteswillbeabletoallocatefundingbasedonneed.


6. ConclusionsandRecommendations6.A CONCLUSIONS

1. TheCAFÉProjectsuccessfullydeliveredaneffectivecomprehensiveprogramof

academicinstruction,engagingproject-basedenrichmentactivitiesandmeaningfulfamilylearningactivitiesdesignedtosupportthelearningofthestudents.

2. TheCAFÉProjectsuccessfullyfosteredpositivelearningbehaviorsandlearningachievement,collegeandcareerreadinessskills,andtransitionactivities.TheCAFÉProjectservedatotalof1167studentsingradesK-12,ofwhich421werereportablestudents(attended30+days).CAFÉserved356studentsduringthesummerintercession(June1,2016–July15,2017),whichisanincreaseof64studentsor21.92%ascomparedtotheprevioussummer.Allsitesofferedacademicandenrichmentsummerprogramsascomparedtothepreviousyearinwhichonly4sitesofferedsummerprograms.

3. CAFÉwasabletocontinuetoimplementstandardizedpre-posttestingtomeasure

learninggainsandestablishvalidityandreliabilityinmathandreadingassessmentacrossallCAFÉsites.

4. TheProjectDirector,ImplementationManager,andAccountClerkhaveremained

withtheCAFÉprogramforthepast12years.Thishelpedtoensureconsistencyinoperationsandprovidedasmoothtransitionfromyeartoyear.Thereisalsoalowturnoverinreturningstaff(sitecoordinatorsandclassroomleaders),thishelpedtoensurethatpoliciesandproceduresimplementedthroughouttheyear.

5. Ninetypercentoftheclassroomleadersarealsofull-timeclassroomteachers;

therefore,therearehighqualityclassroomengagementactivitiesandlessonsimplementeddailyaswellasexcellentbehaviormanagementsystemsinplaceforoptimalstudentlearning.

6. ProgramdatashowedtheCAFÉprogramfosteredpositivelearningbehavior,learning

achievement,andbothparentsandstudentsrespondedpositivelytotheprogram.

7. Thesitebindersforeachsiteprovidedthevehiclefordocumentationofprojectactivitiesandparticipants.


6.B RECOMMENDATIONSFORPROGRAMIMPROVEMENT

1. ContinuetoworkwithCastleComplexCAFÉsiteschools/principalstodocumentCAFÉstudentswiththegreatestneedforexpandedlearningopportunities.CAFÉprojectdirectorshouldcontinuetomeetwithprincipalstoidentifytargetedstudents,thosescoringbelowbenchmark.

2. Developaseriesofplanned,intentionalworkshopstobeofferedasacomplextoassistwithparentandcommunityeducationandtrainings.Developknowledgeorskill(s)tobuildcapacityofparentsto1)superviseandsupporttheirchild’slearningathomeand2)encouragepositivelearningbehaviorsbothathomeandatschool.Considerlearningopportunitiesforfurtheringeducationordevelopingcareerskills.

3. TheCAFÉprogramshouldcontinuetodevelopandmaintainasustainabilityplanthat

workstowardsprogramsustainabilityafterthegrantsubsides.

6.C EVALUATIONDISSEMINATION

1. Resultswillbepostedonthe21stCCLCCAFÉProjectwebsite:castlecomplexcafe.com.

2. CopyoftheevaluationresultsisexplainedandprovidedtotheSiteCoordinatorsandbinderdistributed.SiteCoordinatorsandprojectdirectorssharedatawiththePrincipals.Parentswillbeprovidedwithabriefsummaryoftheevaluationresults.

3. Parentswillreceivetheevaluationformsinaflyerformthatwillhighlightboththestrengthsandrecommendationsoftheprogram.

castle complex 21st cclc evaluation report final – sy2017 · implementation of evaluation results...

Documents