dan curtis pa706 5/11/2011. research question history of topic literature review research method...

18
THE IMPACT OF YEAR-ROUND EDUCATION ON TEST SCORES Dan Curtis PA706 5/11/2011

Upload: mia-fitt

Post on 28-Mar-2015

215 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

THE IMPACT OF YEAR-ROUND EDUCATION ON TEST SCORES

Dan CurtisPA7065/11/2011

Page 2: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

OUTLINE

Research question History of topic Literature review Research method Findings Conclusions Bibliography

Page 3: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

RESEARCH QUESTION

Does year-round education (YRE) affect student test scores?

Page 4: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

HISTORY OF TOPIC Early American public schools were founded on an agrarian

calendar which gave a 2-3 month summer break to allow for children to help their family with the harvest (Traditional)

With the shift of American culture away from an agrarian society, the need for a long summer break went away, but the traditional calendar remains to this day

To try and alleviate large class sizes and other issues, schools around the country began to experiment with YRE

With the increased scrutiny on learning outcomes and standardized testing, YRE is a common topic of consideration for nearly all public schools in the nation

If YRE can be empirically linked to higher tests scores, public schools will migrate towards it. This shift would cause changes in other areas such as work scheduling and tourism

Page 5: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

LITERATURE REVIEW

Rationale: Summer Learning Loss

Cooper, H., Nye, B., Charlton, K., Lindsay, J., & Greathouse, S. (1996). The Effects of summer vacation on achievement test scores: a narrative and meta-analytic review. Review of Educational Research, 66(3), 227-268.

Page 6: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

LITERATURE REVIEW

Looking further into summer learning loss it was found that low SES, African-American and Hispanic students were more affected than white, Asian, or high SES students

Quality of teachers was also identified as a contributing factor in test scores

Downey, D. B., von Hippel, P. T., & Broh, B. A. (2004). Are Schools the great equalizer? cognitive inequality during the summer months and the school year. American Sociological Review, 69(5), 613-635

Page 7: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

LITERATURE REVIEW

Three studies applied summer learning loss theories and compared test scores: Iowa, Roby (1995)

Compared reading and math scores of 6th graders Used one YRE school’s scores and one traditional school’s scores

[comparison group posttest] YRE mean test scores were higher than traditional control school

San Diego, Alcorn (1992) Looked at reading and math scores of 3rd, 5th, and 6th graders Assessed the rate of success for reaching target increases per school for

the entire San Diego School District Found that 17 YRE schools outperformed their traditional counterparts

North Carolina, McMillen (2001) Compared the reading and math test scores of 3rd - 8th graders Compared all of the schools in the state No statistical relationship was found

Page 8: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

RESEARCH METHOD

Multiple linear regression I used the STAR testing data set and

the Academic Performance Index (API) from the California Department of Education for 2009

DV: mean scaled score IV: YRE Hypothesis: YRE has an affect on mean

scaled scores

Page 9: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

INDEPENDENT VARIABLESVariable Description Source

YRE A dummy variable coded 1 if the school participates in year-round education and 0 if it has a traditional schedule.

CDE

ALT Taken from the Statewide Rank. If it was coded I=Invalid data, B=District or ASAM, C=Special Education School, then it is coded as Alternative

API

CHAR Public schools that may provide instruction in any of grades K-12 that are created or organized by a group of teachers, parents, community leaders or a community-based organization

API

EMER Percent teachers with emergency credentials API

P_DI Percent of students with disabilities API

P_MIGED Percent of students in migrant education programs API

P_GATE Percent of students in Gifted and Talented Education programs API

MEALS Percentage of students that are eligible for Free or Reduced Price Lunch Program

API

CLASS ACS_K3: Average class size (grade K-3). Used in analysis of 3rd grade scores API

ACS_46: Average class size (grade 4-6). Used in analysis of 5th grade scores

  ACS_CORE: Number of core academic courses. Used in analysis of 7th and 11th grade scores

 

Page 10: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

DESCRIPTIVE STATISTICSTable 2

Descriptive statistics

Grade TestState Avg

ScoreYRE Avg

Score DifferencePercent

Difference

Number of Schools Included

Percent of YRE

Schools

3rd Grade ELA 340.72 327.86 -12.86 -3.8% 4931 15

Math 387.58 373.97 -13.61 -3.5 4931 15

5th Grade ELA 356.43 345.61 -10.82 -3.0 4786 15

Math 375.24 363.22 -12.02 -3.2 4784 15

Science 354.34 341.49 -12.85 -3.6 4785 15

7th Grade ELA 353.78 344.39 -9.39 -2.7 1624 8

Math 344.36 335.82 -8.54 -2.5 1617 8

Algebra I 425.24 399.61 -25.63 -6.0 557 7

11th Grade ELA 317.8 303.75 -14.05 -4.4 1378 6

Algebra I 279.35 273.04 -6.31 -2.3 930 6

Geometry 275.33 264.26 -11.07 -4.0 862 6

Algebra II 291.35 279.75 -11.6 -4.0 819 5

HS Math 339.53 318.81 -20.72 -6.1 777 5

U.S. History 321.62 304.15 -17.47 -5.4 1358 6

Biology 335.76 314.21 -21.55 -6.4 908 6

Chemistry 324.83 310.93 -13.9 -4.3 801 5

  Physics 352.93 333.87 -19.06 -5.4 579 5

Page 11: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

SAMPLE HISTOGRAM

State Mean for 3rd grade ELA

Page 12: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

FINDINGSTable 3.1

Beta results from multiple regression (elementary school)  3rd Grade 5th Grade

  ELA Math ELA Math ScienceYRE -.046 *** -.035 *** -.024 ** -.009 -.017 *ALT -.017 * -.025 * -.032 *** -.035 *** -.019 *CHAR -.038 *** -.065 *** -.008 -.048 *** -.030 ***EMER -.029 *** -.028 ** -.016 * -.013 -.024 **P_DI -.032 *** -.068 *** -.013 -.069 *** -.013  P_MIGED -.082 *** -.079 *** -.061 *** -.070 *** -.071 ***P_GATE .119 *** .166 *** .137 *** .190 *** .138 ***MEALS -.756 *** -.604 *** -.766 *** -.579 *** -.729 ***CLASS .000 -.009   .031 *** .005 .007  

Adj R2 .700 .504   .723 .480 .657  

F 1280.738 *** 557.799 *** 1413.821 *** 501.829 *** 1041.366 ***

* = .05 significance, ** = .01 significance, *** = .001 significance

Page 13: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

FINDINGSTable 3.2

Beta results from multiple regression (middle school) 

7th Grade

  ELA Math Algebra IYRE -.014 -.013 -.077

*ALT -.267

***-.228

***.027

 CHAR .003 -.082

***-.049

 EMER -.058

***-.051

**-.006

 P_DI -.040

**-.039

*-.077

*P_MIGED .011 .023 -.080

*P_GATE .186

***.198

***.145

***MEALS -.669

***-.517

***-.512

***CLASS .059

***.055

**-.011

 

Adj R2 .727 .499 .383  

F 481.053 *** 179.901 *** 39.322 ***

* = .05 significance, ** = .01 significance, *** = .001 significance

Page 14: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

FINDINGSTable 3.3

Beta results from multiple regression (high school English and math)

  11th Grade

  ELA Algebra I Geometry Algebra II HS Math

YRE -.002 -.058 -.061 * -.050 -.037  

ALT -.489 *** -.237 *** -.244 *** -.145 *** -.067 *

CHAR .016 -.068 * -.032 -.161 *** -.133 ***

EMER -.043 ** -.053 -.068 * -.067 * -.051  

P_DI -.083 *** -.073 * -.118 *** -.147 -.104 ***

P_MIGED .008 .059 .014 .022 -.003  

P_GATE .249 *** .009 .022 .071 * .167 ***

MEALS -.329 *** -.271 *** -.411 *** -.300 *** -.465 ***

CLASS .061 *** .055 .069 * .114 *** .105 ***

Adj R2 .738 .199 .326 .219 .383  

F 431.113 *** 26.650 *** 47.266 *** 26.499 *** 54.477 ***

* = .05 significance, ** = .01 significance, *** = .001 significance

Page 15: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

FINDINGSTable 3.4

Beta results from multiple regression (high school history and science)

  11th Grade

  US History Biology Chemistry Physics

YRE -.015 -.054 * -.033 -.026  

ALT -.465 *** -.330 *** -.147 *** -.086 *

CHAR -.030 -.073 ** -.121 *** -.105 **

EMER -.035 * -.009 -.066 * -.057  

P_DI -.061 *** -.077 *** -.116 *** -.146 ***

P_MIGED .010 -.021 .044 .028  

P_GATE .248 *** .152 *** .110 *** .033  

MEALS -.303 *** -.407 *** -.507 *** -.475 ***

CLASS .110 *** .102 *** .040 .142 ***

Adj R2 .705 .537 .384 .356  

F 361.555 *** 117.957 *** 56.443 *** 36.453 ***

* = .05 significance, ** = .01 significance, *** = .001 significance

Page 16: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

FINDINGS

7 out of 17 tests found YRE to be significant

All betas for YRE were negative In general, the impacts of YRE decrease

as grade level increases

3rd Grade 5th Grade 7th Grade 11th Grade

YRE -0.0462221174849486 -0.0237242997243444 -0.0144638989896681 -0.00190274516007978

-.048-.043-.038-.033-.028-.023-.018-.013-.008-.003

YRE's relative impact on ELA

Beta

Page 17: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

CONCLUSIONS

YRE seems to produce low test scores Controlling for factors that typically indicate a failing

school, YRE still underperformed YRE is most impactful at lower grades where YRE is

more prevalent The findings here run contrary to the theory of

summer learning loss

Page 18: Dan Curtis PA706 5/11/2011. Research question History of topic Literature review Research method Findings Conclusions Bibliography

BIBLIOGRAPHYAlcorn, R. D. (1992). Test scores: can year-round school raise them? Thrust for Educational Leadership, 21(6), 12-15.Alexander, K. L., Entwisle, D. R., & Steffel Olson, L. (2007). Lasting consequences of the summer learning gap. American Sociological

Review, 72(2), 167-180.California Department of Education (2010, July 21). 2007-08 Year-round education directory. Retrieved from

http://www.cde.ca.gov/ls/fa/yr/direct07.asp California Department of Education (2010, September 16). Year-round education program guide. Retrieved from

http://www.cde.ca.gov/ls/fa/yr/guide.aspCalifornia Department of Education. (2010, January 14). Research file list - STAR 2009 test results. Retrieved from

http://star.cde.ca.gov/star2009/ResearchFileList.asp?ps=true&lstTestYear=2009&lstTestType=C&lstCounty=&lstDistrict=&lstSchool=&lstGroup=1&lstSubGroup=1

Cooper, H., Nye, B., Charlton, K., Lindsay, J., & Greathouse, S. (1996). The Effects of summer vacation on achievement test scores: a narrative and meta-analytic review. Review of Educational Research, 66(3), 227-268.

Cooper, H., Valentine, J. C., Charlton, K., & Melson, A. (2003). The Effects of modified school calendars on student achievement and on school and community attitudes. Review of Educational Research, 73(1), 1-52.

Davies, B. & Kerry, T. (1999). Improving student learning through calendar change. School Leadership & Management, 19(3), 359-371. Downey, D. B., von Hippel, P. T., & Broh, B. A. (2004). Are Schools the great equalizer? cognitive inequality during the summer months

and the school year. American Sociological Review, 69(5), 613-635.Education Data Partnership. (2010). School reports. Retrieved from

http://www.ed-data.k12.ca.us/Navigation/fsTwoPanel.asp?bottom=%2Fprofile.asp%3Flevel%3D07%26reportNumber%3D16Gandara, P., & Fish, J. (1994). Year-round schooling as an avenue to major structural reform. Educational Evaluation and Policy Analysis,

16(1), 67-85.Granderson, L. (2011, May 10). We need year-round school to compete globally. Retrieved from

http://www.cnn.com/2011/OPINION/05/10/granderson.yearround.school/index.html Glines, D. (1995). Year-round education: History, philosophy, future. National Association for Year-Round Education: San Diego, CAMcMillen, B. J. (2001). A Statewide evaluation of academic achievement in year-round schools. The Journal of Educational Research,

95(2), 67-74.Roby, D. E. (1995). Comparison of a year-round school and a traditional school: reading and mathematics achievement. ERS Spectrum,

13(1), 7-10.Wothen, B. R. & Zsiray, S. W. (1994). What twenty years of educational studies reveal about year-round education. Retrieved from The

University of North Carolina, North Carolina Educational Policy Research Center: http://eric.ed.gov/PDFS/ED373413.pdf