new_ assessment, moving beyond testing
TRANSCRIPT
Assessment, Moving Beyond Testing
ERC-RMB at
North Carolina Agricultural and Technical
State University
Courtney Lambeth and Heather Aschenbrenner
Students of Today
• Today students are:
– Digitally literate
– Connected
– Immediate
– Experiential
– Social
– Prefer teams
– Achievement oriented
– Value engagement
– Value experience
– Visual and kinesthetic
– Impact driven
Students of Today
• Students have access to PC’s at a young age
– 20 % have access during elementary school
• 71 % of households reported internet access in 2011
• A breakdown of internet access in 2011:
– 76.2 % of White households
– 82.7 % of Asian households
– 58.3 % of Hispanic households
– 56.9 % of African American households
(Oblinger & Oblinger, 2005)
Generational Comparisons
(Oblinger & Oblinger, 2005, p.9)
Careers of Tomorrow
• Competing in a global market for jobs
• Over the next 10 years the job growth in STEM will be 14 %
Careers of Tomorrow
U.S. Department of Education
Recommendations from the “Gathering Storm”
I. Move the United States K-12 education system in science and mathematics to a leading position by global standards.
II. Double the real federal investment in basic research in mathematics, the physical sciences, and engineering over the next seven years (while, at a minimum, maintaining the recently doubled real spending levels in the biosciences).
III. Encourage more United States citizens to pursue careers in mathematics, science, and engineering
IV. Rebuild the competitive ecosystem by introducing reforms in the nation’s tax patent, immigration and litigation policies
(Rising Above the Gathering Storm Committee (U.S.), National Academy of Sciences (U.S.), National Academy of Engineering, & Institute of Medicine (U.S.), 2010)
Standardized Testing
• Administered and scored in a predetermined and standard manner
• Norm Referenced
• Types of tests
– Aptitude Test
• (SAT, ACT)
– Achievement Test
• (California Achievement Test, Comprehensive Test of Basic Skills)
• Designed to determine discrepancies between students
Standardized Testing
• Informative to parents and educators to compare children’s strengths and weaknesses, and other students’ achievements
• There are curricular differences and different educational objectives that make standardization difficult
• Factors that influence scores:– What is taught in school
– Intellectual Ability
– Out of school learning
Programmatic Assessment
Formal Definition:
“ Programmatic evaluation is a collection of methods, skills, and sensitivities necessary to determine whether a human service is needed and likely to be used, whether the service is sufficiently intensive to meet the unmet needs identified, whether the service is offered as planned, and whether the service actually does help people in need at a reasonable cost without unacceptable side effects.”
(Posavac & Carey, 2003, p. 2)
Common Types of Program Evaluations
• Evaluation of need
– Basic step before program planning
• Evaluation of process
– Checking assumptions made while program was being planned
• Evaluation of outcome
– Identify successful outcome
– Maintenance of improvement
• Evaluation of efficiency
Evaluators Need to Know
• Nature of the program
• People served
• Goals and structure of the program
• Why evaluation is considered
Preparing for an Evaluation
• Identify the program and its stakeholders– Obtain program description– Meet stakeholders
• Become familiar with information needs– Who, what focus, why, when and what resources?
• Planning an evaluation– Review the literature– Determine methodology
• Sampling procedures, research design, data collection, and statistical analysis
• Present a written proposal– Evaluators, program personnel, and funding agencies agree on
nature and goals of program, type of evaluation wanted, criteria and measures used, and readiness of program for evaluation
K-12 Framework andNext Generation Science Standards
• K-12 Framework– Scientific and Engineering Practices
– Crosscutting Concepts
– Core Ideas
• Next Generation Science Standards– Incorporates the ideals established in the
Framework
– A start to the development of standards of learning
Examples for Educators
• Content pre and post assessment
• Student portfolios
• District wide proficiencies
• Outside review teams
Take Away
Problem was not created in a day, so it cannot be changed in a day. Solutions need to have staying power.
Questions?
Contact Information:
Courtney Lambeth—
Heather Aschenbrenner—
References
File, T. (2013). Computer and internet use in the United States. Census Bureau, 20-569. Retrieved from http://www.census.gov/prod/2013-pubs/p20-569.pdf
Oblinger, J., & Oblinger, D. (2005). Is it age or IT: First steps toward understanding the net generation. Chapter 2. Educating the Net Generation. Educause: www.educause.edu/educatingthenetgen/. Retrieved from https://net.educause.edu/ir/library/pdf.pub7101b.pdf
Popham, W. J. (1999). Why standardized tests don’t measure educational quality. Using Standards and Assessments, 56(6), 8-15.
Posavac, E. J., & Carey, R. G. (2003). Program Evaluation, Methods and Case Studies, 6th Ed. Prentice Hall: Upper Saddle River, New Jersey.
Rising Above the Gathering Storm Committee (U.S.), National Academy of Sciences (U.S.), National Academy of Engineering, & Institute of Medicine (U.S.). (2010). Rising above the gathering storm, revisited: Rapidly approaching category 5. Washington, D.C.: National Academies Press.
U.S. Department of Education. Science, technology, engineering, and math: Education for global leadership. Retrieved from http://www.ed.gov/stem
(1999). Alternatives to Standardized Tests. New Schools Venture Fund. Retrieved from www.newschools.org/news/alternatives-to-standardized-tests