new options to the act...webinar overview 1. act enhancements: three new options this fall 2....
TRANSCRIPT
![Page 1: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/1.jpg)
New Options to the ACT: Put the New Student Data File and Research into Practice
Kenton Pauls & Krista Mattern
February 26th, 2020
![Page 2: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/2.jpg)
Webinar Overview
1. ACT enhancements: Three new options this fall
2. College reporting options for students
3. Superscore reporting: Details & data implications
4. Research on the validity of section retesting ACT scores
5. Score use policy recommendations
6. Feedback collection for follow-up
![Page 3: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/3.jpg)
Three New Options – September 2020
3
![Page 4: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/4.jpg)
ACT Section Retesting
• Students who have taken the complete test at least once, will be given the choice to retake individual ACT section tests,rather the full ACT - at online equipped national test sites.
4
![Page 5: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/5.jpg)
ACT Superscoring• Superscoring aIlows students to send
colleges a super composite score which utilizes highest individual section scores across multiple test attempts.
▪ Ensures school has best test results
on hand for app and scholarship review
5
![Page 6: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/6.jpg)
Faster Results with ACT Online Testing• Students will have option to take
the National ACT test online.
• Multiple-choice scores for online tests available as soon as 2 business days after test.
6
![Page 7: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/7.jpg)
What’s New:Students & Score Reporting Options
7
![Page 8: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/8.jpg)
Basics of Student ExperienceNot new
• Student registers for the test online• Selects which schools will receive scores
• Pre or post test• Student retains control of what scores get sent to colleges
New
• Presented with two report sending options• Single test event
• Limited to full battery tests (single section retests can’t be sent alone)
• ACT superscore report• The only option to send section retest• Data file includes highest full battery and all test data for every test event included in
superscore
Only one file for colleges - identical layout, though different test data
8
![Page 9: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/9.jpg)
What’s New:Higher Ed & Receiving Test Scores
9
![Page 10: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/10.jpg)
Today’s file – fixed width text
11
![Page 11: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/11.jpg)
Resources to Interpret Data
12
![Page 12: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/12.jpg)
NEW Data Layout
![Page 13: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/13.jpg)
The Score Sender Data: Overview
• One new file format for colleges• No longer in fixed width text format…only CSV
• Improved access to ACT’s powerful data• Logically reorganized
• More descriptive data replaces obscure codes
• Additional test scores included
• Aligned to standards
• Similarities to Encoura file layout
• Institutional autonomy & policy variations understood
• Legacy predictive modeling indexes no longer appended
• Newly designed printable PDF score report
14
Unchanged: Access to data still through Encoura Data Lab
![Page 14: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/14.jpg)
Printable: Superscore College ReportPDF score report downloadable for all students
Type: Section Type: Section
![Page 15: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/15.jpg)
Printable: Single Test College ReportPDF score report downloadable for all students
![Page 16: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/16.jpg)
![Page 17: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/17.jpg)
New Electronic File Layout DocumentationMarch release
![Page 18: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/18.jpg)
Reorganized Data: Expanded Data Use
1. Report Type Identifier (single test or superscore report)
2. Student Information
3. High School & Academic Interest Information
4. Single test event data or highest single composite in the case of superscore report• Student makes the selection• These fields are always populated with full test data
5. Superscore related test data• Test data for every section that contributes to superscore
• Including scores earned during test event which don’t contribute to superscore
• Populated only in superscore report
6. Student Profile data• Always most recent data from student's record
7. Detailed academic test insights
19
![Page 19: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/19.jpg)
Student Info
![Page 20: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/20.jpg)
High School and Academic Interest Information
![Page 21: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/21.jpg)
Single Test Event – Sample Data
These columns will always be populated with completed ACT test
data – either a summary of a single test event or the highest full
battery in the case of a superscore report
![Page 22: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/22.jpg)
Highest Math
Superscore Report – Sample Data
Highest English Highest ReadingHighest Math
Highest Science
![Page 23: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/23.jpg)
Student Profile Data
![Page 24: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/24.jpg)
Accessing the Files
• We will proactively share official documentation• Official layout documentation ASAP: March
• Sample file: shortly thereafter
• Sample files and source documentation will be made available at https://helpcenter.encoura.org/
• To gain access to Encoura visit https://encoura.org/get-my-login
![Page 25: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/25.jpg)
SUPERSCORINGACT September 2020
![Page 26: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/26.jpg)
Su
pe
rsc
ori
ng
27
Superscoring allows students to demonstrate their academic achievement most favorably for college applications and scholarships.
Superscoring is in alignment with current admissions practices and policies among many postsecondary institutions
Students’ best scores from any test attempt results in the most valid indicator of a student’s preparedness for future success
![Page 27: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/27.jpg)
Shift in ACT Score Distribution Due to Superscoring (Cruce & Mattern, 2020)
![Page 28: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/28.jpg)
RETESTINGACT September 2020
SECTION
![Page 29: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/29.jpg)
Se
cti
on
Re
testi
ng
30
Section retesting lowers barriers to retesting—in particular for underserved students—by reducing costs and minimizing the time commitment.
It provides students the opportunity to focus their learning efforts on subject areas in greatest need of improvement.
In combination with superscoring, section retesting can help students demonstrate their academic achievement most favorably for college applications and scholarships.
![Page 30: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/30.jpg)
Students achieved similar scores regardless of test order
31
• ACT has conducted studies with randomly assigned subject order conditions (EMRS, MRSE, RSEM, or SEMR). Taking a section first is akin to taking only that section (Andrews, 2019)
• Based on analyses of 4,106 online testers, students achieved similar average scale scores regardless of the order in which they took the ACT sections.
• There were small, significant differences when comparing science 1st vs. 4th and reading 3rd
vs. 4th.
![Page 31: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/31.jpg)
Taking ACT subject tests on different days doesn’t result in higher than expected scores
~100 students took the four ACT subject tests over the course of four days. Modular scores were matched to official ACT scores from an operational test administration. The results indicate that the scores students earned when taking one ACT subject test at a time were in line with what would be expected if they had taken the full battery (Mattern, Radunzel, & Andrews, 2019)
32
![Page 32: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/32.jpg)
Students tend to perform as expected when retesting in a single ACT subject area (Radunzel & Mattern, 2020)
• Students did not earn higher than expected scores when testing in a modular fashion for English, Reading and Science.
• Students tended to perform better than expected when retesting in Math; this was by only 0.4 points.
• These students also performed better than expected in math on their senior fall retake with the full battery (by 0.6 points).
• These findings suggest that the slightly higher than expected performance on the math section retesting may reflect true learning gains as the effect carried forward to the subsequent testing event.
33
![Page 33: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/33.jpg)
Section retesting scores are as predictive of college success as traditional battery testing scores(Radunzel & Mattern, in progress)
• First-year, first-time entering domestic college students took a single-subject ACT test during the first couple of weeks of classes. College provided course transcript information.
• Section retest scores were predictive of first-term GPA; correlations were not significantly different than the correlations based on full battery scores.
• Results suggest that ACT scores earned in a modular setting remain a valid indicator of college readiness.
34
Content Area N Full battery Section Retest Z p-valueEnglish
Full sample 39 0.340 0.418 -0.700 0.486
Subsample 27 0.437 0.440 -0.060 0.954Math
Full sample1 38 0.449 0.533 -0.700 0.481
Subsample 31 0.416 0.521 -0.940 0.346Reading
Full sample1 49 0.251 0.314 -0.560 0.576Subsample 42 0.286 0.285 0.010 0.990
ScienceFull sample1 45 0.310 0.363 -0.500 0.619
Subsample 36 0.300 0.399 -1.290 0.198
Comparison of Correlations between ACT scores and First-Term
GPA, Section Retesting vs. Full Battery
1 After the removal of one outlier where the student scored a 15 or below on the section retest.
![Page 34: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/34.jpg)
Score Use Policy
ACT September 2020
![Page 35: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/35.jpg)
Possible Superscoring Policy Language
36
University of ____ superscores the ACT. Superscoring at University of ____ means that
we consider student’s highest ACT section (or subtest) scores regardless of test date. The
super composite ACT score is calculated as the average of the best ACT English, Reading,
Math and Science subject scores and is used as one of multiple factors in admission and
financial aid. Beginning in September 2020, students are encouraged to send University
of ____ their ACT test scores utilizing the Superscore reporting option.
![Page 36: New Options to the ACT...Webinar Overview 1. ACT enhancements: Three new options this fall 2. College reporting options for students 3. Superscore reporting: Details & data implications](https://reader036.vdocument.in/reader036/viewer/2022071408/610136748eee34301176ec5d/html5/thumbnails/36.jpg)
37
Thank you!