nrs data system checkup assessing your data system do you need an mis tune-up? american institutes...

NRS Data System CheckupNRS Data System Checkup

Assessing Your Data SystemDo You Need an MIS Tune-up?

American Institutes for ResearchFebruary 2005

NRS Data System CheckupNRS Data System Checkup2

NRS Data System NRS Data System CharacteristicsCharacteristics Functionally Complete Reliable Easy to Use Accessible to Users Not Resource Hungry Able to Mine Data to Learn About

Opportunities/Needs? Takes Advantage of Data Synergies Other Considerations

NRS Data System CheckupNRS Data System Checkup3

Functionality: Data for Functionality: Data for Monitoring and Program Monitoring and Program ImprovementImprovementThe Data System… Is a primary source of information on

programs Provides data for monitoring of

implementation of policies and procedures

Is useful to program and State staff for evaluation and program improvement

NRS Data System CheckupNRS Data System Checkup4

Functionally CompleteFunctionally Complete Sufficiency and Granularity of Data

Report for useful levels and demographics (program, site, class, teacher, ethnicity, age, etc.)

Support monitoring of key assessment procedures (e.g., tests, forms, hours between pre-/post-test)

Monitor follow-up procedures (exit quarters, goal setting)

NRS Data System CheckupNRS Data System Checkup5

Desk Monitoring Functionality: Desk Monitoring Functionality: Sample Data ElementsSample Data Elements Performance Standards

NRS outcomes Compliance Issues

Instructional hours offered Grant requirements

Program Standards Retention—student attendance Pre-/post-test percentages Staff—number and qualifications Cost per student

NRS Data System CheckupNRS Data System Checkup6

Able to Validate DataAble to Validate Data Completeness and Quality of Data Error Checks Electronic Desk-monitoring Report

NRS Data System CheckupNRS Data System Checkup7

Timeliness of DataTimeliness of Data Monthly to Quarterly Submission

To central State database, via Web or other electronic means

Ability to Evaluate Trends Across Years Multi-year data

NRS Data System CheckupNRS Data System Checkup8

ReliableReliable Operates in field without tech

problems Programs can get tables/data to state Doesn’t crash or slow down under load

NRS Data System CheckupNRS Data System Checkup9

Easy to UseEasy to Use Screens are clear and concise Obvious operational flow All functions accessible

NRS Data System CheckupNRS Data System Checkup10

AccessibleAccessible Data entry staff can access by web or

have properly equipped computer Decision-makers/Administrators can

get reports easily

NRS Data System CheckupNRS Data System Checkup11

Tech Support Hungry?Tech Support Hungry? Usability issues Reliability issues Training issues

NRS Data System CheckupNRS Data System Checkup12

Data MiningData Mining Beyond NRS requirements, what else

can your data tell you? What tools might help you understand

issues and trends?

NRS Data System CheckupNRS Data System Checkup13

Data SynergiesData Synergies Where are other useful data? Are they accessible? What might they be used for?

NRS Data System CheckupNRS Data System Checkup14

Other ConsiderationsOther Considerations Bug fixes New features Pet peeves