NRS Data System CheckupNRS Data System Checkup
Assessing Your Data SystemDo You Need an MIS Tune-up?
American Institutes for ResearchFebruary 2005
NRS Data System CheckupNRS Data System Checkup2
NRS Data System NRS Data System CharacteristicsCharacteristics Functionally Complete Reliable Easy to Use Accessible to Users Not Resource Hungry Able to Mine Data to Learn About
Opportunities/Needs? Takes Advantage of Data Synergies Other Considerations
NRS Data System CheckupNRS Data System Checkup3
Functionality: Data for Functionality: Data for Monitoring and Program Monitoring and Program ImprovementImprovementThe Data System… Is a primary source of information on
programs Provides data for monitoring of
implementation of policies and procedures
Is useful to program and State staff for evaluation and program improvement
NRS Data System CheckupNRS Data System Checkup4
Functionally CompleteFunctionally Complete Sufficiency and Granularity of Data
Report for useful levels and demographics (program, site, class, teacher, ethnicity, age, etc.)
Support monitoring of key assessment procedures (e.g., tests, forms, hours between pre-/post-test)
Monitor follow-up procedures (exit quarters, goal setting)
NRS Data System CheckupNRS Data System Checkup5
Desk Monitoring Functionality: Desk Monitoring Functionality: Sample Data ElementsSample Data Elements Performance Standards
NRS outcomes Compliance Issues
Instructional hours offered Grant requirements
Program Standards Retention—student attendance Pre-/post-test percentages Staff—number and qualifications Cost per student
NRS Data System CheckupNRS Data System Checkup6
Able to Validate DataAble to Validate Data Completeness and Quality of Data Error Checks Electronic Desk-monitoring Report
NRS Data System CheckupNRS Data System Checkup7
Timeliness of DataTimeliness of Data Monthly to Quarterly Submission
To central State database, via Web or other electronic means
Ability to Evaluate Trends Across Years Multi-year data
NRS Data System CheckupNRS Data System Checkup8
ReliableReliable Operates in field without tech
problems Programs can get tables/data to state Doesn’t crash or slow down under load
NRS Data System CheckupNRS Data System Checkup9
Easy to UseEasy to Use Screens are clear and concise Obvious operational flow All functions accessible
NRS Data System CheckupNRS Data System Checkup10
AccessibleAccessible Data entry staff can access by web or
have properly equipped computer Decision-makers/Administrators can
get reports easily
NRS Data System CheckupNRS Data System Checkup11
Tech Support Hungry?Tech Support Hungry? Usability issues Reliability issues Training issues
NRS Data System CheckupNRS Data System Checkup12
Data MiningData Mining Beyond NRS requirements, what else
can your data tell you? What tools might help you understand
issues and trends?
NRS Data System CheckupNRS Data System Checkup13
Data SynergiesData Synergies Where are other useful data? Are they accessible? What might they be used for?
NRS Data System CheckupNRS Data System Checkup14
Other ConsiderationsOther Considerations Bug fixes New features Pet peeves