Skip top navigation
National Reporting System   National Reporting System

Data Quality refers to the collection of relevant, accurate data that can help program staff answer questions about recruitment, retention and the effectiveness of their programs and components.

NRS Data Quality Toolkit

This toolkit brings together previously developed material on improving data quality into a single resource that permits easy access of this content to support ongoing state and local training around data quality practices.

 

Choose a data quality topic to get started.

 

Professionals at work

Motivation & Problem Solving

Woman at Computer

Understanding Data Quality

Railroad track crossing

Implementing Change

 

Motivation & Problem Solving

Resources in this section help with encouraging data use, enhancing staff motivation to improve data quality, and support approaches to creatively solving data quality issues.

 

NRS Guides

Linking Data Quality with Action This guide offers new approaches and tools to identify and prevent data quality problems. It introduces a local quality checklist, modeled after OCTAE's state checklist, which states can use to understand and evaluate local data collection practices.  On page 40, review the case about an adult education program.

Report Cards for Adult Education  Report Cards can be used to motivate programs to achieve goals or improve reporting. This guide provides an explanation of the purpose of report cards and their use for accountability, as well as instructions in how to develop report cards.

The Local Connection: Building a Data Use Learning Community   This guide uses a “community of learners” model as an organizing framework to promote data use, foster communication on data, and sustain a culture of data use at the local level.  Provided in the guide are specific strategies for increasing motivation among program staff to use data. Data Use Learning Communities empower local staff to generate their own solutions to data quality issues.

Desk Monitoring Guide  This guide introduces desk monitoring and its essential elements, and lays out how to plan, implement, and use desk monitoring. Continuous data monitoring helps to identify data quality issues before they compound into complex problems.

 

 

Training Materials

Demonstrating Results: Developing State and Local Report Cards for Adult Education  Using updated materials, the training provided guidance to select state teams to develop their own state and local report cards for accountability.

Desk Monitoring: Improving Program Performance This training focused on developing a desk monitoring system, including a tool to supplement onsite monitoring visits and a rubric to evaluate program performance.

 

Tools & Aids

The SCAMPER Technique  Explains SCAMPER technique for using questions to resolve a problem or generate new ideas.

Creative Problem Solving with SCAMPER  Briefly describes the SCAMPER method for creatively identifying solutions to challenging issues.  Provides lists of additional  SCAMPER resources.

SCAMPER Brainstorming Tool  Generates  random questions to encourage problem-solving.

Data Learning Communities: Program Perspective (video) – Local program in Tuscarora, PA describes the function and benefits of its Program Improvement Team (PIT).

 

NRS Online Courses

Developing Report Cards for Adult Education  This 4-part self-directed course provides an overview of how report cards are used in adult education and walks users through the five steps of developing a report card.  (Login required. Completion time 1 hour 20 minutes to 1 hour 45 minutes.)

Part 1: Introduction and Overview

Part 2: What are Report Cards?

Part 3: Five Steps to Developing a Report Card for Adult Education

Part 4: Conclusion

NRS Data Flow Learn who does what with the NRS Data, where it comes from, where it goes, and how it gets there. Upon completion of this course, you should be able to give a detailed account of what goes on at each level of the NRS. (Users will be required to log in to access this course.)

Data Quality Guide Training Courses This is an 8-part training course that will walk you through the information offered in the Data Quality Guide. (Users will be required to log in to access this course.)

 

 

 

Understanding Data Quality

Resources in this section help to evaluate your data quality, with an eye toward identifying and preventing problems such as issues with data collection and reporting with training and local monitoring and evaluation.

 

NRS Guides

Linking Data Quality with Action This guide offers new approaches and tools to identify and prevent data quality problems. It introduces a local quality checklist, modeled after OCTAE's state checklist, which states can use to understand and evaluate local data collection practices.

Building and Sustaining NRS Quality Data (PDF) Summarizes the NRS and clarifies NRS requirements. The guide also offers a new look at basic issues for NRS veterans and returns to the fundamental concepts—building quality data and using data for program improvement. Online  version

Desk Monitoring Guide  This guide introduces desk monitoring and its essential elements, and lays out how to plan, implement, and use desk monitoring.

 

Training Materials

Building and Sustaining Quality in NRS Data: Strategies for Program Improvement This training dealt with using NRS data to improve program quality through a four step continuous improvement process for building and sustaining change. 

 

Tools & Aids

Local Data Quality Checklist Self-monitoring tool for local staff focused on data collection  and reporting activities. Using this tool, local programs will be better informed about what is  necessary to know and do to ensure quality data.

OCTAE State Data Quality Checklist   State users can complete this  online  checklist, print the last submitted version for any state, and view statistics for all checklists submitted.  (Use of this tool requires login to the Division of Adult Education and Literacy (DAEL) National Reporting System (NRS)  application)

 

NRS Online Courses

Learning to be an NRS Data Detective  This in-depth 7-part course includes a variety of readings and tools that illustrate the art of being a data detective and using data to monitor performance, understand programs, and plan and evaluate program improvements efforts. (Login required. Completion time 3-5)

Part 1- Learning to be an NRS Data Detective: Introduction

Part 2- Foundational Elements: Data Collection

Part 3- Foundational Elements: Data Systems

Part 4- Policies and Procedures: Assessment

Part 5- Policies and Procedures: Goal Setting

Part 6- Policies and Procedures: Follow-up Measures

Part 7- Conclusion: Translating Detective Work into Action

 

Data Quality Guide For this course, learn who does what with the NRS Data, where it comes from, where it goes, and how it gets there. Upon completion, you should be able to give a detailed account of what the goes on at each level of the NRS. (Login required.  Completion time 1 hour 15 minutes to 1 hour 45 minutes.)

Part I. Introduction and Overview

Part II. Quality Data: Why Good Data Matter

Part III. The Data Collection Process

Part IV. Collecting NRS Outcome Measures

Part V. The State Role in Data Quality

 

NRS Data Flow  Learn who does what with the NRS Data, where it comes from, where it goes, and how it gets there. Upon completion of this course, you should be able to give a detailed account of what the goes on at each level of the NRS. (Login Required. Completion time 10-15 minutes.)

 

 

 

Implementing Change

This section contains resources for encouraging behavioral change and executing plans for improving data quality in a way that can make them a reality and result in true improvement.

NRS Guides

Linking Data Quality with Action  This guide offers new approaches and tools to identify and prevent data quality problems. It introduces a local quality checklist, modeled after OCTAE's state checklist, which states can use to understand and evaluate local data collection practices.

Training Materials

Linking Data Quality with Action: Evaluating and Improving Local Program Performance   The workshop focused states on data quality issues and provide approaches and tools for improving data quality and program performance. In this training, states review current data quality issues and suggest solutions, including methods for reviewing data and trends, improving procedures and data systems, and data auditing.

 

 

Tools & Aids

Prochaska and DiClemente’s Stages of Change Model

Keys to Successful Behavior Change

Southwest Educational Development Laboratory

Creating a Context for Change

Site-Based Decision Making: Its Potential for Enhancing Learner Outcomes

Staff Development and Change Process: Cut from the Same Cloth

Vision, Leadership, and Change

 

NRS Online Courses

Data Use Guide Training Courses   This 8-part online course will walk you through the creating a plan for Data Use. (Login required. Completion time 1 hour 15 minutes to 1 hour 45 minutes).

Part 1: Introduction: A Model for Using Data for Program Management and Improvement

Part 2: Identifying Issues and Problems

Part 3: Developing Measurable Questions

Part 4: Develop an Analysis Plan

Part 5: Analyze and Interpret Data

Part 6: Develop a Plan for Change

Part 7: Implement Change

Part 8: Evaluate the Change

 

 

Arrow pointing toward top of page. Back to Top

Archive

Archived documents are available upon request by sending an email to nrs@air.org with the name or description of the document. 


The National Reporting System for Adult Education (NRS) is administered by the Division of Adult Education and Literacy in the Office of Vocational and Adult Education at the U.S. Department of Education.