Home > Systemwide > Service Improvement/Systems Reform > Improving Practices > Program Evaluations: Collecting & Analyzing Data

Collecting & Analyzing Data

Note: Child Welfare Information Gateway provides this information as a resource. Our library does not define or endorse specific criteria for program evaluations.

• Evaluating program outcomes
• Planning for outcome evaluations
• Evaluation designs
• Collecting & analyzing data
• Using & communicating evaluation results

There are two types of data:

• Quantitative data involve numbers. These data can quantify change, including its direction and extent. Quantitative data often allow for comparisons among groups.
• Qualitative data involve narrative and description. These data can explain change by providing context and nuance. Qualitative data can put a human face to the numbers.

Both types of data are needed for a thorough outcome evaluation.

Data collection

For each indicator you wish to measure, you may collect data through:

• Existing sources such as school records or child protection reports
• Surveys or questionnaires
• Interviews
• Focus groups
• Observations

Many instruments exist that have already been validated - researchers have confirmed they measure what they are intended to measure. Some are available for free and others for purchase.

You will also need to develop a plan for who will collect the data, how often, and how the data will be stored (e.g., a database).

Data analysis

Analysis transforms raw data (e.g., lists of numbers or interview notes) into information that is easier to understand. Spreadsheets, databases, and data analysis software often are used. Specific analytic techniques are used for specific types of data. This aspect of program evaluation is almost always best performed by a professional evaluator or researcher.

The final step in data analysis is interpretation--the data are given meaning. The results of the analysis should answer your questions about the program's effectiveness.

	Selected Resources Buros Institute for Mental Measurements Buros Center for Testing, University of Nebraska-Lincoln Information about psychological tests and measures that may be useful in evaluating outcomes. Mental Measurements Research Guide Johns Hopkins University Information about psychological tests and measures that may be useful in evaluating outcomes.

	Information Gateway Library Search Includes publications from 2000 to present Data collection strategies Evaluation tools and instruments Analyzing data Evaluation how-to's (Search by Program Type)

Updated on November 19, 2008