Child Welfare Information Gateway
Skip to main content
  • U.S. Department of Health & Human Services
  • Administration for Children & Families
  • Children's Bureau
Child Welfare Information Gateway
REPORT ABUSE OR
NEGLECT
FIND HELP WITH A
PERSONAL SITUATION   

Home Topics Publications Library State Resources More Tools & Resources News & Events
REPORT ABUSE OR
NEGLECT
FIND HELP WITH A
PERSONAL SITUATION   
  • About Us
  • Contact
  • Chat
  • Free Subscriptions
  • Resources in Spanish
  • About Us
  • Contact
  • Chat
  • Resources in Spanish
  • Shopping Cart
  • Home
  • Topics
    • Family-Centered Practice
      • Philosophy and Key Elements of Family-Centered Practice
      • Family-Centered Practice Across the Service Continuum
      • Engaging Families
      • Family-Centered Casework Practice
      • Family Group Decision-Making
      • Engaging Communities to Support Families
      • Creating a Family-Centered Agency Culture
    • Child Abuse & Neglect
      • Definitions of Child Abuse & Neglect
      • Identification of Child Abuse & Neglect
      • Risk Factors That Contribute to Child Abuse and Neglect
      • People Who Engage in Child Abuse or Neglect
      • Impact of Child Abuse & Neglect
      • Child Abuse & Neglect Fatalities
    • Preventing Child Abuse & Neglect
      • National Child Abuse Prevention Month
      • Overview: Preventing Child Abuse & Neglect
      • Promoting Child & Family Well-Being
      • Public Awareness & Creating Supportive Communities
      • Child Abuse and Neglect Prevention Programs
      • Developing & Sustaining Prevention Programs
      • Evidence-Based Practice for Child Abuse Prevention
      • Evaluating Prevention Programs
    • Responding to Child Abuse & Neglect
      • Introduction to Responding to Child Abuse & Neglect
      • Reporting Child Abuse and Neglect
      • Assessment in Child Protection
      • Differential Response in Child Protective Services
      • Child Protection Casework Practice
      • Responding to Child Maltreatment Near Fatalities and Fatalities
      • Trauma-Informed Practice in Child Welfare
      • Collaborative Responses to Child Abuse & Neglect
    • Supporting & Preserving Families
      • Supporting Families With Mental Health and Substance Use Disorders
      • Introduction to Family Support and Preservation
      • In-Home Services Involved With Child Protection
      • Family Support Services
      • Resources for Managers of Family Support and Preservation Services
      • Family Preservation Services
    • Out-of-Home Care
      • National Foster Care Month
      • Overview: Out-of-Home Care
      • Foster Care
      • Group and Residential Care
      • Kinship Care
      • Casework Practice in Out-of-Home Care
      • Transition to Adulthood and Independent Living
      • Placement Decisions
      • Resources for Foster Families
    • Achieving & Maintaining Permanency
      • Overview: Achieving & Maintaining Permanency
      • Reunifying Families
      • Recruiting and Retaining Resource Families
      • Permanency With Relatives and Kin
      • Guardianship
      • Permanency for Specific Youth Populations
      • Legal and Court Issues in Permanency
      • Interjurisdictional Placements
      • Working With Children, Youth, and Families in Permanency Planning
      • Working With Children, Youth, and Families After Permanency
      • Resources for Administrators and Managers About Permanency
      • Resources for Families About Permanency
    • Adoption
      • National Adoption Month
      • All-In Foster Adoption Challenge
      • Children's Bureau Adoption Call to Action
      • Adoption and Guardianship Assistance by State
      • Introduction to Adoption
      • Ethical Issues in Adoption
      • For Adopted People
      • For Adoption Program Managers & Administrators
      • For Expectant Parents Considering Adoption and Birth Parents
      • How to Adopt
      • Laws Related to Adoption
      • Parenting After Adoption
      • Preplacement Adoption Casework Practice
      • Postplacement Adoption Casework Practice
      • Search & Reunion in Adoption
    • Management & Supervision
      • Administering & Managing Child Welfare Agencies & Programs
      • Child Welfare Practice Improvement
      • Disaster Preparedness & Response
      • Ethical Practice & Client Rights
      • Evaluating Program and Practice Effectiveness
      • Funding
      • Information Systems & Data
      • Supervising Child Welfare Services
      • System Reform
      • Training
      • Workforce
    • Systemwide
      • Assessment
      • Behavioral Health & Wellness
      • Courts
      • Cultural Responsiveness
      • Diverse Populations and Communities
      • Domestic Violence
      • Human Trafficking
      • Laws & Policies
      • Service Array
      • Statistics
      • Well-Being
      • Youth
  • Publications
    • Publications Series
    • Browse by Topic
    • Browse by Title
    • índice de Títulos en Español (Spanish Title Index)
  • Library
    • Library Services
    • Library Search Help
  • State Resources
    • State Statutes
    • National Foster Care & Adoption Directory
    • State Guides & Manuals Search
    • State-Related Organizations Lists
    • Adoption and Guardianship Assistance by State
  • More Tools & Resources
    • Related Organizations
    • Learning Center
    • Resources From the Children's Bureau
      • Children's Bureau Discretionary Grants
      • The Story of the Children's Bureau
      • Children's Bureau Video Series
    • Child Welfare Information Gateway Podcast Series
    • Multimedia
      • Videos
      • Webinars
    • Family Engagement Inventory
  • News & Events
    • Free Subscriptions
    • Adoption Triad
    • Children's Bureau Express (CBX)
    • The Grantee Connection
    • New on Information Gateway
    • New From the Children's Bureau
    • Event Calendar
  • Home
  • Pubs
  • acloserlook
  • Accountability
  • Defining Accountability

Accountability

Download (PDF 1439KB)
Author(s)
National Technical Assistance and Evaluation Center for Systems of Care
Year Published 2010

Defining Accountability

Whether in relation to criminals or lawmakers, U.S. or foreign government, corporations or public institutions, holding people and entities accountable encompasses such a variety of goals and activities that arriving at a comprehensive definition is difficult. According to one policy expert (Koppell, 2005, p. 95), "Layering every imagined meaning of accountability into a single definition would render the concept meaningless." Instead, Koppell presents a typology of accountability that features five dimensions:

  • Transparency ("Did the organization reveal the facts of its performance?").
  • Liability ("Did the organization face consequences for its performance?").
  • Controllability ("Did the organization do what the principal desired?").
  • Responsibility ("Did the organization follow the rules?").
  • Responsiveness ("Did the organization fulfill the substantive expectation/demand/need?").

Koppell emphasizes that no single organization will focus equally on all dimensions of accountability. Behn (2001) identifies four main categories of issues to which people and institutions are held accountable: finance; fairness; abuse of power; and performance. Although all categories serve important purposes, for accountability as a principle within the system of care framework, performance is the main issue, as reflected in the definition of accountability used in the Improving Child Welfare Outcomes Through Systems of Care demonstration initiative: "Accountability refers to the continual assessment of practice, organizational, and financial outcomes to determine the effectiveness of systems of care in meeting the needs of children and families" (Child Welfare Information Gateway, 2008).

Accountability within large systems is not achieved with a single act. As Figure 1 illustrates, accountability is a process with three important phases:

  • Planning
  • Measuring
  • Applying the Information

Figure 1: Phases of Accountability

Figure 1 - Phases of Accountability

D

Evaluation Basics

Although the principle of accountability covers more than program evaluation, evaluation methods are an essential aspect of accountability.

Logic Models and Theories of Change

A logic model is a diagram that connects inputs (resources) to activities, to outputs (direct result of activity), to outcomes (short-term, intermediate, long-term, ultimate). Comprehensive models also include external factors and assumptions. In a theory of change, planners specifically call out the underlining assumptions that drive a particular change in order to best identify the activities that must occur.

For more information on theories of change, visit www.theoryofchange.org.

Types of Evaluation

Among the different categories of program evaluations, the two most common, and potentially most meaningful, are process or formative evaluations and outcome or summative evaluations.

Process or formative evaluation. Used to understand how a program works. Data collection is ongoing and focuses on outputs from activities. Process evaluations commonly include accomplishing discrete tasks (such as participation in training) required to reach larger goals.

Outcome or summative evaluation. Used to understand whether a program achieved a desired outcome. Measures focus on long-term outcomes, such as improved safety, permanency, and well-being for children. The best evaluation model for understanding if and how a system is improving is frequently a hybrid that includes elements of both process and outcome evaluations.

Planning. Holding systems accountable requires measuring the extent to which they are successful. Measuring the success of systems requires establishing clear outcomes and a plan for reaching them. Formulating strategic plans, logic models, and theories of change helps agencies and institutions connect activities to outcomes. As plans start to take shape, strategies to measure progress also should be determined (Sahonchik, Frizsell, & O'Brien, 2005). In addition to decision-makers, planners should include individuals who do the work (staff), receive its benefits (families), and measure its effectiveness (evaluators and others involved in accountability).

Although planning is the first step toward establishing an accountable system of care, reviewing and revising system planning should be ongoing (Sahonchik et al., 2005).

Systematic and strategic planning prior to implementing a system improvement effort is vital, which is why the Children's Bureau required a full planning year before grant communities launched implementation activities.

Measuring. Good measurement is the foundation of accountability. True accountability includes measuring change as it happens as well as measuring the outcomes of change. The systems of care theory of change depicted in Figure 2 proposes that system and practice changes result in improved child and family outcomes. Hence, indicators should be established to measure change in system policies, procedures, and practices as well as change in outcomes for children and families.

Figure 2: Theory of Change for Systems of Care

Figure 2 - Theory of Change for Systems of Care

D

Child and Family Outcome Measures. Many child and family measures are associated with long-term outcomes. Accountability often begins with these measures since they represent the goal of the agencies: to improve safety, permanency, and well-being for the children served. Many of these measures are collected from large administrative datasets housed in agencies' electronic information systems. While important, and often mandated by Federal or State agencies, these are not the only kinds of indicators of child and family outcomes. Agencies can obtain valuable information about the population served, or a subpopulation of interest, through a variety of other methods, including focus groups, interviews, and evaluations designed to track cohorts over time.

System and Practice Measures. Systems can be complex, including not only the children and families served, but also staff, partner agencies, and communities, as well as all the practices and operations that contribute to making the system work. If accountability is embedded in the system, both outcomes for children and system change can be measured. Measuring complex system change may require measuring many individual aspects of the system, such as how a new tool works, if training was successful, or how staff members' attitudes about cultural competency change over time. These individual measures should be as accurate as possible, but they do not have to be overly complex. Often, these measures include information that already is, or could easily be, routinely collected. The measures may be quantitative (e.g., how many staff attended a brown bag session on diversity or participant satisfaction with the training, indicated on a scale of 1-5) or qualitative (e.g., response from caseworkers who are testing a new assessment tool or focus group findings about new ideas for foster parent recruitment). Engaging child welfare staff in evaluation planning can be helpful for identifying ways to measure an intended change as well as maintaining accurate records throughout an evaluation project.

Even if collecting measures associated with mundane activities is easy, collection should be planned and systematic and all measures should link to the larger outcomes a system is trying to achieve. Often referred to as performance measurement, a structured process using empirical indicators should be established to allow child welfare and partner agency staff to track whether an agency's activities and services are being provided, used, and ultimately improve the lives of children and families (Bazemore, 2006; Rossi, Lipsey, & Freeman, 2004).

In addition to being able to accurately assess system progress, measures must lend themselves to the next step in accountability, applying the information.

Measures must be:

  • Thorough enough to be useful to people at all levels of the system and those outside the system without being burdensome.
  • Directly related to agency/program/project goals and expectations.
  • Flexible and fast enough to guide real-time decisions and test new ideas quickly (Langley, Nolan, Nolan, Norman, & Provost, 1996)
  • Continuously collected.

"Any oversight program or expenditure that does not help the agency advance in the direction of their mandated goals and Federal expectations should be evaluated and questioned" (Blome & Steib, 2007, p. 4).

Applying the Information. To advance from simply measuring to practicing accountability, the information must be shared and used to improve the activity, program, or system. The information must be analyzed and synthesized for multiple communication formats to support a variety of tasks, including:

  • Testing the theory of change on which the program or project is based.
  • Informing staff about how their practices affect individuals served.
  • Helping administrators and decision-makers shape policy.
  • Informing families, the community, and the public about, and engaging them in, the work.

Communicating information about performance to a variety of stakeholders is critical for agencies trying to effect significant system change, especially when they are relying on a broad-based collaborative to oversee the change. Small indicators may show improvement long before large, system-wide results are seen. Even if progress is not apparent, sharing data advances system improvement by:

  • Creating early opportunities to review and revise system improvement activities that are ineffective.
  • Allowing a wider group of stakeholders to participate in improvements.
  • Demonstrating an agency's willingness to be transparent to staff and community partners, resulting in increased trust and commitment.
  • Showing those who may perform most of the data collection (i.e., caseworkers) how the information is used and how improvements in practice can generate improvements in outcomes.
  • Making accountability a routine part of agency operations by building evaluative capacity throughout the system.

Applying the information must be as inclusive as possible and based on sound leadership. Leaders must be willing to use what is learned through measurement to make changes, holding the agency and their own leadership accountable. However, accountability and leadership both require the participation of a broad group of stakeholders who share responsibility for outcomes (Schorr, 2006).

"Improvement comes from the application of knowledge" (Langley et al., 1996, p. 3).

(Previous) (Next)

This material may be freely reproduced and distributed. However, when doing so, please credit Child Welfare Information Gateway.

Related Content

Accountability

Accountability in a Child Welfare Driven System of Care

Challenges and Strategies in Implementing Accountability

Implications for Administrators and Stakeholders

Children's Bureau - An office of the Administration for Children and Families

Child Welfare Information Gateway is a service of the

  • Children’s Bureau
  • Administration for Children and Families
  • U.S. Department of Health and Human Services.
↑ Back to top
  • HOME
  • TOPICS
    • Family-Centered Practice
    • Child Abuse & Neglect
    • Preventing Child Abuse & Neglect
    • Responding to Child Abuse & Neglect
    • Supporting & Preserving Families
    • Out-of-Home Care
    • Achieving & Maintaining Permanency
    • Adoption
    • Management & Supervision
    • Systemwide
  • National Initiatives
    • National Adoption Month
    • National Child Abuse Prevention Month
    • National Foster Care Month
  • Publications
    • Publications Series
    • Browse by Title
    • Browse by Topic
    • Índice de Títulos en Español
  • Library
    • Search the Library
  • State Resources
    • State Statutes
    • National Foster Care & Adoption Directory
    • State Guides & Manuals
    • State Related Organizations Lists
    • Adoption Assistance by State
  • More Tools & Resources
    • Related Organizations
    • Learning Center
    • Children's Bureau Resources
    • Information Gateway Podcast
    • Multimedia
    • Family Engagement Inventory
  • NEWS AND EVENTS
    • New on Information Gateway
    • New From the Children's Bureau
    • Event Calendar
  • ABOUT US
    • How to Report Child Abuse or Neglect
    • Find Help With a Personal Situation
    • Frequently Asked Questions
    • Glossary
    • Search A to Z
  • Contact Us
    • 1-800-394-3366
    • info@childwelfare.gov
    • Subscribe to Free Updates
    • Chat With Us
  • Follow us on Facebook
  • Follow us on Twitter
  • Follow us on YouTube
  • POLICIES & HELPFUL LINKS
    • Disclaimer and Policies
    • Privacy Policy
    • Accessibility
    • FOIA requests
    • No FEAR Act data
    • Office of the Inspector General
    • Performance reports
    • Vulnerability Disclosure Policy
    • USA.gov
    • Download Acrobat Reader
  • ↑ Back to top