Developing and validating measures for child welfare agencies to self-monitor fidelity to a child safety intervention

ABSTRACT

Building evidence of effective practice in child welfare requires practitioners and researchers to know the extent to which programs are implemented in order to understand evaluation results. Fidelity monitoring is a critical strategy for ensuring that evidence-based and promising practices are implemented as intended and can be studied in real-world contexts.

This paper addresses challenges to measuring fidelity in child welfare systems and presents an approach taken with one state to define fidelity criteria and measure fidelity to a child safety intervention. Measurement challenges were addressed by using existing documents and case review mechanisms to assess fidelity, and measuring the quality of practitioner judgment using expert reviewers. Validity of fidelity criteria and fidelity review instruments was established through consensus with model developers and local purveyors. Twelve cases were reviewed by a panel of raters to assess inter-rater reliability and discrepancy between local purveyors and model developers.

This participatory and capacity-building method can be replicated and used to develop and embed valid and reliable fidelity monitoring systems in public child welfare to continue to build evidence about what works in child welfare services.

CITATION

Kaye, S., Osteen, P.J. (2011). Developing and validating measures for child welfare agencies to self-monitor fidelity to a child safety intervention. Children and Youth Services Review 33(11), pp. 2146-2151. https://doi.org/10.1016/j.childyouth.2011.06.020

Go to journal article

 

Blog Search