132 Annual Meeting Logo - Go to APHA Meeting Page  
APHA Logo - Go to APHA Home Page

State Plan Index (SPI): A new evaluation tool for assessing state-level plans

Frances D. Butterfoss, PhD1, Diane O. Dunet, MPA, PhD2, Robin Hamre, RD, MPH3, and Sarah Kuester, MS, RD2. (1) Health Promotion/Disease Prevention, Center for Pediatric Research, Eastern Virginia Medical School, 855 W. Brambleton Ave, Norfolk, VA 23510, 757-668-6429, fbutterf@chkd.com, (2) National Center for Chronic Disease Prevention and Health Promotion, Division of Nutrition and Physical Activity, Centers for Disease Control and Prevention, 4770 Buford Highway NE, Mail Stop K-26, Atlanta, GA 30341-3719, (3) Division of Nutrition and Physical Activity, Centers for Disease Control and Prevention, 4770 Buford Highway, NE MS K-46, Atlanta, GA 30341

Background: State planning activities for chronic disease prevention engage considerable resources and assume that better plans will result in better health outcomes. Evaluation of the relationship of public health planning to health outcomes has been limited by the lack of instruments to objectively assess the quality of state plans. Methods: The SPI is a 9-component, 60-item instrument to assess quality of state obesity prevention plans and is based on public health theory, practice, testing and the expert opinion of federal, state, and academic partners. An iterative, participatory process was used to engage stakeholders in developing and testing the instrument. Two rounds of field testing with 19 raters and 10 state plans were conducted to test and refine the instrument. Results: Pilot testers indicated the instrument was easy to use and helped them to distinguish quality among plans. Mean component scores for the 10 state plans ranged from 0.2 to 4.8. Inter-rater reliability was acceptable; inter-class correlations averaged 0.57 (median=0.61). Cronbach alpha scores ranged from .80 -.90. Correlations between raters’ component and overall scores were statistically significant (p<.01), except for one component. Discussion: The SPI is a well-grounded and reliable instrument, adaptable for various chronic diseases. Since the SPI was created by practitioners and researchers, buy-in and acceptance is high. Conclusion: The SPI is useful for evaluating plan quality and as a framework for plan development. Long term, the SPI can be used to assess the relationship of state planning activities to long-term health outcomes.

Learning Objectives: At the end of this session, participants will be able to

Keywords: Quality Assurance, Chronic Diseases

Presenting author's disclosure statement:
Organization/institution whose products or services will be discussed: Centers for Disease Control and Prevention, Division of Nutrition and Physical Activity
I have a significant financial interest/arrangement or affiliation with any organization/institution whose products or services are being discussed in this session.
Relationship: ORISE Fellowship with the Cneters for Dissease Control and Prevention to develop the SPI instrument

Outcome-based Evaluations Of Innovative Programs in Planning, Policy Development, or Service Delivery

The 132nd Annual Meeting (November 6-10, 2004) of APHA