142nd APHA Annual Meeting and Exposition

Home Events & Meetings Annual Meeting Schedule & Program

Online Program

Annual Meeting Recordings are now available for purchase

312328
Lessons learned after one year of a school-based randomized control trial evaluation of a positive youth development program: Successes, challenges, and solutions

142nd APHA Annual Meeting and Exposition (November 15 - November 19, 2014): http://www.apha.org/events-and-meetings/annual
Monday, November 17, 2014 : 9:10 AM - 9:30 AM

Ashley Singleton, MPH , Department of Community and Family Health, College of Public Health, University of South Florida, Tampa, FL
Eric R. Buhi, MPH, PhD , Department of Community and Family Health, College of Public Health, University of South Florida, Tampa, FL
Stephanie L. Marhefka, PhD , Department of Community and Family Health, College of Public Health, University of South Florida, Tampa, FL
Ellen Daley, PhD , Department of Community and Family Health, College of Public Health, University of South Florida, Tampa, FL
Shireen Noble, BASc , Department of Community and Family Health, College of Public Health, University of South Florida, Tampa, FL
Cameron Chambers , Department of Community and Family Health, University of South Florida, Tampa, FL
Objective: The purpose of this presentation is to discuss the successes, challenges, solutions, and lessons learned by the Teen Outreach Program (TOP) Evaluation Team, after one year conducting a school-based randomized controlled trial evaluation of the TOP.

Methods: Through a partnership between an evaluation team at the University of South Florida and the Florida Department of Health, 28 high schools in 12 non-metropolitan Florida counties participated in this project. Responsibilities of the evaluation team included conducting pre- and post-intervention surveys, in addition to 1 and 2 year follow-ups. The first year included 3989 youth, despite challenges related to a complex research design, sensitive nature of the topic (e.g., sexual behavior), and working with multiple school districts.

Results: Success was achieved through use of a passive parental permission (opt-out) process, allowing for inclusion of greater numbers of youth (which can lead to better external validity). Challenges included misunderstanding of survey questions and missing data, and procedures were adapted to help combat that loss. An early partnership with the DOH provided credibility to the evaluation project with school districts. Finally, issues have arisen around school attrition, but those issues have been addressed through better communication with school administrators.

Conclusion: Being able to adapt to the unique needs of each school is essential, and creating personal relationships with school personnel to proactively deal with issues as they arise helps reduce problems. Finally, the opt-out permission process can be used to increase survey participation.

Learning Areas:

Conduct evaluation related to programs, research, and other areas of practice

Learning Objectives:
Discuss potential challenges that may arise as a result of creating partnerships between community agencies and organizations, universities, public schools and school districts. Assess challenges that may occur implementing a school-based evaluation and define plausible solutions to further support research and community/university partnerships.

Keyword(s): Adolescents, Community-Based Partnership & Collaboration

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I serve as the Project Coordinator for this RCT evaluation which is implemented in 28 Florida high schools and funded ($2.5 million) by the U.S. Office of Adolescent Health
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.

Back to: 3073.0: Violence and bullying: School programs and policies