Use of a Systematic 3-Pronged Evaluation to Measure, Monitor, and Test Fidelity of the 5-State iCook 4-H Program
Objective: A 3-pronged approach to evaluation was utilized to measure change (Program Evaluation [PE]), monitor feedback (Process Evaluation), and test Fidelity of Implementation (FOI). Family dyads (youth aged 9-10 and adult food preparer) participated in an intervention promoting the focal areas of culinary skills, family meals, physical activity, and goal setting. The online PE tool (questions: youth=34; adult=15) was developed to measure change in focal areas and completed at pre and post-test. Following sessions, dyads and leaders completed online process surveys (questions: youth=13; adult=21; leader=11) giving feedback on sessions and at home activities. At each session FOI (32 questions) was measured. Treatment youth increased PE scores (P<0.05). Treatment adults reported increases in family meals (P<0.05) and youth involvement in meals (P<0.05). Dyads reported more cooking, eating and playing together as the program progressed. Adults reported child's culinary skills were enhanced at each session. FOI evaluators reported session objectives were met 91% and focal areas were covered 90% of time. Dyads, leaders, and evaluators reported iCook was valuable in promoting positive learning. Using a systematic approach to design and implement evaluation tools resulted in evidence-based outcomes to measure program impact.
The FASEB Journal
Abstract Number: 395.8
Mathews, D; Franzen-Castle, Lisa; Kattelmann, Kendra; Colby, Sarah E.; Olfert, Melissa D.; and White, Adrienne A., "Use of a Systematic 3-Pronged Evaluation to Measure, Monitor, and Test Fidelity of the 5-State iCook 4-H Program" (2015). Health and Nutritional Sciences Faculty Publications. 270.