Program Profile: Success for Kids

This was an afterschool program intended to build children’s resilience and positive connections. The program is rated Promising. Treatment group children demonstrated greater adaptive skills and lower rates of behavioral problems, school problems, attention problems, and externalizing problems, compared with children in the control group. These differences were all statistically significant. However, there was no statistically significant difference in depression.

A Promising rating implies that implementing the program may result in the intended outcome(s).

This program's rating is based on evidence that includes either 1) one study conducted in multiple sites; or 2) two or three studies, each conducted at a different site. Learn about how we make the multisite determination.

A Promising rating implies that implementing the program may result in the intended outcome(s).

This program's rating is based on evidence that includes either 1) one study conducted in multiple sites; or 2) two or three studies, each conducted at a different site. Learn about how we make the multisite determination.

Program Goals

Success for Kids (SFK) was an afterschool program that sought to build resilience in children by teaching them to access inner resources and build positive connections with others. The programs goals of the SFK curriculum were:

• To increase children’s sense of empowerment about their ability to influence their future
• To provide the knowledge, attitudes, and skills needed to make positive choices
• To increase caring and empathy
• To improve the quality of family interaction, including communication, doing activities together, sharing, and asking permission
• To increase happiness

Target Population/Program Theory

The curriculum was geared toward children ages 6 to 14, and targeted kids living in lower-income communities and those challenged by poor school performance, crime, and lack of community services (though none of these factors is a requirement for participation). The program theory underlying SFK is that resilience, or the ability to overcome adverse circumstances in daily life, is a universal quality rather than a quality that only some children possess. The curriculum focused on four areas of personal strength: social competence, problem solving, autonomy or self-efficacy, and the sense of purpose.

Program Activities

The level-1 SFK course (called The Game of Life) consisted of ten 90-minute lessons that are typically run over a 10-week period. The course was built on the analogy that, as in a game, the challenges we overcome in life bring a sense of achievement. Children were taught they can “win the game” and realize their potential when they follow the “rules,” which include making an effort, caring for others, and making responsible choices. The 10 lesson plans were:

1. What Do We Want?
2. Making Choices
3. Making an Effort
4. Caring for Others
5. Feelings and Behavior
6. Sharing
7. We Are All Connected
8. Cause and Effect
9. Telling People You Care
10. Review and Graduation

The course was experiential in nature, using teaching methods that include stories, puppets, music, performance, and hands-on activities to address auditory, kinesthetic, and visual learning styles. All topic areas taught in the SFK curriculum were continually reinforced within a lesson and across all subsequent lessons in the course.

Study

The Success for Kids (SFK) curriculum was evaluated by Maestas and Gaillot (2010) using a combination of experimental and quasi-experimental research designs. During late 2006, the SFK program was rapidly expanding across different afterschool programs in southeast Florida. This allowed the study authors to randomly assign 19 participating afterschool program sites to immediate implementation of SFK programming and delayed implementation after an approximately 12-week waiting period. This setup is similar to using a waitlist control group design. During the waiting period, the delayed-implementation sites formed a control group for the immediate intervention sites.

There were three groups of sites that implemented the SFK curriculum throughout the study period. In fall 2006, group 1 and group 2 entered the study. Group 1 received SFK immediately; programming for group 2 was delayed until winter 2006–07. However, both groups were tested in fall 2006 and winter 2006–07. During these times, group 1 received pretests and posttests as a treatment group and group 2 received pretests and posttests as the control group. Then in winter 2006–07, group 2 switched from control-group status to treatment-group status; subsequently, the group’s posttest simultaneously became its treatment-group pretest. Group 2’s posttest as a treatment group was administered in spring 2007, while group 1 received a follow-up test. Group 3 then entered the study in winter 2006–07, first as the control group, and then switched to the treatment-group status in spring 2007. The pretest for group 3 as a control group was administered in winter 2006–07. When group 3 served as a control group, the posttest was delivered in spring 2007. This posttest simultaneously worked as the pretest for group 3 when they became a treatment group. The posttest to group 3 as a treatment group was administered in summer 2007, when group 2 also received a follow-up test. The study ended in summer 2007, so no follow-up data was collected for group 3.

During analysis of the data, all of the treatment-group observations and all control-group observations were pooled together. This combined the experimental variations (induced by randomization) with quasi-experimental variations. This was done because preliminary analyses revealed that randomization did not sufficiently balance the covariates across treatment and control groups, meaning there were significant group differences despite the random assignment of receiving immediate or delayed programming. This may have been due to the fact that randomization was done over a small number of units (19 program sites) drawn from demographically heterogeneous neighborhoods, and such group differences tend to “average out” as the number of randomization units increases.

To address the issues that arose with the randomization process, the research design was reconceptualized as a longitudinal study, because repeated measures were available. By letting the control sites in groups 2 and 3 also contribute treatment observations, the authors were able to pool all treatment and control observations and use site-level fixed effects, which effectively let group 2 and 3 sites act as control groups for themselves. This means that children in groups 2 and 3 enter the study once as control children and again as treatment children, which helps minimize observed and unobserved differences between the groups. The experimental variation is still present to a certain degree, because group 1 (which never acted as a control group) is retained in the treatment group.

All measurements were taken using the Behavior Assessment System for Children, Second Edition (BASC–2), which is a multimethod, multidimensional system used to evaluate the behavior and self-perceptions of children and young adults. It consists of two scales, one for teachers and one for children. The BASC–2 individual scales are adaptability, aggression, anxiety, attention problems, atypicality, conduct problems, depression, functional communication, hyperactivity, leadership, learning problems, social skills, somatization, study skills, and withdrawal. Composite scales (groupings of individual scales) are adaptive skills, behavioral symptoms index, externalizing problems, internalizing problems, and school problems. The BASC–2 scales may be classified as two types: clinical scales (measuring negative outcomes) and adaptive scales (measuring positive outcomes).

There were 19 program sites that participated in the study from various cities across southeast Florida, including Miami, Hialeah Gardens, Davie, Boynton Beach, Lauderhill, Delray Bach, Fort Lauderdale, Palm Beach, Pompano Beach, and Opa Locka. However, the participating sites were a heterogeneous group. For example, the racial and ethnic composition of all program sites were predominately white, African American, and Latino; however, the percent breakdown of each group differed depending on the city. For instance, in Davie, participating children were approximately 90.6 percent white, 4.5 percent African American, and 17.4 percent Latino (racial and ethnic categories were not mutually exclusive, which is why percentages do not total to 100). But in Pompano Beach, students were 54.7 percent white, 41.2 percent African American, and 11.9 percent Latino. Logistic regression of pretests of teachers’ reports showed that there were significant differences between the treatment and control groups. The treatment group children tended to come from relatively disadvantaged neighborhoods, with higher crime rates and higher percentages of both whites and blacks than other racial and ethnic groups. However, there were no significant differences between the treatment and control groups in the average standardized-test scores, gender of study children, and the availability of other types of programming at the sites. There also was no statistically significant difference between groups on 14 of the 15 BASC–2 behavioral scales.

A total of 737 children were enrolled in the study. Of these, teachers completed questionnaires for 89 percent of enrolled children, while 53 percent of children completed the self-report questionnaire. Attrition rates for teachers participating in the study were 22 percent for the treatment group and 19 percent in the control group, which was not a significant difference. For children, the attrition rates were significantly higher in the treatment group (40 percent) than in the control group (26 percent). However, the attrition rate in the treatment group climbed dramatically between the posttest and follow-up test (57 percent in the teacher sample and 66 percent in the child sample). Since pretest and follow-up test differences for the treatment group was compared with pretest and posttest differences for the control group (there were no follow-up tests administered to the control groups), the very different attrition rates for the two groups under comparison indicates that very different attrition processes were likely at play. Regression analysis revealed no differences between the groups in baseline behavioral scores, but there were very significant differences in neighborhood demographic characteristics and availability of alternative programming. The site-level differences can be accounted for with site-level fixed effects; however, the follow-up results should be interpreted as only suggestive, since the underlying experimental variation was flawed. The study authors did not conduct subgroup analyses.

These sources were used in the development of the program profile:

Following are CrimeSolutions-rated programs that are related to this practice:

After-School Programs

After-school programs generally take place during after school hours and are designed decrease the amount of time youth are unsupervised. Examples of such programs may include recreation-based activities, mentoring, and tutoring services. The practice is rated Promising for child self-perceptions, school bonding, school grades, positive social behaviors, problem behaviors, readings scores, and mathematics scores and Ineffective for delinquency, drug use, and school attendance.

Evidence Ratings for Outcomes

	Education - Math Achievement
	Attitudes & Beliefs - Child Self-Perceptions
	Education - School Bonding
	Mental Health & Behavioral Health - Social Behaviors
	Mental Health & Behavioral Health - Externalizing behavior
	Education - Reading Achievement
	Education - Academic achievement/school performance
	Crime & Delinquency - Multiple crime/offense types
	Drugs & Substance Abuse - Multiple substances
	Education - Attendance/truancy

Why might a practice's outcome ratings differ from the ratings of specific programs encompassed by that practice?