Evaluation Methods:

This evaluation was a quasi-experimental cross-sectional study where PCMM participants took a baseline survey at their program site in November 2017, and electronically from their homes in November 2020 (due to the COVID-19 pandemic). The survey included questions from the Kentucky Youth Risk Behavior Surveillance Survey (YRBSS), Kutcher Adolescent Depression Scale (KADS), and The Child and Youth Resilience Measure, and all data from 2017 and 2020 were analyzed by IBM SPSS Statistics (Version 27.0). Survey focus areas were: violence and victimization, substance use/misuse, health and nutrition, and sexual risk behaviors. 

Evaluation Type: Quasi-experimental

Summary of Outcomes:

Researchers found several statistically significant conclusions among PCMM participants after comparing the baseline and follow-up surveys: 22.1 percent of participants reported a decrease in carrying weapons and 13.7 percent fewer participants reported drinking alcohol. Decreases were also seen in participants reporting nicotine vaping and cigarette use, although statistically insignificant (decreases of 6.5 and 2.9 percentage points, respectively).

Incidents of cyberbullying (also called online victimization) decreased significantly between survey administration: down from 25.74 percent to 21.94 percent. Participants reported a nearly significant difference in resilience on The Child and Youth Resilience Measure questions in the survey, from a 67.49 percent to a 74.31 percent (a 6.82 percent increase) due to the resources and assistance participants received from PCMM. Less positive findings include that the follow-up survey showed lower levels of depression, a decrease from 8.43 down to 6.92 on the Kutcher Adolescent Depression Scale (KADS); however, the KADS threshold for probable depression is 6 and above. Additionally, marijuana use increased from 7.2 percent to 12.5 percent (a 5.3 percent growth) from 2017 to 2020.

The study included context around the COVID-19 pandemic to further explain these outcomes. For instance, the over 20 percent decrease in carrying weapons could be partially attributed to the differences in socialization in the pandemic lockdown, as youth were home more often and less likely to be interacting with their peers in person. The decrease in nicotine vaping is related to a decrease in availability, including vaping shop closures in the pandemic, and requirements to purchase e-cigarettes with age verification, while alcohol and marijuana remained more easily accessible to youth. However, the authors of study note that PCMM participants’ resilience was higher due to PCMM mentors and staff providing them with support and resources to help in this area, which the authors also posit may explain why  PCMM participants’ levels of depression decreased. Researchers attributed that depression dropped from baseline to follow-up (8.43 down to 6.92) due to the services and mentorship support offered by PCMM, but stayed above 6 as a result of the social isolation and related stresses of the COVID-19 pandemic