FIRST 5 Santa Clara County FY 2006-07 Annual Report 

PART B: COUNTY EVALUATION SUMMARY 

a. 
Evaluation Activities Completed 
Evaluation activities during FY 2006-07 built a foundation to systematically measure how the 
FIRST 5 system of care (launched in November 2006) impacts children and families, programs, 
and system changes. A large focus was initially centered on the development and implementation 
of FIRST 5’s revised evaluation framework. Using a participatory approach, FIRST 5’s 
evaluation contractor, SRI International, met individually with all grantees to collaboratively 
formulate logic models, review outcomes and indicators, and discuss practical and cultural 
proficiency of data collection procedures. Concurrently, system-wide evaluation planning 
meetings were convened to develop a revised evaluation framework, including: prioritization of 
client-level and system-level indicators; outcome data tool development; and data management 
systems. Culminating from these activities, in January 2007, a revised two-phased FIRST 5 
Evaluation Framework was approved by the FIRST 5 County Commission. 

Phase I evaluation activities began in January 2007. The emphasis was to strengthen the 
systematic collection of process evaluation data and to begin the collection of client-level 
baseline outcome data. The FY 2006-07 evaluation activities of FIRST 5 included the following: 

• 
IRB/Human Subjects Committee application submission and approval. 
• 
Development of more than 60 individual evaluation plans for external and internal 
programs, and provision of technical assistance for all partners. 
• 
Revision of the FIRST 5 Strategic Plan and School Readiness logic model to align to 
revised evaluation framework. 
• 
Development of Year 1 Priority Indicators and data tools (e.g., participant satisfaction 
surveys, focus group protocols, parenting skills survey, family outcome interviews, and 
screening/assessment summary forms) available in multiple languages (i.e., English, 
Spanish, Vietnamese, and Mandarin) and scannable formats (i.e., TeleForm) 
• 
Training of FIRST 5 and partner staff on the evaluation framework and data tools 
• 
Submission of summarized findings about the format and functionality of internal 
database systems of FIRST 5 grantees and subcontractors 
• 
Development of a longitudinal design, sampling plan, and pilot study plan (to implement 
in FY 2007-08) 
• 
Case study data collection (with three families and service providers over 4 months) 
• 
Submission of collaborative proposals to national conferences and for federal grants 
• 
Production of “Evidence-Based Practices with Children Ages 0-3 and Their Families” 
Report and the Secondary Data Community Indicators 2007 Report 
• 
Conduct of evaluation workshops, trainings, and presentations for key stakeholders. 
b. 
Evaluation Findings Reported 
FIRST 5’s comprehensive evaluation framework documents changes to individuals, programs, 
and the system of care through the collection of quantitative and qualitative data. Since the 
system was launched in winter 2006, and data tools were finalized in spring 2007, preliminary 
satisfaction and outcome data are available from samples of participants. Highlights of 
evaluation findings are described by priority result areas of First 5 California; additional outcome 
data are reported in the School Readiness section and Result Area 4 Systems Change narrative. 

Page 1 


FIRST 5 Santa Clara County FY 2006-07 Annual Report 

Improved Family Functioning/General Parenting Education Programs. Countywide 
since November, 2,742 parents and other family members (86% Latino, 9% Asian, and 5% 
White) attended Parent Workshops, while 2,077 children ages prenatal through 5 participated in 
quality early learning opportunities. Preliminary satisfaction data indicated that respondents 
believed the workshops provided useful information, were delivered with cultural proficiency, 
and would have an impact on their family. In addition parenting skills survey results indicated 
that attendees believed the workshops had increased their use of positive parenting techniques, 
such as praising (39% increased), reading to their child (72% increased), and talking with their 
child (72% increased), while it decreased their use of aversive discipline, such as spanking (72% 
decreased) or scolding (72% decreased). Overall, 94% felt more informed about how to be a 
better parent, and 100% had a clearer understanding of child development. 

Improved Family Functioning/Targeted Intensive Parent Support Services. A total of 
1,631 parents (78% Latino, 8% Asian, and 7% White) and their 1,812 children received FIRST 5 
Family Partner services, the centerpiece of the system of care, which launched in November. 
Preliminary satisfaction data indicated that all respondents rated the family partner services 
highly: 100% indicated that their family partners provided family-centered and culturally-
proficient services, and that the services would have a positive impact on their family. Through 
Family Partner referrals, 398 parents, 328 children, and 205 other family members also received 
Home Visitation services. Satisfaction data indicated that the recipients rated home visitation 
highly: 100% indicated that they believed their home visitors provided family-centered and 
culturally-proficient services, and that the services would have a positive impact on their family. 

Improved Family Functioning/Providing Behavioral, Substance Abuse, and Mental 
Health Services. Through Family Partner referrals, 139 children, 158 parents, and 34 other 
family members also received Therapeutic Services since November 2006. 

Improved Child Development/Preschool for 3 and 4-Year Olds. FIRST 5’s Power of 
Preschool initiative served 575 children (62% Latino; 15% identified with special needs). 

Improved Child Health/Oral Health. In FY 2006-07, 902 children were provided dental 
services, including oral health treatment, screenings, and education on preventing problems. 

FIRST 5 Baseline Outcome Data (April 1 – June 30, 2007) 

Family partners administered intake interviews to 347 participants referred to the FIRST 5 
system of care on or after April 1 through June 30, 2007. Follow-up interviews will be 
administered after every 6 months of active service participation to measure individual-level 
outcomes concerning health, well-being, and school readiness. Preliminary descriptive and 
outcome data for the 347 participants are summarized below. 

Demographics. The mean age of children served was 3.3 years, with 41% of the children 
ages prenatal through 2 years, and about 60% male. More than three quarters were identified as 
Latino, and more than 60% of the families’ primary language was Spanish. The proportion of 
children living in poverty was extremely high: more then three quarters of the families’ annual 
incomes totaled $30,000 or less, with an average of 3 children per household. 

Children’s Health Care and Developmental Competencies. Almost all families (99%) 
reported that their children had health insurance coverage, with most (55%) having Medi-Cal, 
followed by Healthy Families (19%). Approximately half of the families (51%) regularly saw a 
health care provider at a community clinic, and 44% were served by private doctors or HMOs. 

Page 2 


FIRST 5 Santa Clara County FY 2006-07 Annual Report 

Even though 40% of the children had seen a dentist in the past year, another 40% had never seen 
a dentist. Overall, most parents rated their children’s health as good to excellent (97%), but a 
substantial proportion had serious concerns about their children’s speech (21%), behavior (16%), 
and emotional well-being (13%). These concerns were reflected in the developmental screenings 
conducted with the children: 27% of children scored below the typical range in Communication; 
22% in Fine Motor Skills; 20% in Problem-Solving; and 42% in Social-Emotional skills. 

Early Care and Education/Family Literacy. About half of the children ages 3 through 5 
years (53%) were not attending preschool. Most families reported that children were cared for 
daily at home by a family member (39%) or outside the home by a non-family member (30%). 
More than half reported that they regularly read (56%) or told stories (54%) to their children. 

Family Education, Social Support, and Community Connectedness. In terms of formal 
education, about half (48%) of the primary caregivers did not have a high school diploma, about 
one quarter (26%) had a high school diploma or GED, and 18% had some college or technical 
school courses. Parents reported very low ratings of their overall social support; only 11% 
believed they had sufficient support from family and friends, and only 25% felt like they 
belonged to their community. Less than 20% of the parents reported that they knew where to go 
to get community resources and support for their family. 

c. Policy Impact on Evaluation Reports 
Evaluation results were communicated to the FIRST 5 Commission, its stakeholders, and the 
community in a variety of venues. SRI held weekly on-site office hours to maintain consistent 
contact with all partners and staff, to discuss evaluation progress, and to provide technical 
assistance. Routinely, SRI evaluators and Commission staff discussed preliminary analysis of 
process and outcome data, including findings from focus group and evaluation planning 
meetings. The examined data were used to mobilize services and support throughout the county, 
including additional outreach staff in targeted neighborhoods with underserved and underinsured 
families, more Family Partners in PoP sites to increase access to services, and more Program 
Specialists in the Courts to provide information and referrals to families in the legal system. 

In public forums, evaluation results and activities were reported to the FIRST 5 Commission and 
staff through quarterly reports, monthly presentations to the Commission and the Program and 
Evaluation committee, interactive evaluation workshops, and written reports on the evaluation 
framework and findings. The reports and presentations were available as handouts in all venues, 
and they were posted on the FIRST 5 website. Presentation of evaluation data continued to 
support the Commission’s decision to move towards a system of care approach, and to focus 
intensive, evidence-based services in the geographical areas with high cumulative risk. By 
utilizing research and planning from the Power of Preschool Master Plan and the geo-mapping of 
community risk factors, in combination with the successes and lessons learned from early 
initiatives, FIRST 5 and its partners expanded and coordinated a network of services that are 
culturally responsive and appropriate for the children and families in each region of the county. 
FIRST 5 also identified best practice strategies, including a model of quality early learning, 
home visitation, therapeutic interventions, and family support. 

Page 3 


FIRST 5 Santa Clara County FY 2006-07 Annual Report 

2. Submission of Local Evaluation Reports 
FIRST 5 Santa Clara County will submit the 2007 Community Indicators Report and the 
Literature Review on Evidence-Based Practices for Children Ages 0-3 and Their Families. The 
FIRST 5 Santa Clara County Local Evaluation Report will be submitted at a later date. 

Page 4