Understanding the Role of Quantitative Methods in a Culturally Competent Approach to Evaluation

Prior research has discussed the need for an inquiry into if and how quantitative methods can help evaluators better respond to and engage with culture (Chouinard and Cousins, 2009). Part One addresses this topic through illustrating findings from a review and synthesis conducted across 110 evaluation cases demonstrating culturally competent approaches. Findings discuss the predominant purposes and challenges with integrating quantitative methods with culturally competent approaches. Furthermore, findings highlight key themes for aligning quantitative practices with culturally competent approaches.
Part Two of this presentation provides an example of an evaluation that used quantitative methods in conjunction with a culturally competent approach. Specifically, Part Two outlines the Bear Assessment System process for creating, validating, and calibrating quantitative measures in a manner that complements a culturally competent evaluation approach. This process is explained through reflecting on the case of UC Berkeley’s Athletic Study Center evaluation in which quantitative measures of “sense of belonging” and “self-reliance” were created for both formative and summative purposes. Additionally, Part Two explains how the pre/post survey analysis, conducted via the Latent Growth Item Response Model, demonstrated both statistical rigor and cultural competence.

Laura Pryor is a Senior Associate at Social Policy Research Associates with expertise in culturally responsive evaluation, survey design and analysis, quantitative research methods, and formative and summative evaluation designs. She began her evaluation career in 2011 as an American Evaluation Association Graduate Education Diversity Intern and has since worked on numerous evaluations focusing on K-12 education, youth development, offender reentry, and higher education. Dr. Pryor received a PhD in Quantitative Methods and Evaluation from UC Berkeley's Graduate School of Education. Her doctoral research focused on the ways in which quantitative methods can align with a culturally competent approach to evaluation. Additionally, she received an MA in Urban and Regional Planning from the University of California, Los Angeles, and a BA in Urban Studies from the University of California, Berkeley.

Tuesday, April 17, 2018 - 2:00pm
PDF icon Pryor Presentation Pt 11.48 MB
PDF icon Pryor Presentation Pt 21.7 MB