Gold Standard Quantitative Social Science Research:
- Based on large samples (e.g., thousands of participants) thus, there is sufficient statistical power to conduct high confidence comparisons between groups.
- Nationally representative samples thus can be generalized to the broader U.S. population.
- Examines (and/or control for) many different factors/variables (often 10+) thus provides a broad picture of “what is going on.”
- Longitudinal method allowing comparison of measures across time to establish causality.
Two key limitations of this research include the realities that it:
1) Is often limited to reports from one person per family (Handel, 1996).
2) Is often limited to survey responses without fielding participants’ in-depth verbal responses, contextualizing comments, narratives, or explanations.
Most Qualitative Family Research:
- Based on small samples of fewer than 30 participants.
- Based on racially and culturally homogenous samples without comparison groups (e.g., white Jewish women; see Davidman, 1991; Kaufman, 1993).
- Conducted within a limited cultural/geographic area, based on researcher convenience.
- Involves only one participant per family (Handel, 1996).
- Conducted primarily or solely by one or two researchers, whose biases go unchecked [see Marks (2015) for criticism of the “sole scholar” or “monk/nun in a cell” approach to qualitative research].
Two key limitations of this research include the realities that it:
- Often provides unique depth—but is limited by constrained sample size, limited scope, and questionable applicability.
- Further, the above limitations leave most qualitative studies vulnerable to criticisms regarding validity, reliability, and replicability.
The American Families of Faith Qualitative Research Project:
- Based on a sample of 476 participants from 200 families collected through a replicable sampling strategy (recommendations from religious gatekeepers).
- Heterogeneous sample characterized by: 2A) Rich racial/ethnic diversity (50%+ of the sample); including African American, Asian American, Latino, Native American, Middle Eastern, East Indian, and Pacific Islander families. 2B) Religious diversity (more than 20 Christian, Jewish, and Muslim denominations) 2C) Socio-economic diversity (educational experience ranged from GED-PhD/MD)
- Based on a national (although not nationally representative) sample that includes participants from 17 states in all eight religio-cultural regions of the United States (see Silk & Walsh, 2009).
- Includes in-depth, interview-based questioning of multiple participants per family [mother, father, child(ren)], consistent with Handel’s (1996) call for true “family” research.
- Involved 100+ diverse researchers/coders to provide data audit trails, checks, balances, and inter-rater reliability for reported themes (see Marks, 2015 for discussion).
- Face-to-face, in-depth interviews (2-4 hours) in the homes and worship places of families (as opposed to phone or online interviews).
- The sample consists of “exemplars” of both religious involvement and family strength achieved by inviting religious gate-keepers to recommend known exemplars.
- “Trans-Historical” in that data collection occurred from 2001-2015 Sample not limited by historical events such as 9-11, the housing collapse of 2008, natural disasters (e.g., hurricanes Katrina and Rita), and the presidential elections of 2004, 2008, and 2012.)
References
Davidman, L. (1993). Tradition in a rootless world: Women turn to Orthodox Judaism. Berkeley, CA: University of California Press.
Handel, G. (1996). Family worlds and qualitative family research. Marriage and Family Review, 24, 335-48.
Kaufman, D.R. (1991). Rachel’s daughters: Newly Orthodox Jewish women. New Brunswick, NJ: Rutgers.
Marks, L. D. (2015). A pragmatic, step-by-step guide for qualitative methods: Capturing the disaster and long-term recovery stories of Katrina and Rita. Curr Psychol, 34, 494-505. doi:10.1007/s12144-015-9342-x
Silk, M., & Walsh, A. (2011). One nation, divisible: How regional religious differences shape American politics (Religion by Region series, vol. 9). Lanham, MD: Rowman & Littlefield.