The Fundamental Difference Between Qualitative and Quantitative Data in Mixed Methods Research
DOI:
https://doi.org/10.17169/fqs-24.1.3986Keywords:
mixed methods research, qualitative data, quantitative data, hybrid data, quantitizing, mixed dataset, qualitative data analysis, quantitative data analysis, mixed data analysis, case comparison tableAbstract
Mixed methods research is commonly defined as the combination and integration of qualitative and quantitative data. However, defining these two data types has proven difficult. In this article, I argue that qualitative and quantitative data are fundamentally different, and this difference is not about words and numbers but about condensation and structure. As qualitative data are analyzed with qualitative methods and quantitative data with quantitative methods, we cannot analyze one type of data with the other type of method. Quantitative data analysis can reveal new patterns, but these are always related to the existing variables, whereas qualitative data analysis can reveal new aspects that are hidden in the data. To consider data as quantitative or qualitative, we should judge these data as end products, not in terms of the process through which they come into being. Thus, quantitizing qualitative data results in quantitative data and the analysis thereof is quantitative, not mixed, data analysis. For mixed data analysis, both real, non-quantitized qualitative data and quantitative data are needed. As these quantitative data may be quantitized qualitative data, the implication is that, contrary to a common view, mixed methods research does not necessarily involve quantitative data collection.
Downloads
References
Bazeley, Pat (2018a). "Mixed methods in my bones": Transcending the qualitative-quantitative divide. International Journal of Multiple Research Approaches, 10(1), 334-341,
Bazeley, Pat (2018b). Integrating analyses in mixed methods research. Los Angeles, CA: Sage.
Bergman, Manfred M. (2008). The strawmen of the qualitative-quantitative divide and their influence on mixed methods research. In Manfred M. Bergman (Ed.), Advances in mixed methods research (pp.11-21). Los Angeles, CA: Sage.
Bernard, H. Russell (1996). Qualitative data, quantitative analysis. CAM Journal, 8(1), 9-11.
Brewer, John & Hunter, Albert (1989). Multimethod research: A synthesis of styles. Thousand Oaks, CA: Sage.
Bryman, Alan (2006). Integrating quantitative and qualitative research: How is it done?. Qualitative Research, 6(1), 97-113.
Bryman, Alan (2008). Why do researchers integrate/combine/mesh/blend/mix/merge/fuse quantitative and qualitative research?. In Manfred M. Bergman (Ed.), Advances in mixed methods research (pp.87-100). Los Angeles, CA: Sage.
Caracelli, Valerie J. & Greene, Jennifer C. (1993). Data analysis strategies for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 15(2), 195-207.
Combs, Julie P. & Onwuegbuzie, Anthony J. (2010). Describing and illustrating data analysis in mixed research. International Journal of Education, 2(2), E13, https://doi.org/10.5296/ije.v2i2.526 [Accessed: October 22, 2022].
Creswell, John W. & Plano Clark, Vicki L. (2018). Designing and conducting mixed methods research. Los Angeles, CA: Sage.
De Allegri, Manuela; Brenner, Stephan; Kambala, Christabel; Mazalale, Jacob; Muula, Adamson S.; Chinkhumba, Jobiba; Wilhelm, Danielle & Lohmann, Julia (2020). Exploiting the emergent nature of mixed methods designs: Insights from a mixed methods impact evaluation in Malawi. Health Policy and Planning, 35(1), 102-106, https://doi.org/10.1093/heapol/czz126 [Accessed: October 22, 2022].
Field, Andy (2009). Discovering statistics using SPSS. London: Sage.
Fox, Nick J. & Alldred, Pam (2017). Sociology and the new materialism: Theory, research, action. London: Sage.
Gobo, Giampietro; Fielding, Nigel G.; La Rocca, Gevisa & Van der Vaart, Wander (2022). Merged methods: A rationale for full integration. Los Angeles, CA: Sage.
Greene, Jennifer C. (2007). Mixed methods in social inquiry. San Francisco, CA: Jossey-Bass.
Greene, Jennifer C.; Caracelli, Valerie J. & Graham, Wendy F. (1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11(3), 255-274.
Guetterman, Timothy C.; Fetters, Michael D. & Creswell, John W. (2015). Integrating quantitative and qualitative results in health science mixed methods research through joint displays. Annals of Family Medicine, 13(6), 554-561, https://doi.org/10.1370/afm.1865 [Accessed: October 22, 2022].
Hammersley, Martyn (1996). The relationship between qualitative and quantitative research: Paradigm loyalty versus methodological eclecticism. In John T.E. Richardson (Ed.), Handbook of qualitative research methods for psychology and the social sciences (pp.159-174). Leicester: British Psychological Society.
Hitchcock, John H. & Onwuegbuzie, Anthony J. (2020). Developing mixed methods crossover analysis approaches. Journal of Mixed Methods Research, 14(1), 63-83, https://doi.org/10.1177/1558689819841782 [Accessed: October 22, 2022].
Latour, Bruno & Woolgar, Steve (1986). Laboratory life: The construction of scientific knowledge. Princeton, NJ: Princeton University Press.
Lee, Young-Ju & Greene, Jennifer (2007). The predictive validity of an ESL placement test: A mixed methods approach. Journal of Mixed Methods Research, 1(4), 366-389.
Martin, Aryn (2004). Can't any body count? Counting as an epistemic theme in the history of human chromosomes. Social Studies of Science, 34(6), 923-948.
Martin, Aryn & Lynch, Michael (2009). Counting things and people: The practices and politics of counting. Social Problems, 56(2), 243-266.
Maxwell, Joseph A. (2019). Distinguishing between quantitative and qualitative research: A response to Morgan. Journal of Mixed Methods Research, 13(2), 132-137.
Maxwell, Joseph A. (2022). Integration in mixed methods research: An alternative perspective. In John H. Hitchcock & Anthony J. Onwuegbuzie (Eds.), The Routledge handbook for advancing integration in mixed methods research (pp.86-93). London: Routledge.
Mertens, Donna M.; Bazeley, Pat; Bowleg, Lisa; Fielding, Nigel; Maxwell, Joseph; Molina-Azorin, Jose F. & Niglas, Katrin (2016). The future of mixed methods: A five year projection to 2020. https://mmira.wildapricot.org/resources/Documents/MMIRA%20task%20force%20report%20Jan2016%20final.pdf [Accessed: October 22, 2022].
Miles, Matthew B. & Huberman, Alan M. (1994). Qualitative data analysis: An expanded sourcebook. Thousand Oaks, CA: Sage.
Morgan, David L. (2018). Living within blurry boundaries: The value of distinguishing between qualitative and quantitative research. Journal of Mixed Methods Research, 12(3), 268-279.
Newman, Isadore; Ridenour, Carolyn S.; Newman, Carole & DeMarco, George Mario Paul, Jr. (2003). A typology of research purposes and its relationship to mixed methods research. In Abbas Tashakkori & Charles Teddlie (Eds.), Handbook of mixed methods in social & behavioral research (pp.167-188). Thousand Oaks, CA: Sage.
Nzabonimpa, Jean P. (2018). Quantitizing and qualitizing (im-)possibilities in mixed methods research. Methodological Innovations, 11(2), https://doi.org/10.1177/2059799118789021 [Accessed: October 22, 2022].
Onwuegbuzie, Anthony J. & Johnson, R. Burke (2021). Mapping the emerging landscape of mixed analysis. In Anthony J. Onwuegbuzie & R. Burke Johnson (Eds.), The Routledge reviewer's guide to mixed methods analysis (pp.1-22). New York, NY: Routledge.
Onwuegbuzie, Anthony J. & Leech, Nancy L. (2019). On qualitizing. International Journal of Multiple Research Approaches, 11(2), 98-131.
Ragin, Charles C. (1997). Turning the tables: How case-oriented research challenges variable-oriented research. Comparative Social Research, 16, 27-42.
Ragin, Charles C. (2000). Fuzzy-set social science. Chicago, IL: University of Chicago Press.
Rihoux, Benoît; Álamos-Concha, Priscilla & Lobe, Bojana (2021). Qualitative comparative analysis (QCA): An integrative approach suited for diverse mixed methods and multimethod research strategies. In Anthony J. Onwuegbuzie & R. Burke Johnson (Eds.), The Routledge reviewer's guide to mixed methods analysis (pp.185-197). New York, NY: Routledge.
Sandelowski, Margarete (2014). Unmixing mixed-methods research. Research in Nursing & Health, 37(1), 3-8, https://doi.org/10.1002/nur.21570 [Accessed: October 22, 2022].
Sandelowski, Margarete; Voils, Corrine I. & Knafl, George (2009). On quantitizing. Journal of Mixed Methods Research, 3(3), 208-222.
Schadler, Cornelia (2019). Enactments of a new materialist ethnography: Methodological framework and research processes. Qualitative Research, 19(2), 215-230.
Schoonenboom, Judith (2023). Mixed methods and multimethod research in education: Six design decisions for collecting, combining, and developing datasets. In Robert J. Tierney, Fazal Rizvi & Kadriye Ercikan (Eds.), International encyclopedia of education: Vol. 12. Qualitative, multimethod, and mixed methods research (pp.361-371). Amsterdam: Elsevier.
Schoonenboom, Judith & Johnson, R. Burke (2021). The case comparison table: A joint display for constructing and sorting simple tables as mixed analysis. In Anthony J. Onwuegbuzie & R. Burke Johnson (Eds.), The Routledge reviewer's guide to mixed methods analysis (pp.277-288). New York, NY: Routledge, https://doi.org/10.4324/9780203729434-24 [Accessed: October 22, 2022].
Shaw, Eric K.; Ohman-Strickland, Pamela A.; Piasecki, Alicja; Hudson, Shawna V.; Ferrante, Jeanne M.; McDaniel, Reuben R., Jr.; Nutting, Paul A. & Crabtree, Benjamin F. (2013). Effects of facilitated team meetings and learning collaboratives on colorectal cancer screening rates in primary care practices: A cluster randomized trial. Annals of Family Medicine, 11(3), 220-228, https://doi.org/10.1370/afm.1505 [Accessed: October 22, 2022].
Small, Mario Luis (2011). How to conduct a mixed methods study: Recent trends in a rapidly growing literature. Annual Review of Sociology, 37(1), 57-86.
Suerdem, Ahmet (2021). Multidimensional scaling of qualitative data. In Anthony J. Onwuegbuzie & R. Burke Johnson (Eds.), The Routledge reviewer's guide to mixed methods analysis (pp.45-56). New York, NY: Routledge.
Tashakkori, Abbas M.; Johnson, R. Burke & Teddlie, Charles B. (2021). Foundations of mixed methods research. Los Angeles, CA: Sage.
Uprichard, Emma & Dawney, Leila (2019). Data diffraction: Challenging data integration in mixed methods research. Journal of Mixed Methods Research, 13(1), 19-32, https://doi.org/10.1177/1558689816674650 [Accessed: October 22, 2022].
Van Haneghan, James (2021). Exploratory factor analysis of text. In Anthony J. Onwuegbuzie & R. Burke Johnson (Eds.), The Routledge reviewer's guide to mixed methods analysis (pp.25-36). New York, NY: Routledge.
Vis, Barbara (2011). Under which conditions does spending on active labor market policies increase? An fsQCA analysis of 53 governments between 1985 and 2003. European Political Science Review, 3(2), 229-252.
Vis, Barbara (2012). The comparative advantages of fsQCA and regression analysis for moderately large-N analyses. Sociological Methods & Research, 41(1), 168-198.
Visser, Lennart; Korthagen, Fred A.J. & Schoonenboom, Judith (2018). Differences in learning characteristics between students with high, average, and low levels of academic procrastination: Students' views on factors influencing their learning. Frontiers in Psychology, 9(808), https://doi.org/10.3389/fpsyg.2018.00808 [Accessed: October 22, 2022].
Vogl, Susanne (2019). Integrating and consolidating data in mixed methods data analysis: Examples from focus group data with children. Journal of Mixed Methods Research, 13(4), 536-554.
Vogl, Susanne (in press). Data integration as a form of integrated mixed analysis in mixed methods research designs. In Cheryl Poth (Ed.), The Sage handbook of mixed methods research design. London: Sage.
Witt, Harald (2001). Forschungsstrategien bei quantitativer und qualitativer Sozialforschung. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 2(1), Art. 8, https://doi.org/10.17169/fqs-2.1.969 [Accessed: October 22, 2022].
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Judith Schoonenboom
This work is licensed under a Creative Commons Attribution 4.0 International License.
