Mixed Methods in Research on the Psychology of the Internet and Social Media
DOI:
https://doi.org/10.17169/fqs-24.1.4009Keywords:
methodological integration, communities of practice, mixed methods, media psychology, communication, media studies, cultural studies, causality, causality conceptsAbstract
Research on the psychology of the Internet and social media (POISM) is characterized by a heavy methodological compartmentalization. In the current contribution we show empirically that 1. quantitative methods constitute the preferred gold standard of the field's mainstream (favored over qualitative and mixed methods), 2. the field is divided into separate communities of practice (psychology, communication, cultural/media studies), each with their own type of causal claims and associated methods. To show this we content analyze published articles in 2020 across six pertinent POISM journals for instances of quantitative, qualitative, and mixed methods as well as regularity-type versus subjective meaning-type causal logic. We find that regularity-type causal logic is at the center of quantitative research practices in psychology and communication, while qualitative subjective meaning-type causal logic is adopted by scholars in cultural/media studies, with hardly any overlap in between, and only few mixed methods studies. To describe how the research area would profit from mixed methods approaches, we subsequently present a mixed methods study about social media-based integration patterns of Korean and Turkish-heritage individuals in Germany. We conclude by dissolving some of the exclusive stereotyped notions of causality and methods in POISM research and suggest avenues for methodologically more inclusive practices of inquiry.
Downloads
References
Allen, Mike (Ed.). (2017). Introduction. In Mike Allen (Ed.), The Sage encyclopedia of communication research methods. Thousand Oaks, CA: Sage.
Baldassar, Loretta; Nedelcu, Mihaela; Merla, Laura & Wilding, Raelene (2016). ICT-based co-presence in transnational families and communities: Challenging the premise of face-to-face proximity in sustaining relationships. Global Networks, 16(2), 133-144.
Berry, John W. (1997). Immigration, acculturation, and adaption. Applied Psychology: An International Review, 46(1), 5-68.
Boehnke, Klaus; Lietz, Petra; Schreier, Margrit & Wilhelm, Adalbert (2011). Sampling: The selection of cases for culturally comparative psychological research. In David Matsumoto & Fons J.R. van de Vijver (Eds.), Culture and psychology. Cross-cultural research methods in psychology (pp.101-129). New York, NY: Cambridge University Press.
Bowker, Natilene Irain (2001). Understanding online communities through multiple methodologies combined under a postmodern research endeavour. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 2(1), Art.19, https://doi.org/10.17169/fqs-2.1.980 [Accessed: July 13, 2022].
Breuer, Franz (2020). Wissenschaftstheoretische Grundlagen qualitativer Methodik in der Psychologie. In Günter Mey & Katja Mruck (Eds.), Handbuch Qualitative Forschung in der Psychologie (Vol. 1, pp.27-48). Wiesbaden: Springer VS.
Bryman, Alan (2008). The end of the paradigm wars?. In Pertti Alasuutari, Leonard Bickman & Julia Brannen (Eds.), The Sage handbook of social research methods (pp.12-25). London: Sage.
Bucher, Priska & Bonfadelli, Heinz (2007). Mediennutzung von Jugendlichen mit Migrationshintergrund in der Schweiz. In Heinz Bonfadelli & Heinz Moser (Eds.), Medien und Migration: Europa als multikultureller Raum (pp.119-146)? Wiesbaden: VS Verlag für Sozialwissenschaften.
Burkart, Thomas (2020). Qualitatives Experiment. In Günter Mey & Katja Mruck (Eds.), Handbuch Qualitative Forschung in der Psychologie (Vol. 1, pp.41-58). Wiesbaden: Springer VS.
Clark-Gordon, Cathlin V.; Bowman, Nicholas D.; Goodboy, Alan K. & Wright, Alyssa (2019). Anonymity and online self-disclosure: A meta-analysis. Communication Reports, 32(2), 98-111.
Creswell, John W. (1994). Research design: Qualitative and quantitative approaches. Thousand Oaks, CA: Sage.
Creswell, John W. & Plano Clark, Vicki (2017). Designing and conducting mixed methods research. Thousand Oaks, CA: Sage.
Culnan, Mary J. & Markus, M. Lynne (1987). Information technologies. In Frederic M. Jablin, Linda L. Putnam, Karlene H. Roberts & Lyman W. Porter (Eds.), Handbook of organizational communication: An interdisciplinary perspective (pp.420-443). Newbury Park, CA: Sage.
Cupchik, Gerald (2001). Constructivist realism: An ontology that encompasses positivist and constructivist approaches to the social sciences. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 2(1), Art. 7, https://doi.org/10.17169/fqs-2.1.968 [Accessed: July 13, 2022].
Denscombe, Martyn (2008). Communities of practice: A research paradigm for the mixed methods approach. Journal of Mixed Methods Research, 2(3), 270-283.
Deuze, Mark (2020). The role of media and mass communication theory in the global pandemic. Communication Today, 11(2), 4-16.
Dill, Karen E. (Ed.) (2013). The Oxford handbook of media psychology. Oxford, NY: Oxford University Press.
Fetters, Michael D. & Molina-Azorin, José. F. (2017). The Journal of Mixed Methods Research starts a new decade: The mixed methods research integration trilogy and its dimensions. Journal of Mixed Methods Research, 11(3), 291-307.
Fiedler, Klaus; Schott, Malte & Meiser, Thorsten (2011). What mediation analysis can (not) do. Journal of Experimental Social Psychology, 47(6), 1231-1236
Freytag, Anna; Knop-Huelss, Katharina; Meier, Adrian; Reinecke, Leonard; Hefner, Dorothee; Klimmt, Christoph & Vorderer, Peter (2021). Permanently online—always stressed out? The effects of permanent connectedness on stress experiences. Human Communication Research, 47(2), 132-165.
Gackenbach, Jayne (Ed.) (2011). Psychology and the Internet: Intrapersonal, interpersonal, and transpersonal implications. Amsterdam: Elsevier/Academic Press.
George, Andrew L. & Bennett, Alexander (2005). Case studies and theory development in the social sciences. Cambridge, MA: MIT Press.
Glassman, Michael (2016). Educational psychology and the internet. New York, NY: Cambridge University Press.
Gnambs, Timo & Batinic, Bernad (2020). Qualitative Online-Forschung. In Günter Mey & Katja Mruck (Eds.), Handbuch Qualitative Forschung in der Psychologie (Vol. 1, pp.97-112). Wiesbaden: Springer VS.
Goertz, Gary (2016). Multimethod research. Security Studies, 25(1), 3-24.
Goertz, Gary & Mahoney, James (2012). A tale of two cultures: Contrasting qualitative and quantitative paradigms. Princeton, NJ: Princeton University Press.
Goodings, Lewis (2011). The dilemma of closeness and distance: A discursive analysis of wall posting in "MySpace". Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 12(3), Art. 16, https://doi.org/10.17169/fqs-12.3.1576 [Accessed: July 13, 2022].
Groeben, Norbert & Scheele, Brigitte (2020). Das Forschungsprogramm Subjektive Theorien. In Günter Mey & Katja Mruck (Eds.), Handbuch Qualitative Forschung in der Psychologie (Vol. 1, pp.185-202). Wiesbaden: Springer VS.
Groeben, Norbert; Wahl, Diethelm; Schlee, Jörg & Scheele, Brigitte (1988). Das Forschungsprogramm Subjektive Theorien: Eine Einführung in die Psychologie des reflexiven Subjekts. Tübingen: Francke.
Guba, Egon G. & Lincoln, Yvonna S. (1989). Fourth generation evaluation. Thousand Oaks, CA: Sage.
Guest, Greg (2013). Describing mixed methods research: An alternative to typologies. Journal of Mixed Methods Research, 7(2), 141-151.
Hall, Stuart (1980). Cultural studies: Two paradigms. Media, Culture & Society, 2(1), 57-72.
Halloran, James D. (1998). Asking the right questions. In Anders Hansen, Simon Cottle, Ralph Negrine & Chris Newbold (Eds.), Mass communication research methods (pp.9-34). London: Macmillan.
Hansen, Anders & Machin, David (2019). Media and communication research methods. London: Red Globe Press.
Harding, David J. & Seefeldt, Kristin S. (2013). Mixed methods and causal analysis. In Stephen Morgan (Ed.), Handbook of causal analysis for social research (pp.91-110). Dordrecht: Springer.
Hardt, Hanno (1979). Social theories of the press. Early German and American perspectives. Beverly Hills, CA: Sage.
Hatfield, Gary (1995). Remaking the science of mind: Psychology as a natural science. IRCS Technical Reports Series, 159, https://repository.upenn.edu/ircs_reports/159 [Accessed: July 4, 2022].
Hedström, Peter & Swedberg, Richard (1996). Social mechanisms. Acta Sociologica, 39(3), 281-308.
Heger, Katharina & Hoffmann, Chistian P. (2021). Feminism! What is it good for? The role of feminism and political self-efficacy in women's online political participation. Social Science Computer Review, 39(2), 226-244.
Jensen, Klaus Brun (2002). Introduction: The state of convergence in media and communication research. In Klaus Brun Jensen (Ed.), A handbook of media and communication research (pp.1-11). London: Routledge.
Jensen, Klaus Brun (Ed.) (2021a). A handbook of media and communication research. Milton Park: Routledge.
Jensen, Klaus Brun (2021b). The humanistic sources of media and communication research. In Klaus Brun Jensen (Ed.), A handbook of media and communication research (pp.25-53). Milton Park: Routledge.
Jensen, Klaus Brun (2021c). Introduction: The state of convergence in media and communication research. In Klaus Brun Jensen (Ed.), A handbook of media and communication research (pp.1-21). Milton Park: Routledge.
Johnson, R. Burke; Onwuegbuzie, Anthony J. & Turner, Lisa A. (2007). Towards a definition of mixed methods research. Journal of Mixed Methods Research, 1(2), 112-233.
Johnson, Burke R., Russo, Federica & Schoonenboom, Judith (2019). Causation in mixed methods research: The meeting of philosophy, science, and practice. Journal of Mixed Methods Research, 13(2), 143-162.
Kelle, Udo (2001). Sociological explanations between micro and macro and the integration of qualitative and quantitative methods. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 2(1), Art. 5, https://doi.org/10.17169/fqs-2.1.966 [Accessed: July 13, 2022].
Kelle, Udo (2008). Die Integration qualitativer und quantitativer Methoden in der empirischen Sozialforschung. Wiesbaden: VS Verlag für Sozialwissenschaften.
Kuehn, David & Rohlfing, Ingo (2016). Are there really two cultures? A pilot study on the application of qualitative and quantitative methods in political science. European Journal of Political Research, 55(4), 885-905.
Kuhn, Thomas S. (2012 [1962]). The structure of scientific revolutions. Chicago, IL: University of Chicago Press.
Lang, Annie (2013). Discipline in crisis? The shifting paradigm of mass communication research. Communication Theory, 23(1), 10-24.
Lesorogol, Carolyn K. (2005). Experiments and ethnography: Combining methods for better understanding of behavior and change. Current Anthropology, 46(1), 129-136.
Lincoln, Yvonna S. & Guba, Egon G. (1985). Naturalistic inquiry. Thousand Oaks, CA: Sage.
Lindlof, Thomas R. (2009). Qualitative methods. In Robin L. Nabi & Mary Beth Oliver (Eds.), The Sage handbook of media processes and effects (pp.53-66). Los Angeles, CA: Sage.
Maxwell, Joseph A. (2004). Using qualitative methods for causal explanation. Field Methods, 16, 243-264.
Maxwell, Joseph A. (2012). The importance of qualitative research for causal explanation in education. Qualitative Inquiry, 18(8), 655-661.
Maxwell, Joseph A. (2020). The value of qualitative inquiry for public policy. Qualitative Inquiry, 26(2), 177-186.
Maxwell, Joseph A. (2021). Why qualitative methods are necessary for generalization. Qualitative Psychology, 8(1), 111-118.
Maxwell, Joseph A.; Bashook, Philipp G. & Sandlow, Leslie J. (1986). Combining ethnographic and experimental methods in educational research: A case study. In David M. Fetterman & Mary Anne Pitman (Eds.), Educational evaluation: Ethnography in theory, practice, and politics (pp.121-143). Beverly Hills, CA: Sage.
Mayring, Philipp (2001). Combination and integration of qualitative and quantitative analysis. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 2(1), Art. 6, https://doi.org/10.17169/fqs-2.1.967 [Accessed: July 13, 2022].
Mayring, Philipp (2020). Qualitative Forschungsdesigns. In Günter Mey & Katja Mruck (Eds.), Handbuch Qualitative Forschung in der Psychologie (Vol. 1, pp.3-17). Wiesbaden: Springer VS.
McQuail, Denis (2003). Media accountability and freedom of publication. Oxford: Oxford University Press.
McQuail, Denis & Deuze, Mark (2020). McQuail's media and mass communication theory. London: Sage.
Meier, Yannic; Schäwel, Johanna & Krämer, Nicole C. (2021). Between protection and disclosure: Applying the privacy calculus to investigate the intended use of privacy-protecting tools and self-disclosure on different websites. SCM Studies in Communication and Media, 10(3), 283-306, https://doi.org/10.5771/2192-4007-2021-3-283 [Accessed: October 18, 2021].
Mey, Günter & Mruck, Katja (2020). Qualitative Forschung in der Psychologie: Eine Kartierung. In Günter Mey & Katja Mruck (Eds.), Handbuch Qualitative Forschung in der Psychologie (Vol. 2, pp.1-24). Wiesbaden: Springer VS.
Meyen, Michael (2021). The social-scientific sources of media and communication research. In Klaus Brun Jensen (Ed.), A handbook of media and communication research (pp.54-69). Milton Park: Routledge.
Morgan, David L. (2007). Paradigms lost and pragmatism regained: Methodological implications of combining qualitative and quantitative methods. Journal of Mixed Methods Research, 1(1), 48-76.
Morgan, Stephen L. (Ed.). (2013). Handbook of causal analysis for social research. Dordrecht: Springer.
Morley, David (1992). Television, audiences, and cultural studies. New York, NY: Routledge.
Murdock, Graham (2012). Media, culture, and modern times: Social science investigations. In Klaus Brun Jensen (Ed.), A handbook of media and communication research: Qualitative and quantitative methodologies (2nd ed., pp.49-66). London: Routledge.
Nabi, Robin L. & Oliver, Mary Beth (Eds.) (2009). The Sage handbook of media processes and effects. Los Angeles, CA: Sage.
Odağ, Özen & Schreier, Margrit (2020). Qualitative Medienpsychologie. In Günter Mey & Katja Mruck (Eds.), Handbuch Qualitative Forschung in der Psychologie (Vol. 2, pp.461-477). Wiesbaden: Springer VS.
Odağ, Özen; Leiser, Anne & Boehnke, Klaus (2019). Reviewing the role of the Internet in radicalization. Journal for De-Radicalization, 21, https://journals.sfu.ca/jd/index.php/jd/article/view/289 [Accessed: July 22, 2022].
Odağ, Özen; Uluğ, Melis Özden & Ünal, Helin (2021). Identity dynamics among left-leaning, politically active Kurds in Germany: The role of perceived injustice, collective efficacy, and online/offline participation. International Journal of Communication, 15, 4639-4661, https://ijoc.org/index.php/ijoc/article/view/16592 [Accessed: July 22, 2022].
Odağ, Özen; Uluğ, Melis Özden; Maganic, Mia & Kanık, Betül (2022). Exploring collective action,motivations and the mobilizing role of social media: A comparative interview study with activists in Germany and Turkey. Political Psychology, online first.
Oliver, Mary Beth; Raney, Art & Bryant, Jennings (Eds.) (2020). Media effects: Advances in theory and research. New York, NY: Routledge.
Onwuegbuzie, Anthony J. & Combs, Julie P. (2010). Emergent data analysis techniques in mixed methods research. In Abbas Tashakkori & Charles Teddlie (Eds.), The Sage Handbook of mixed methods in social & behavioral research (pp.397-430). Thousand Oaks, CA: Sage.
Onwuegbuzie, Anthony J. & Johnson, R. Burke (2006). The validity issue in mixed research. Research in the Schools, 13(1), 48-63.
Pennycook, Gordon & Rand, David G. (2021). The psychology of fake news. Trends in Cognitive Sciences, 25(5), 388-402, https://doi.org/10.1016/j.tics.2021.02.007 [Accessed: November 2, 2021].
Peters, Madelon L.; Smeets, Elke; Feijge, Marion; van Breukelen, Gerard; Andersson, Gerhard; Buhrman, Monica & Linton, Steven, J. (2017). Happy despite pain: A randomized controlled trial of an 8-week internet-delivered positive psychology intervention for enhancing well-being in patients with chronic pain. The Clinical Journal of Pain, 33(11), 962-975, https://doi.org/10.1097/AJP.0000000000000494 [Accessed: September 23, 2021].
Plano Clark, Vicki L. (2019). Meaningful integration within mixed methods studies: Identifying why, what, when, and how. Contemporary Educational Psychology, 57, 106-111.
Plano Clark, Vicki L. & Badiee, Manijeh (2010). Research questions in mixed methods research. In Abbas Tashakkori & Charles Teddlie (Eds.), The Sage handbook of mixed methods in social & behavioral research (pp.275-304). Los Angeles, CA: Sage.
Postmes, Tom; Spears, Russell & Lea, Martin (1998). Breaching or building social boundaries? SIDE-effects of computer-mediated communication. Communication Research, 25(6), 689-715.
Prot, Sara & Anderson, Craig A. (2013). Research methods, design, and statistics in media psychology. In Karen E. Dill (Ed.), The Oxford handbook of media psychology (pp.109-136). New York, NY: Oxford University Press.
Ragin, Charles C. (2014 [1987]). The comparative method: Moving beyond qualitative and quantitative strategies. Berkeley, CA: University of California Press.
Reinecke, Leonard & Oliver, Mary Beth (Eds.) (2017). The Routledge handbook of media use and well-being: International perspectives on theory and research on positive media effects. New York, NY: Routledge.
Roden, Jessica & Saleem, Muniba (2021). White apathy and allyship in uncivil racial social media comments. Mass Communication and Society, 25(3), 383-406.
Roth, Ilona (Ed.) (2015). Introduction to psychology (Vol 1). New York, NY: Routledge.
Schneider, Carsten Q. & Rohlfing, Ingo (2013). Combining QCA and process tracing in set-theoretic multi-method research. Sociological Methods & Research, 42(4), 559-97.
Schreier, Margrit (2012). Qualitative content analysis in practice. Thousand Oaks, CA: Sage
Sedlakova, Renata (2014). Media studies methodology and research. In Renata Sedlakova, Výzkum médií: nejužívanější metody a techniky [engl.] (pp.483-487). Prag: Grada Publishing.
Shannon, Claude E. & Weaver, Warren (1949). The mathematical theory of communication. Urbana, IL: University of Illinois Press.
Spears, Russell & Postmes, Tom (2015). Group identity, social influence, and collective action online: Extensions and applications of the SIDE model. In S. Shyam Sundar (Ed.), The handbook of the psychology of communication technology (pp.23-46). Oxford: John Wiley & Sons.
Sundar, S. Shyam (Ed.) (2015). The handbook of the psychology of communication technology. Oxford: John Wiley & Sons.
Tacq, Jacques (2011). Causality in qualitative and quantitative research. Quality & Quantity, 45(2), 263-291.
Tashakkori, Abbas; Johnson, Burke & Teddlie, Charles (2020). Foundations of mixed methods research. London: Sage.
Teddlie, Charles & Tashakkori, Abbas (2009). Foundations of mixed methods research. London: Sage.
Todd, Zazie; Nerlich, Brigitte & McKeown, Suzanne (2004). Introduction. In Zazie Todd, Brigitte Nerlich, Suzanne McKeown & David D. Clarke (Eds.), Mixing methods in psychology. The integration of qualitative and quantitative methods in theory and practice (pp.3-16). Hove: Psychology Press.
Valkenburg, Patti M. & Oliver, Mary B. (2020). Media effects theories: An overview. In Jennings Bryant, Art Raney & Mary Beth Oliver (Eds.), Media effects: Advances in theory and research (pp.16-35). New York, NY: Routledge.
Vorderer, Peter; Park, David W. & Lutz, Sarah (2020). A history of media effects research traditions. In Mary Beth Oliver, Art Raney & Jennings Bryant (Eds.), Media effects: Advances in theory and research (pp.1-15). New York, NY: Routledge.
Wallace, Patricia (2016). The psychology of the Internet. New York, NY: Cambridge University Press.
Walther, Joseph B.; Van Der Heide, Brandon; Ramirez, Artemio Jr.; Burgoon, Judee K. & Peña, Jorge (2015). Interpersonal and hyperpersonal dimensions of computer-mediated communication. In S. Shyam Sundar (Ed.), The handbook of the psychology of communication technology (pp.3-22). Oxford: John Wiley & Sons.
Ward, Colleen & Geeraert, Nicolas (2016). Advancing acculturation theory and research: The acculturation process in its ecological context. Current Opinion in Psychology, 8, 98-104.
Ward, Colleen & Kennedy, Antony (1997). Acculturation strategies, psychological adjustment, and sociocultural competence during cross-cultural transitions. International Journal of Intercultural Relations, 18(3), 329-343.
Yağmur, Kutay & van der Vijver, Fons J.R. (2012). Acculturation and language orientations of Turkish immigrants in Australia, France, Germany, and the Netherlands. Journal of Cross-Cultural Psychology, 43(7), 1110-1130.
Yanovitzky, Itzhak & Greene, Kathryn (2009). Quantitative methods and causal inference in media effects research. In Robin L. Nabi & Mary Beth Oliver (Eds.), The Sage handbook of media processes and effects (pp.35-52). Los Angeles, CA: Sage.
Zagaria, Andrea; Ando, Agata & Zennaro, Alessandro (2020). Psychology: A giant with feet of clay. Integrative Psychological & Behavioral Science, 54(3), 521-562.
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Özen Odağ, Alexandra Mittelstädt
This work is licensed under a Creative Commons Attribution 4.0 International License.
