Your browser does not support the PubReader view.
Go to this page to see a list of supporting browsers.
Korean Academic Society of Business Administration
[ Article ]
korean management review - Vol. 52, No. 1, pp.111-136
ISSN: 1226-1874 (Print)
Print publication date 28 Feb 2023
Received 22 Aug 2022 Accepted 13 Sep 2022
DOI: https://doi.org/10.17287/kmr.2023.52.1.111

비동일방법편의(Uncommon Method Bias)의 원인과 해결방안

Won-Woo Park ; Soobin Park ; Healyim Lee ; Minju Oh ; Junsung Maeng
(First Author) Professor, College of Business Administration, Seoul National University wwpark@snu.ac.kr
(Corresponding Author) Seoul National University 2022-36625@snu.ac.kr
(Co-Author) Seoul National University hllee@snu.ac.kr
(Co-Author) Seoul National University omj0216@snu.ac.kr
(Co-Author) Kookmin University iliath@mensakorea.org
Causes and Solutions of Uncommon Method Bias


Copyright 2011 THE KOREAN ACADEMIC SOCIETY OF BUSINESS ADMINISTRATION
This is an open access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Common method bias(CMB) occurs when the measurement of all variables within a conceptual framework is done with a single i.e. common method. The importance of overcoming CMB as a key way to increase the quality of research has been recognized by most scholars, that it is often treated as a basic condition to be fulfilled in doing an empirical study. Thus, the use of uncommon methods became a fad to overcome CMB. By recognizing that uncommon method also has problems, this paper describes uncommon method bias(UMB) thoroughly: What it is, why it happens, and finally the six ways to overcome it. Furthermore, 1,529 empirical papers published in past 14 years (2008~2021) in three prominent Korea journals were analyzed in detail to see to what extent they recognized the issue of CMB and/or UMB, and how they tried to overcome them. Unlike growing recognition and effort to overcome CMB, none of the 1,529 papers has mentioned anything about UMB, not to mention any efforts to overcome it.

Keywords:

Uncommon method bias(UMB), Common method bias(CMB), Uncommon method variance(UMV), Common method variance(CMV)

Acknowledgments

This research was supported by the Institute of Management Research at Seoul National University.

References

  • Alessandri, G., Vecchione, M., Donnellan, B., and Tisak, J. (2013), “An application of the LC-LSTM framework to the self-esteem instability case,” Psychometrika, 78(4), pp.769-792. [https://doi.org/10.1007/s11336-013-9326-4]
  • Baumgartner, H., and Weijters, B. (2012), “Commentary on common method bias in marketing: Causes, mechanisms, and procedural remedies,” Journal of Retailing, 88(4), pp.563-566. [https://doi.org/10.1016/j.jretai.2012.10.003]
  • Bergman, M. E., and Jean, V. A. (2016), “Where have all the ”workers“ gone? A critical analysis of the unrepresentativeness of our samples relative to the labor market in the industrial-organizational psychology literature,” Industrial and Organizational Psychology, 9(1), pp.84-113. [https://doi.org/10.1017/iop.2015.70]
  • Brannick, M. T., Chan, D., Conway, J. M., Lance, C. E., and Spector, P. E. (2010), “What is method variance and how can we cope with it? A panel discussion,” Organizational Research Methods, 13(3), pp.407-420. [https://doi.org/10.1177/1094428109360993]
  • Campbell, D. T., and Fiske, D. W. (1959), “Convergent and discriminant validation by the multitrait-multimethod matrix,” Psychological Bulletin, 56(2), pp.81-105. [https://doi.org/10.1037/h0046016]
  • Carpenter, N. C., Berry, C. M., and Houston, L. (2014), “A meta-analysis comparison of self-reported and other-reported organizational citizenship behavior,” Journal of Organizational Behavior, 35(4), pp.547-574. [https://doi.org/10.1002/job.1909]
  • Chen, C. C., and Chiu, S. F. (2009), “The mediating role of job involvement in the relationship between job characteristics and organizational citizenship behavior,” The Journal of Social Psychology, 149(4), pp.474-494. [https://doi.org/10.3200/SOCP.149.4.474-494]
  • Choi, S. (2021), “Analyzing common method bias using CFA marker technique: Data and sample for instructional guide,” Korea Association of Business Education, 36(2), pp.245-265. [https://doi.org/10.23839/kabe.2021.36.2.245]
  • Conger, A. J. (1974), “A revised definition for suppressor variables: A guide to their identification and interpretation,” Educational and Psychological Measurement, 34(1), pp.35-46. [https://doi.org/10.1177/001316447403400105]
  • Cote, J. A., and Buckley, M. R. (1987), “Estimating trait, method, and error variance: Generalizing across 70 construct validation studies,” Journal of Marketing Research, 24(3), pp.315-318. [https://doi.org/10.1177/002224378702400308]
  • Cruz, K. S. (2021), “Does anyone care about external validity? A call (or plea?) for more OB/HR research from multiple organizations/industries, panels, and publicly available datasets,” Group & Organization Management, 46(6), pp.974-983. [https://doi.org/10.1177/10596011211055879]
  • Doty, D., and Glick, W. (1998), “Common methods bias: Does common methods variance really bias results?,” Organizational Research Methods, 1(4), pp.374-406. [https://doi.org/10.1177/109442819814002]
  • Eid, M.(2000), “A multitrait-multimethod model with minimal assumptions,” Psychometrika, 65(2), pp.241-261. [https://doi.org/10.1007/BF02294377]
  • Findley, M. G., Kikuta, K., and Denly, M. (2021), “External validity,” Annual Review of Political Science, 24, pp.365-393. [https://doi.org/10.1146/annurev-polisci-041719-102556]
  • Gaylord-Harden, N. K., Cunningham, J. A., Holmbeck, G. N., and Grant, K. E. (2010), “Suppressor effects in coping research with African American adolescents from low-income communities,” Journal of Consulting and Clinical Psychology, 78(6), pp.843-855. [https://doi.org/10.1037/a0020063]
  • Gong, H., and Kim, H. (2016), “The effect of customer aggression on workplace deviant behavior: Focus on the moderating effect of psychological ownership,” Korean Management Review, 45(3), pp.795-827. [https://doi.org/10.17287/kmr.2016.45.3.795]
  • Han, H., and Kum, H. (2017), “An empirical study on comparability of satisfaction measurement tools: Focusing on 4,5 and 11 Likert type items for public service satisfaction survey,” Survey Research, 18(1), pp.61-96. [https://doi.org/10.20997/SR.18.1.3]
  • Harman, H. H. (1976), Modern factor analysis, The University of Chicago Press, Chicago.
  • Harris, M. M., and Schaubroeck, J. (1988), “A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings,” Personnel Psychology, 41(1), pp.43-62. [https://doi.org/10.1111/j.1744-6570.1988.tb00631.x]
  • Höge, T., and Büssing, A. (2004), “The impact of sense of coherence and negative affectivity on the work stressor-strain relationship,” Journal of Occupational Health Psychology, 9(3), pp.195-205. [https://doi.org/10.1037/1076-8998.9.3.195]
  • Johns, G. (2006), “The essential impact of context on organizational behavior,” Academy of Management Review, 31(2), pp.386-408. [https://doi.org/10.5465/amr.2006.20208687]
  • Kim, B., Park, O., and Yun, S. (2009) “The effect of self-enhancement motives and coworker LMX on help,” Korean Journal of Management, 17(1), pp.161-197.
  • Kim, D., Shin, H., and Young, L. (2009), “Perceived organizational support as a mediator of the relationship between organizational justice and organizational citizenship behavior,” Korean Journal of Management, 17(4), pp.47-85.
  • Kim, G. M.(2021), “Stakeholder recognition, ethical management system, and social performance,” Korean Journal of Management, 29(3), pp.25-62. [https://doi.org/10.26856/kjom.2021.29.3.25]
  • Lance, C. E., Dawson, B., Birkelbach, D., and Hoffman, B. J. (2010), “Method effects, measurement error, and substantive conclusions,” Organizational Research Methods, 13(3), pp.435-455. [https://doi.org/10.1177/1094428109352528]
  • Lee, J., and Park, D. (2013), “The effect of individual emotional intelligence and locus of control on the in-role behavior and innovative behavior: The moderating effects of TMX,” Korean Association of Industrial Business Administration, pp.90-116.
  • Lee, S., Youn, C. and Kim, Y. (2005), “Analysis of the multitrait-multimethod data: A critical review,” Korean Journal of Industrial and Organizational Psychology, 18(3), pp.455-480.
  • Li, X., Park, Y. S., and Park, K. (2021), “The impact of perceived exclusive global talent management on intention to stay: The moderating role of interpersonal relationships in multinational enterprises,” Korean Management Review, 50(6), pp.1693-1710. [https://doi.org/10.17287/kmr.2021.50.6.1693]
  • Lindell, M., and Whitney, D. (2001), “Accounting for common method variance in cross-sectional research designs,” Journal of Applied Psychology, 86(1), pp.114-121. [https://doi.org/10.1037/0021-9010.86.1.114]
  • Maassen, G. H., and Bakker, A. B. (2001), “Suppressor variables in path models: Definitions and interpretations,” Sociological Methods & Research, 30(2), pp.241-270. [https://doi.org/10.1177/0049124101030002004]
  • Meehl, P. E. (1945), “A simple algebraic development of Horst's suppressor variables,” The American Journal of Psychology, 58(4), pp.550-554. [https://doi.org/10.2307/1417770]
  • Pandey, S., and Elliott, W. (2010), “Suppressor variables in social work research: Ways to identify in multiple regression models,” Journal of the Society for Social Work and Research, 1(1), pp.28-40. [https://doi.org/10.5243/jsswr.2010.2]
  • Park, K. (2020) “A research on common method bias using the workplace panel survey,” Journal of Human Resource Management Research, 27(4), pp.67-81. [https://doi.org/10.14396/jhrmr.2020.27.4.67]
  • Park, W., Kim, M. S., Jeong, S. M., and Huh, K. M. (2007) “Causes and remedies of common method bias,” Korean Journal of Management, 15(1), pp.89-133.
  • Podsakoff, P. M., and Organ, D. (1986), “Self-reports in organization research: Problems and prospects,” Journal of Management, 12(4), pp.531-544. [https://doi.org/10.1177/014920638601200408]
  • Podsakoff, P. M., MacKenzie, S. B., and Podsakoff, N. P. (2012), “Sources of method bias in social science research and recommendations on how to control it,” Annual Review of Psychology, 63(1), pp.539-569. [https://doi.org/10.1146/annurev-psych-120710-100452]
  • Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., and Podsakoff, N. P. (2003), “Common method biases in behavioral research: A critical review of the literature and recommended remedies,” Journal of Applied Psychology, 88(5), pp.879-903. [https://doi.org/10.1037/0021-9010.88.5.879]
  • Richardson, H. A., Simmering, M. J., and Sturman, M. C. (2009) “A tale of three perspective: Examining post hoc statistical techniques for detection and correction of common method variance,” Organizational Research Method, 12(4), pp.762-800. [https://doi.org/10.1177/1094428109332834]
  • Simmering, M., Fuller, C., Richardson, H., Ocal, Y., and Atinc, G. (2015), “Marker variable choice, reporting, and interpretation in the detection of common method variance,” Organizational Research Methods, 18(3), pp.473-511. [https://doi.org/10.1177/1094428114560023]
  • Spector, P. E. (1977), “What to do with significant multivariate effects in multivariate analyses of variance,” Journal of Applied Psychology, 62(2), pp.158-163. [https://doi.org/10.1037/0021-9010.62.2.158]
  • Spector, P. E. (2006), “Method variance in organizational research,” Organizational Research Methods, 9(2), pp.221-232. [https://doi.org/10.1177/1094428105284955]
  • Spector, P. E., Rosen, C., Richardson, H., Williams, L., and Johnson, R. (2019), “A new perspective on method variance: A measure-centric approach,” Journal of Management, 45(3), pp.855-880. [https://doi.org/10.1177/0149206316687295]
  • Spector, P. E., Van Katwyk, P. T., Brannick, M. T., and Chen, P. Y. (1997), “When two factors don’t reflect two constructs: How item characteristics can produce artifactual factors,” Journal of Management, 23(5), pp.659-677. [https://doi.org/10.1177/014920639702300503]
  • Stafford, T. (2020), “Uncommon method bias,” ACM SIGMIS Database: The DATABASE for Advances in Information Systems, 51(4), pp.8-10. [https://doi.org/10.1145/3433148.3433150]
  • Suh, M., and Rho, T. (2015), “Relationship velocity in the service provider-personal customer relationship: A longitudinal approach using different stages of a relationship,” Korean Journal of Marketing, 30(2), pp.1-26. [https://doi.org/10.15830/kmr.2015.30.2.1]
  • Tak, J., and Shin, J. (2018), “The effects of participative leadership on change-oriented organizational citizenship behavior: Mediating effect of psychological empowerment and moderating effect of psychological safety,” Yonsei Business Review, 55(2), pp.57-92. [https://doi.org/10.55125/YBR.2018.06.55.2.57]
  • Weijters, B., and Baumgartner, H. (2012), “Misresponse to reversed and negated items in surveys: A review,” Journal of Marketing Research, 49(5), pp.737-747. [https://doi.org/10.1509/jmr.11.0368]
  • Williams, L. J., and Anderson, S. E. (1994), “An alternative approach to method effects by using latent-variable models: Applications in organizational behavior research,” Journal of Applied Psychology, 79(3), pp.323-331. [https://doi.org/10.1037/0021-9010.79.3.323]
  • Williams, L. J., and Brown, B. K. (1994), “Method variance in organizational behavior and human resources research: Effects on correlations, path coefficients, and hypothesis testing,” Organizational Behavior and Human Decision Processes, 57(2), pp.185-209. [https://doi.org/10.1006/obhd.1994.1011]
  • Williams, L. J., and McGonagle, A. (2015), “Four research designs and a comprehensive analysis strategy for investigating common method variance with self-report measures using latent variables,” Journal of Business and Psychology, 31(3), pp.339-359. [https://doi.org/10.1007/s10869-015-9422-9]
  • Williams, L. J., and Podsakoff, P. M. (1989), “Longitudinal methods for studying reciprocal relationships in organizational behavior research: Toward improved causal analysis,” Research in Organizational Behavior, 11, pp.247-292.
  • Williams, L. J., Hartman, N., and Cavazotte, F. (2010), “Method variance and marker variables: A review and comprehensive CFA marker technique,” Organizational Research Methods, 13(3), pp.477-514. [https://doi.org/10.1177/1094428110366036]
  • Zapf, D., Dormann, C., and Frese, M. (1996), “Longitudinal studies in organizational stress research: A review of the literature with reference to methodological issues,” Journal of Occupational Health Psychology, 1(2), pp.145-169. [https://doi.org/10.1037/1076-8998.1.2.145]

∙ The author Won-Woo Park received Ph.D. from the University of Pittsburgh in 1989. He worked as a faculty member in the USA and in South Korea before joining Seoul National University in 1998. He published about 130 research articles and 16 books, received many types of teaching awards from the university, also received ‘2020 Emerald Literati Award’ from Emerald Publishing.

∙ The author Soobin Park is a student of Organizational Behaviors and Human Resource Management in the School of Business Administration, Seoul National University (SNU). She received her BA in Human Environment & Design and Business Administration and MS in Business Administration from Yonsei University. Her research interests include innovation, creativity, OCB and survey research methodology.

∙ The author Healyim Lee is currently attending the Ph.D. in International Business at Seoul National University. Her research focuses on e-government, public values, and survey research methodology, etc.

∙ The author Minju Oh is currently in master’s degree in organizational Behavior & Human Resource Management at Seoul National University Business Administration. She received a bachelor’s degree in Business Administration, Political Science, and International Relations from Kyung Hee University. Her current research interests are leadership, knowledge sharing, voice, and silence behavior.

∙ The author Junsung Maeng is serving as the CEO of Neoinside Co., Ltd. and is attending a Ph.D. program majoring in trading systems at Kookmin University's Graduate School of Business IT. He graduated from Sungkyunkwan University's Department of Language and Literature and Business Administration and obtained an MBA from Seoul National University's Graduate School of Business Administration.