The scholarly information-seeking process for behavioral research consists of three phases: searching, accessing, and processing of past research. Existing IT artifacts, such as Google Scholar, have in part addressed the searching and accessing phases, but fall short of facilitating the processing phase, creating a knowledge inaccessibility problem. We propose a behavioral ontology learning from text (BOLT) design framework that presents concrete prescriptions for developing systems capable of supporting researchers during their processing of behavioral knowledge. Based upon BOLT, we developed a search engine—TheoryOn—to allow researchers to directly search for constructs, construct relationships, antecedents, and consequents, and to easily integrate related theories. Our design framework and search engine were rigorously evaluated through a series of data mining experiments, a randomized user experiment, and an applicability check. The data mining experiment results lent credence to the design principles prescribed by BOLT. The randomized experiment compared TheoryOn with EBSCOhost and Google Scholar across four information retrieval tasks, illustrating TheoryOn’s ability to reduce false positives and false negatives during the information-seeking process. Furthermore, an in-depth applicability check with IS scholars offered qualitative support for the efficacy of an ontology-based search and the usefulness of TheoryOn during the processing phase of existing research. The evaluation results collectively underscore the significance of our proposed design artifacts for addressing the knowledge inaccessibility problem for behavioral research literature.
TheoryOn: A Design Framework and System for Unlocking Behavioral Knowledge Through Ontology Learning1 Available to Purchase
Jingjing Li is an assistant professor of Information Technology in the McIntire School of Commerce at the University of Virginia. She received her Ph.D. in Information Systems from the Leeds School of Business, University of Colorado. Her research interests relate to artificial intelligence and big data analytics, with applications in search engine, recommender system, healthcare, behavioral ontology learning, consumer behavior, and public policy making. Her research has been published in elite journals in the Information Systems, Marketing, and Management fields, and earned her the INFORMS Design Science Award, WITS Best Paper Award, and WITS Best Prototype Award. She has received grants from the U.S. National Science Foundation, Amazon Web Services, and Microsoft. When she worked as a scientist at Microsoft, she proposed and implemented a variety of machine learning solutions to tackle complex business and societal problems.
Kai R. Larsen is an associate professor of Information Systems in the division of Organizational Leadership and Information Analytics, Leeds School of Business, University of Colorado Boulder. He is a courtesy faculty member in the Department of Information Science of the College of Media, Communication and Information, a Research Advisor to Gallup, and a Fellow of the Institute of Behavioral Science. Kai is most known for providing a practical solution to Edward Thorndike’s (1904) Jingle Fallacy and for his contributions to the semantic theory of survey response (STSR), which holds that results of surveys using attitude scales primarily measure the linguistic relationships between survey questions.
Ahmed Abbasi is the Giovanini Endowed Chaired Professor in the Department of IT, Analytics, and Operations in the Mendoza College of Business at the University of Notre Dame. He received his Ph.D. in Information Systems from the Artificial Intelligence Lab at the University of Arizona, and an M.B.A. and B.S. degrees in Information Technology from Virginia Tech. Ahmed has 20 years of experience pertaining to AI and predictive analytics, with applications in health, text mining, online fraud and security, and social media. His research has been funded by over a dozen grants from the U.S. National Science Foundation and industry partners such as Amazon Web Services, eBay, Microsoft, and Oracle. He has also received the IEEE Technical Achievement Award, INFORMS Design Science Award, and IBM Faculty Award for his work at the intersection of machine learning and design. Ahmed has published over 100 articles in top journals and conferences, and won the AIS top publication and MIS Quarterly best paper awards. His work has been featured in various media outlets, including the Wall Street Journal, Harvard Business Review, the Associated Press, WIRED, and CBS. Ahmed serves on the editorial board for various IS, ACM, and IEEE journals.
Jingjing Li, Kai Larsen, Ahmed Abbasi; TheoryOn: A Design Framework and System for Unlocking Behavioral Knowledge Through Ontology Learning1. MIS Quarterly 1 December 2020; 44 (4): 1733–1772. https://doi.org/10.25300/MISQ/2020/15323
Download citation file: