Addressing bias in generative AI: Challenges and research opportunities in information management

Xiahua Wei, Naveen Kumar, Han Zhang*

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

Abstract

Generative AI technologies, particularly Large Language Models (LLMs), have transformed information management systems but introduced substantial biases that can compromise their effectiveness in informing business decision-making. This challenge presents information management scholars with a unique opportunity to advance the field by identifying and addressing these biases across extensive applications of LLMs. Building on the discussion on bias sources and current methods for detecting and mitigating bias, this paper seeks to identify gaps and opportunities for future research. By incorporating ethical considerations, policy implications, and sociotechnical perspectives, we focus on developing a framework that covers major stakeholders of Generative AI systems, proposing key research questions, and inspiring discussion. Our goal is to provide actionable pathways for researchers to address bias in LLM applications, thereby advancing research in information management that ultimately informs business practices. Our forward-looking framework and research agenda advocate interdisciplinary approaches, innovative methods, dynamic perspectives, and rigorous evaluation to ensure fairness and transparency in Generative AI-driven information systems. We expect this study to serve as a call to action for information management scholars to tackle this critical issue, guiding the improvement of fairness and effectiveness in LLM-based systems for business practice.

Original languageEnglish
Article number104103
Number of pages9
JournalInformation and Management
Volume62
Issue number2
DOIs
Publication statusPublished - Mar 2025

Scopus Subject Areas

  • Management Information Systems
  • Information Systems
  • Information Systems and Management

User-Defined Keywords

  • Bias in generative AI
  • Debiasing
  • Fairness metrics
  • Generative AI
  • Large language models

Fingerprint

Dive into the research topics of 'Addressing bias in generative AI: Challenges and research opportunities in information management'. Together they form a unique fingerprint.

Cite this