Exploring AI Bias in Key Healthcare: The Role of Data Science

Authors

DOI:

https://doi.org/10.54536/ajpehs.v4i2.7562

Keywords:

Ai Bias, Algorithmic Fairness, Artificial Intelligence In Healthcare, Data Privacy, Systematic Review

Abstract

Artificial Intelligence (AI) is increasingly integrated into healthcare to enhance decision-making; improve patient outcomes; and optimize healthcare operations. However, the adoption of AI in this sector presents challenges, particularly regarding ethical considerations, data privacy, and bias. The purpose of this study is to explore the types of AI bias reported in healthcare literature from 2018 to 2024 and to highlight the implications for AI implementation in medical practice. the paper discusses Data sciences strategies to mitigate these biases, highlighting the critical role for responsible and ethical AI development. It roles in role in mitigating and enhancing the fairness in ML and LLM. It then delves into the process of fine-tuning, outlining the steps taken to adapt the model to specific datasets and tasks. This study is a systematic review of papers published between 2018 and 2024. The literature was analyzed to identify various types of AI bias; including algorithmic bias; data bias; and ethical-human-related bias. Relevant articles were selected based on their contribution to understanding AI bias in healthcare and its effects on healthcare delivery. The analysis identified several types of AI bias prevalent in healthcare. Algorithmic bias; data bias; and ethical-human-related bias were the primary categories. These biases can distort the decision-making process; impact patient outcomes; and challenge the fundamental principles of medical ethics. The review also found that human and data biases are significant factors contributing to AI bias in healthcare systems. The study highlights the need of data sciences for addressing AI-related biases in healthcare to ensure the successful and ethical implementation of AI technologies. Special attention is given to avoiding overfitting and optimizing hyperparameters during the fine-tuning process. Future research should focus on developing strategies to mitigate these biases; ensuring that AI systems are fair; reliable; and trustworthy. Identifying and addressing these biases is essential for the ethical integration of AI in healthcare and for protecting the integrity of the medical profession. 

Downloads

Download data is not yet available.

Author Biographies

  • Yara Mohammed, University of North Texas College of Information, United States

    Yara Mohammed is a student in the College of Information at the University of North Texas (UNT), concentration in Data Science. Her academic profile is defined by interdisciplinary interests spanning banking and finance, business development, artificial intelligence, prompt engineering, and cybersecurity. Her work examines how data-driven methods and emerging technologies can inform strategic decision-making, enhance organizational resilience, and support innovation across sectors. She is particularly interested in the practical and ethical dimensions of AI adoption, including its role in improving operational efficiency and strengthening digital security. Alongside her academic studies, Yara works as an AI developer consultant, contributing to the development and application of AI-based solutions in professional settings. Through her research and practice, Yara seeks to connect technical expertise with practical impact and to contribute applied, interdisciplinary perspectives to ongoing discussions in data science, technology, and organizational transformation in global contexts.

  • Manar Alsaid, East Texas A&M University, United States

    Dr. Manar Alsaid is an Assistant Professor in the Department of Computer Science & Information Systems at East Texas A&M University, where she balances a rigorous research agenda with a commitment to pedagogical excellence. Her academic journey is anchored by a PhD in Information Science with a concentration in Data Science from the University of North Texas, complemented by a foundational background in Computer Science from Al-Balqa Applied University in Jordan. Dr. Alsaid’s research explores the complex intersections of Artificial Intelligence, cybersecurity, and the information ecosystem, with a particular focus on quantifying "social noise" and mitigating the impact of misinformation on social media platforms. Dr. Alsaid is an active voice in the global academic community. She serves as an Associate Editor for the Journal of Information & Knowledge Management. She serves as a reviewer for U.S. National Science Foundation, NSF 26-503, Artificial Intelligence and Cybersecurity Education Innovation and Scholarship for Service Program Solicitation. She serves as a reviewer for high-ranking journals such as ACM, IEEE Access, Information Sciences, and Systemic. Dr. Alsaid has been recognized with honors, including the G2T Global Academic Excellence Award. Also, Dr. Alsaid was nominated for a few Faculty Awards Paul W. Barrus Distinguished Faculty Award for Teaching, H.M. Lafferty Distinguished Faculty Award for Scholarship and Creative Activity, Neill Humfeld Distinguished Faculty Award for Service, and Faculty Senate Recognition Awards for Professional Excellence. Whether mentoring students through the ALISE Emerging Scholars Program or contributing to international research collaborations, Dr. Alsaid remains dedicated to leveraging data science for sustainable innovation and ethical technological advancement.

References

Adegunle, F., Chhatwal, K., Arab, S., Alabdaljabar, M. S., Raslan, M. A., Sayed, O., & Goldsweig, A. M. (2026). Bias and oversight in clinical AI: A review of decision support tools and equity frameworks. Journal of General Internal Medicine, 1–12.

Belyaeva, A., Cosentino, J., Hormozdiari, F., McLean, C. Y., & Furlotte, N. A. (2023). Multimodal LLMs for health grounded in individual-specific data (arXiv:2307.09018). arXiv. https://arxiv.org/abs/2307.09018

Bohao Li, Rui Wang, Guangzhi Wang, Yuying Ge, Yixiao Ge, and Ying Shan. (2023). Seed-bench: Benchmarking multimodal llms with generative comprehension. arXiv preprint arXiv:2307.16125,.

Bol, K. W. O. (2024). Impact of bias in AI and human decision-making: A healthcare perspective [Master’s thesis, University of Twente].

Bouderhem, R. (2026). Artificial intelligence in healthcare: Ethical challenges and promoting clinical equity and transparency. In Handbook of tissue reconstruction and regeneration (pp. 1–29). Springer Nature Singapore.

Celi, L. A., Cellini, J., Charpignon, M. L., Dee, E. C., Dernoncourt, F., Eber, R., & Yao, S. (2022). Sources of bias in artificial intelligence that perpetuate healthcare disparities—A global review. PLOS Digital Health, 1(3), Article e0000022.

Chen, F., Wang, L., Hong, J., Jiang, J., & Zhou, L. (2024). Unmasking bias in artificial intelligence: A systematic review of bias detection and mitigation strategies in electronic health record-based models. Journal of the American Medical Informatics Association, 31(5), 1172–1183.

Chukwudi, W. C. (2024). Mitigating intersectional bias in machine learning: A novel approach to fairness in automated decision-making. ResearchGate.

Chukwuemelie, N. D., Yussuf, M. D., & Abdul, S. O. (2026). Precision public health: Harnessing AI and big data for equitable health outcomes. Center of Artificial Intelligence, 1(1).

Fu, C., Chen, P., Shen, Y., Qin, Y., Zhang, M., Lin, X., Qiu, Z., Lin, W., Yang, J., Zheng, X., Li, K., Sun, X., Wu, Y., & Ji, R. (2023). MME: A comprehensive evaluation benchmark for multimodal large language models (arXiv:2306.13394). arXiv. https://doi.org/10.48550/arXiv.2306.13394

Giovanola, B., & Tiribelli, S. (2023). Beyond bias and discrimination: Redefining the AI ethics principle of fairness in healthcare machine-learning algorithms. AI & Society, 38(2), 549–563.

Habermann, J. (2021). Psychological impacts of COVID-19 and preventive strategies: A review. [Publisher information needed]

Hague, D. C. (2019). Benefits, pitfalls, and potential bias in healthcare AI. North Carolina Medical Journal, 80(4), 219–223.

Hoffman, S., & Podgurski, A. (2019). Artificial intelligence and discrimination in healthcare. Yale Journal of Health Policy, Law, & Ethics, 19, 1.

Iyanda, E. O., Kakwagh, V. V., Gomment, T. I., Yunusa, E., & Owoyemi, J. O. (2026). Gender differences in health seeking behaviours among people living with HIV/AIDS in Benin City, Edo State-Nigeria. American Journal of Medicine, 1(1), 5–17.

Li, B., Wang, R., Wang, G., Ge, Y., Ge, Y., & Shan, Y. (2023). SEED-Bench: Benchmarking multimodal LLMs with generative comprehension (arXiv:2307.16125). arXiv. https://arxiv.org/abs/2307.16125

Li, C., Wong, C., Zhang, S., Usuyama, N., Liu, H., Yang, J., Naumann, T., Poon, H., & Gao, J. (2023). LLaVA-Med: Training a large language-and-vision assistant for biomedicine in one day. arXiv.

Lyu, C., Wu, M., Wang, L., Huang, X., Liu, B., Du, Z., Shi, S., & Tu, Z. (2023). Macaw-LLM: Multi-modal language modeling with image, audio, video, and text integration (arXiv:2306.09093). arXiv. https://arxiv.org/abs/2306.09093

Maaz, M., Rasheed, H., Khan, S., & Khan, F. S. (2023). Video-ChatGPT: Towards detailed video understanding via large vision and language models (arXiv:2306.05424). arXiv. https://arxiv.org/abs/2306.05424

Mandal, R., Kapoor, S., & Krishnaswamy, N. (2021). Geographical bias in visual datasets and its impact on facial analytics. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops.

Manvi, R., Khanna, S., Burke, M., Lobell, D., & Ermon, S. (2024). Large language models are geographically biased (arXiv:2401.01234). arXiv. https://arxiv.org/abs/2401.01234

Mir, B. A., Abbas, S. R., & Lee, S. W. (2026). Federated learning in healthcare ethics: A systematic review of privacy-preserving and equitable medical AI. Healthcare, 14(3), Article 306.

Mohanarajesh, K. (2024). Develop new techniques for ensuring fairness in artificial intelligence and ML models to promote ethical and unbiased decision-making. [Publisher information needed]

Nazer, L. H., Zatarah, R., Waldrip, S., Ke, J. X. C., Moukheiber, M., Khanna, A. K., & Mathur, P. (2023). Bias in artificial intelligence algorithms and recommendations for mitigation. PLOS Digital Health, 2(6), Article e0000278.

Norori, N., Hu, Q., Aellen, F. M., Faraci, F. D., & Tzovara, A. (2021). Addressing bias in big data and AI for healthcare: A call for open science. Patterns, 2(10).

Nsoesie, E. O., & Galea, S. (2022). Towards better data science to address racial bias and health equity. PNAS Nexus, 1(3), Article pgac120.

Olson, S. M., Muñoz, E. G., Solis, E. C., & Bradford, H. M. (2024). Mitigating weight bias in the clinical setting: A new approach to care. Journal of Midwifery & Women’s Health, 69(2), 180–190.

Poli, P. K. R., Pamidi, S., & Poli, S. K. R. (2025). Unraveling the ethical conundrum of artificial intelligence: A synthesis of literature and case studies. Augmented Human Research, 10(1), 2.

Radanliev, P. (2025). AI ethics: Integrating transparency, fairness, and privacy in AI development. Applied Artificial Intelligence, 39(1), Article 2463722. https://doi.org/10.1080/08839514.2025.2463722

Rahman, M. I. (2026). Algorithmic bias and transparency in artificial intelligence tools for nursing education: A scoping review. Nurse Education in Practice, Article 104756.

Ratwani, R. M., Sutton, K., & Galarraga, J. E. (2024). Addressing AI algorithmic bias in healthcare. JAMA, 332(13), 1051–1052. https://doi.org/10.1001/jama.2024.13486

Soenksen, L. R., Ma, Y., Zeng, C., Boussioux, L., Villalobos Carballo, K., Na, L., Wiberg, H. M., Li, M. L., Fuentes, I., & Bertsimas, D. (2022). Integrated multimodal artificial intelligence framework for healthcare applications. NPJ Digital Medicine, 5(1), 149.

Vaishya, R., Javaid, M., Khan, I. H., & Haleem, A. (2020). Artificial intelligence (AI) applications for the COVID-19 pandemic. Diabetes & Metabolic Syndrome: Clinical Research & Reviews, 14(4), 337–339.

van der Schaar, M., Alaa, A. M., Floto, A., Gimson, A., Scholtes, S., Wood, A., McKinney, E., Jarrett, D., Lio, P., & Ercole, A. (2021). How artificial intelligence and machine learning can help healthcare systems respond to COVID-19. Machine Learning, 110(1), 1–14.

Varsha, P. S. (2023). How can we manage biases in artificial intelligence systems—A systematic literature review. International Journal of Information Management Data Insights, 3(1), Article 100165. https://doi.org/10.1016/j.jjimei.2023.100165

Wantlin, K., Wu, C., Huang, S.-C., Banerjee, O., Dadabhoy, F., Mehta, V. V., Han, R. W., Cao, F., Narayan, R. R., Colak, E., Adamson, A., Heacock, L., Tison, G. H., Tamkin, A., & Rajpurkar, P. (2023). BenchMD: A benchmark for unified learning on medical images and sensors. arXiv.

Xu, L., Liu, B., Khan, A. H., Fan, L., & Wu, X.-M. (2023). Multi-modal pre-training for medical vision-language understanding and generation: An empirical study with a new benchmark. arXiv.

Yin, S., Fu, C., Zhao, S., Li, K., Sun, X., Xu, T., & Chen, E. (2023). A survey on multimodal large language models (arXiv:2306.13549). arXiv. https://arxiv.org/abs/2306.13549

Zhao, T., Dai, E., Shu, K., & Wang, S. (2022). Towards fair classifiers without sensitive attributes: Exploring biases in related features. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining (pp. 1433–1442)

Downloads

Published

2026-08-03

How to Cite

Mohammed, Y. ., & Alsaid, M. . (2026). Exploring AI Bias in Key Healthcare: The Role of Data Science. American Journal of Physical Education and Health Science, 4(2), 6-15. https://doi.org/10.54536/ajpehs.v4i2.7562

Similar Articles

1-10 of 41

You may also start an advanced similarity search for this article.