Article

Original Article

Ann Lab Med 2024; 44(6): 562-571

Published online November 1, 2024 https://doi.org/10.3343/alm.2024.0111

Copyright © Korean Society for Laboratory Medicine.

Laboratory Preparation for Digital Medicine in Healthcare 4.0: An Investigation Into the Awareness and Applications of Big Data and Artificial Intelligence

Shinae Yu , M.D.1, Byung Ryul Jeon , M.D., Ph.D.2, Changseung Liu , M.D.3, Dokyun Kim , M.D., Ph.D.4, Hae-Il Park , M.D., Ph.D.5, Hyung Doo Park , M.D., Ph.D.6, Jeong Hwan Shin , M.D., Ph.D.7, Jun Hyung Lee , M.D., Ph.D.8, Qute Choi , M.D., Ph.D.9, Sollip Kim , M.D., Ph.D.10, Yeo Min Yun , M.D., Ph.D.11, and Eun-Jung Cho, M.D., Ph.D.12 ; On behalf of the Evidence-Based Laboratory Medicine Committee of the Korean Society for Laboratory Medicine

1Department of Laboratory Medicine, Haeundae Paik Hospital, Inje University College of Medicine, Busan, Korea; 2Department of Laboratory Medicine & Genetics, Soonchunhyang University Bucheon Hospital, Soonchunhyang University College of Medicine, Bucheon, Korea; 3Departments of Laboratory Medicine, Gangneung Asan Hospital, University of Ulsan College of Medicine, Gangneung, Korea; 4Department of Laboratory Medicine and Research Institute of Bacterial Resistance, Yonsei University College of Medicine, Seoul, Korea; 5Department of Laboratory Medicine, College of Medicine, The Catholic University of Korea, Seoul, Korea; 6Department of Laboratory Medicine and Genetics, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea; 7Department of Laboratory Medicine, Inje University College of Medicine, Busan, Korea; 8Department of Laboratory Medicine, GC Labs, Yongin, Korea; 9Department of Laboratory Medicine, Chungnam National University Sejong Hospital, Chungnam National University School of Medicine, Daejeon, Korea; 10Department of Laboratory Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea; 11Department of Laboratory Medicine, Konkuk University Medical Center, Konkuk University School of Medicine, Seoul, Korea; 12Department of Laboratory Medicine, Hallym University Dongtan Sacred Heart Hospital, Hallym University College of Medicine, Hwaseong, Korea

Correspondence to: Eun-Jung Cho, M.D., Ph.D.
Department of Laboratory Medicine, Hallym University Dongtan Sacred Heart Hospital, Hallym University College of Medicine, 7 Keunjaebong-gil, Hwaseong 18450, Korea
E-mail: ejlovi@naver.com

Received: February 29, 2024; Revised: April 3, 2024; Accepted: June 21, 2024

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Background: Healthcare 4.0. refers to the integration of advanced technologies, such as artificial intelligence (AI) and big data analysis, into the healthcare sector. Recognizing the impact of Healthcare 4.0 technologies in laboratory medicine (LM), we seek to assess the overall awareness and implementation of Healthcare 4.0 among members of the Korean Society for Laboratory Medicine (KSLM).
Methods: A web-based survey was conducted using an anonymous questionnaire. The survey comprised 36 questions covering demographic information (seven questions), big data (10 questions), and AI (19 questions).
Results: In total, 182 (17.9%) of 1,017 KSLM members participated in the survey. Thirty-two percent of respondents considered AI to be the most important technology in LM in the era of Healthcare 4.0, closely followed by 31% who favored big data. Approximately 80% of respondents were familiar with big data but had not conducted research using it, and 71% were willing to participate in future big data research conducted by the KSLM. Respondents viewed AI as the most valuable tool in molecular genetics within various divisions. More than half of the respondents were open to the notion of using AI as assistance rather than a complete replacement for their roles.
Conclusions: This survey highlighted KSLM members’ awareness of the potential applications and implications of big data and AI. We emphasize the complexity of AI integration in healthcare, citing technical and ethical challenges leading to diverse opinions on its impact on employment and training. This highlights the need for a holistic approach to adopting new technologies.

Keywords: Artificial intelligence, Big data, Digital medicine, Healthcare 4.0, Laboratory medicine

Healthcare 1.0 refers to the traditional model of healthcare delivery that has existed for much of the 20th century and continues to be prevalent in many regions. In the late 1990s, Healthcare 1.0 focused on improving service efficiency and reducing bureaucracy. Healthcare 2.0 was aimed at enhancing efficiency and data exchange among healthcare organizations. Healthcare 3.0 introduced proactive care using electronic medical records (EMRs), big data analytics, and Internet of Things (IoT) wearables, emphasizing preventive treatment [1]. Finally, Healthcare 4.0 marks a shift toward predictive care and patient-centric approaches, using advanced technologies such as the IoT, blockchain, artificial intelligence (AI), and big data analytics to deliver high-quality, cost-effective healthcare [1]. In the era of Healthcare 4.0, the integration of AI, big data analysis, and the IoT is revolutionizing medical diagnostics and laboratory medicine (LM). The use of AI in diagnostic procedures enhances precision and efficiency, reduces human error, and improves patient outcomes [2-4].Similarly, machine learning (ML) offers a means to analyze complex biochemical data rapidly and accurately, and big data analysis allows for more personalized and predictive medicine [5]. The relationship among big data, ML, and AI is foundational to these advancements. Big data provides the extensive datasets necessary for analysis, ML processes the data to identify patterns and provide insights, and AI applies the findings to improve diagnostic and treatment decisions, collectively driving the evolution toward more informed and tailored healthcare solutions [2-5].

The influx of extensive data poses significant challenges in data management, emphasizing the need for robust systems to maintain data integrity and security. The management of sensitive patient information under these circumstances becomes a matter of stringent compliance with data privacy and ethical standards, introducing novel challenges in LM [2]. Consequently, there is a growing need for laboratory professionals skilled in digital literacy, data analysis, and AI-based tools [3, 4]. Educational programs and professional training are being adapted to include these skills to equip professionals for Healthcare 4.0 [2, 6, 7].

The Evidence-Based Laboratory Medicine (EBLM) Committee of the Korean Society for Laboratory Medicine (KSLM), recognizing the importance of understanding the impact of Healthcare 4.0 technologies in LM, aimed to evaluate the awareness and implementation of these technologies among KSLM members to identify knowledge gaps and prepare for future challenges. The objectives were to assess perceptions and readiness regarding big data, AI, and terminology standards among laboratory professionals in the Healthcare 4.0 era.

Study design and participants

A web-based survey was conducted between June 12 and 30, 2023, using an anonymous questionnaire distributed via the Moaform online survey platform (www.moaform.co.kr). To ensure the validity and reliability of the survey results, 12 EBLM Committee members rigorously evaluated the questionnaire for comprehensibility and consistency before it was distributed. Then, KSLM members were invited to partake in the survey through a hyperlink embedded in an e-mail, facilitating direct access to the questionnaire. The study protocol and design were approved by the Institutional Review Board of the Hallym University Dongtan Sacred Heart Hospital, Gyeonggi, Korea (approval No.: 2023-03-005).

Questionnaire content

The survey comprised 36 questions covering demographic information (seven questions), big data (10 questions), and AI (19 questions).

The seven demographic questions included sex, age, employment type, years of practice in LM, workplace type and location, and the most important technologies introduced in LM with the advent of Healthcare 4.0.

Ten questions were addressed to clinical pathologists to assess their understanding of, interest in, and research experience with big data analysis and the statistical tools and programming languages used in big data analysis. The questionnaire included questions pertaining to the awareness of the common data model (CDM) and clinical data warehouse (CDW) and the availability thereof in the institution, and questions regarding the recognition of the Federated E-Health Big Data for Evidence Renovation Network (FeederNet), which is an environment for federated learning constructed based on the Observational Medical Outcomes Partnership (OMOP) CDM used in the Observational Health Data Sciences and Informatics [8].

Nineteen questions focused on the participants’ knowledge of, attitude regarding, and experience with AI, as well as their interest in using AI tools in their work, aiming to assess current AI usage and views on the use of AI in the next five years. The questions on AI usage assessed whether the participant’s laboratory workplace is currently integrating AI technologies, how the adoption of advanced technologies affects the workplace, and in which divisions AI is considered particularly useful. We asked for opinions on whether AI would improve the quality of the laboratory and on the legal liability for AI test results and decision-making.

Participants

In total, 182 participants (17.9%) of 1,017 KSLM members completed the survey over a three-week period. Demographic data are provided in Supplemental Data Table S1.

According to the responses to single-selection questions, AI (31.9%) and big data (31.3%) were regarded as the most important technologies in the era of Healthcare 4.0 in LM, followed by personalized medicine (24%). Three-dimensional (3D) printing, augmented reality (AR), virtual reality (VR), IoT, and surgical robots were less emphasized (Fig. 1).

Figure 1. Most important technologies introduced in LM with the advent of Healthcare 4.0.
Abbreviations: AI, artificial intelligence; AR, augmented reality; VR, virtual reality; IoT, internet of things; 3D, three-dimensional; LM, laboratory medicine.

Knowledge of the fundamental concept of big data

Among the 182 respondents, 134 (73.6%) acknowledged being somewhat familiar with the concept of big data, and 11 (6.0%) professed a comprehensive understanding. Thirty-six respondents (19.8%) reported having a limited grasp of the concept, and one (0.5%) reported a complete lack of knowledge on the topic.

Use of big data analytics in LM

A survey on big data research experience among laboratory professionals revealed that the majority (80.8%, N=147) were interested in but had not yet conducted big data analysis research. Only 10.4% (N=19) had conducted research in this field, 36.8% of whom had published their work. Additionally, 7.7% were involved in ongoing big data analysis research, whereas a small portion (3.3%, N=6) showed no interest in the subject. Regarding the use of statistical methods for big data analytics, 22.0% of respondents reported being able to use data analytics tools. According to the responses to the multiple-choice question regarding preferences for statistical software, the majority of participants (75.0%) preferred using R programming (Fig. 2A). Among programming languages, R was the most commonly used by 77.5% of respondents, followed by Python (67.5%), Visual Basic (25.0%), structured query language (SQL) (17.5%), and C (17.5%) (Fig. 2B).

Figure 2. Statistical software (A) and programming languages (B) used in big data analysis.

State of the healthcare information technology

In 2020, the Korean Ministry of Health and Welfare launched a project to enhance medical data collection, processing, and interoperability [9]. Forty-eight respondents (26.4%) reported that their institution had participated in the project, whereas 73 (40.1%) reported non-participation. Sixty-one respondents (33.5%) were uncertain whether their institution had participated.

To facilitate the reuse of health data and ensure interoperability, medical information systems, such as CDWs and CDMs, have been developed [9, 10]. Approximately 60% of respondents were unaware of CDMs, whereas 40% reported varying degrees of awareness. When asked about the establishment of a CDW or CDM at their institution, 14.8% reported the presence of a CDW, and 7.7% reported CDM implementation. Notably, 11.5% indicated that their institution has both a CDW and a CDM. Conversely, 27.5% stated the absence of both systems in their institution, and 38.5% were unsure of their availability.

Nationwide big data platform and center

The Health Insurance Review and Assessment Service (HIRA) releases data via the Healthcare Bigdata Hub platform, which provides public datasets, medical big data analysis tools, and statistics tools for the analysis of diseases and medicines [11]. Only nine respondents (4.9%) reported having used Healthcare Bigdata Hub data for research. Forty-one (22.5%) had only visited the portal, 79 (43.4%) were aware of it but had not visited it, and 53 (29.1%) were unfamiliar with it. Regarding the 2021 memorandum of understanding between the KSLM and the big data research department of the National Health Insurance Service, 36.8% of respondents were informed about its existence, whereas 63.2% were not. FeederNet, a clinical data analysis platform in Korea established in 2019 [8], was familiar to 43 (23.6%) respondents. Among them, 9.3% had engaged in analysis using real-world big datasets from the OMOP CDM, whereas 90.7% had not actively participated in such research. A significant portion of respondents (139, 76%) lacked awareness of this nationwide network. One hundred thirty respondents (71.4%) expressed willingness to participate in future big data research by KSLM.

Awareness and perceptions of AI

Most described their knowledge of AI as somewhat (73.6%) or very well-informed (4.9%), whereas 39 (21.4%) respondents reported not being well-informed.

Research and publications on AI

One hundred forty-eight of 182 respondents (81.3%) were interested in but had not yet published AI research. Twenty-three respondents (12.6%) had published AI research papers, and 16 (8.8%) were currently engaged in AI research. Eleven respondents (6.0%) reported no interest in AI research.

Use of AI in LM

Table 1 outlines the impact of AI on current and future LM work. Fig. 3 illustrates the respondents’ perceptions of the potential utility of AI within various LM divisions. AI was considered most useful in molecular genetics (28.7%) and diagnostic hematology (27.5%), followed by laboratory management (24.2%). AI was perceived to be less applicable in clinical chemistry and other areas. Two respondents highlighted the role of AI in test result verification and point-of-care testing. Concerning AI adoption, the vast majority (95.6%) were open to using AI applications in their work, whereas a small fraction (4.4%) expressed no such intention. Regarding AI training, 79.7% recognized the need for and were willing to pursue specialized AI training, 17.6% preferred learning from AI experts, and 2.7% expected only basic training.

Figure 3. LM division in which AI is considered to be the most useful for laboratory work.
Abbreviations: LM, laboratory medicine; AI, artificial intelligence.

Survey results regarding the use of AI in LM
Use of AI in LMN%
Use of AI in laboratory work (N=181)
Currently using AI in some parts of the work2111.6
Not currently using AI, but may use it in the future14881.8
Not currently using AI, and never will in the future21.1
Not sure105.5
If you are currently using AI in the laboratory, what kind of work do you use it for (N=21)
Image analysis1361.9
Genetic data analysis314.3
Data analysis838.1
Automated electronic notification systems419.0
Reviewing patient risk factors419.0
Usefulness of AI in LM over the next 5 yrs (N=182)
Extremely valuable5228.6
Very valuable9853.8
Somewhat valuable3217.6
Not at all valuable00.0
What AI is perceived useful for in LM over the next 5 yrs (N=182)
Data analysis15886.8
Test management11663.7
Resource management7340.1
When do you think AI will be used in your work (N=182)
Within 5 yrs9552.2
Within 10 yrs7742.3
Within 15 yrs105.5
After >20 yrs00.0
Never00.0
How many years do you believe it will take for AI to become a major and/or everyday tool (N=182)
Within 5 yrs5831.9
Within 10 yrs8245.1
Within 15 yrs3117.0
After >20 yrs105.5
Never10.5

Abbreviations: AI, artificial intelligence; LM, laboratory medicine.



Impact of AI on clinical pathologists or LM residents

Table 2 summarizes the views on the impact of AI on clinical pathologists and LM residents. More than half of the respondents (56.0%) anticipated an expansion of their roles because of AI, 27.5% expected no change, and 16.5% expected their roles to become redundant. Regarding the impact of AI on the current numbers of clinical pathologists and LM residents, 52.2% predicted no change, whereas 26.4% expected an increase and 21.4% a decrease. Opinions on the impact of AI on residency training duration also varied: 81.9% expected no effect, 12.1% anticipated a need for extended training, and 6.0% suggested a potential reduction of the conventional 4-yr training duration. Regarding medical education, 46.8% of clinical pathologists believed AI would increase their teaching responsibilities, 45.6% predicted no significant change, and 7.1% expected a decrease in educational duties.

Survey results regarding the impact of AI on clinical pathologists and LM residents
Impact of AI on clinical pathologists or LM residentsN%
Impact of AI on the roles of clinical pathologists or LM residents (N=182)
AI will make their role redundant3016.5
AI will expand their role10256.0
AI will have no impact on their role5027.5
Impact of AI on the current number of clinical pathologists or LM residents (N=182)
The number of residents will decrease4826.4
The demand for clinical pathologists will increase3921.4
There will be no impact9552.2
Impact of AI on LM resident training (training course) (N=182)
Shortening of the training period116.0
No impact14981.9
Need to extend the training period2212.1
Impact of AI on the education of students and LM residents (questions for clinical pathologists) (N=158)
The responsibility for education will increase7446.8
There will be no change in educational responsibility7245.6
The burden of educational responsibility will decrease127.6
Impact of AI on student and LM resident training hours (questions for clinical pathologists) (N=158)
Reduction in education time2012.7
Increase in education time5232.9
No change in education time8654.4

Abbreviations: AI, artificial intelligence; LM, laboratory medicine.



Impact of AI on laboratory test reporting

Table 3 presents the views on the impact of AI on laboratory test reporting and liability. Most respondents (80.2%) were optimistic about AI’s potential to improve laboratory test quality and accuracy, whereas 20% remained neutral or cautious. With AI poised to contribute to laboratory reporting and EMR integration, 45.6% of professionals expressed concerns about potential unforeseen issues with AI-generated reports, whereas 40.7% would not be concerned if AI would achieve expert-level interpretation. Regarding liability for AI diagnostic errors, 54.4% advocated shared legal responsibility between AI developers and physicians, 33.5% found that physicians should be fully accountable for final decisions, and 12.1% believed that manufacturers should compensate for any patient harm resulting from defective AI products or designs.

Survey results regarding the impact of AI on laboratory test reporting
Perception of the impact of AI on laboratory test reportingN%
Improvement in quality using AI for laboratory tasks (N=182)
Positive impact14680.2
Neutral impact3619.8
Negative impact00.0
Opinion about AI-driven laboratory reporting (N=182)
Concerns about the unpredictable nature and various technical aspects8345.6
If demonstrated that it can achieve expert-level interpretations, there are no concerns7440.7
It will make fewer diagnostic errors than experts2513.7
Legal liability in the event of errors when using AI as a decision support tool (N=182)
Developer’s liability2212.1
Developer’s and physician’s liability9954.4
Physician’s liability6133.5

Abbreviation: AI, artificial intelligence.


This survey was the first of its kind, targeting KSLM members in Korea, specifically addressing Healthcare 4.0. The respondents considered AI the most vital in LM, followed by big data and personalized medicine. In contrast, a previous report highlighted IoT as the most promising healthcare technology because of 5G and data-sharing capabilities, followed closely by AI in the second position and robotics and digital manufacturing, including 3D printing, in the third and fourth positions, respectively [12]. ML, a subset of AI, is already implemented or is likely to be used to enhance laboratory workflows, provide decision support, facilitate diagnostic and predictive applications, and integrate laboratory data [13]. Our findings revealed some differences in the ranking of the importance of Healthcare 4.0 technologies.

Most survey respondents were somewhat familiar with big data, with varying levels of understanding of and interest in big data analysis. Only a small percentage were proficient in using statistical software tools, indicating a gap in skills related to statistical analysis and programming language fluency. R programming was the most preferred language for statistical analysis, which is attributed to its open-source nature and diverse packages. In 2020, the most popular programming language for big data projects was Python, followed by C++ and JavaScript [14]. In a 2021 survey regarding tools for data scientists and analytics professionals, the order of preference was Python>SAS>R [15]. This suggests that preferences differ based on the industry, study area, and intended use, as well as according to the advantages and disadvantages of each tool.

In the era of big data, the integration of laboratory data into healthcare research presents both unprecedented opportunities and significant challenges. With the rapid expansion of AI applications and the utilization of big data in healthcare, laboratory results have become a crucial component of the data landscape. However, the assurance of data quality of laboratory results is far from straightforward [16], particularly given that identical samples can yield significantly biased results when tested across different laboratories despite ongoing standardization and harmonization efforts [17-19]. Correcting biased results is essential to minimize laboratory errors, enhance patient safety, and reduce costs. Significant biases, both statistical and medical, must be identified and rectified [20]. Therefore, clinical pathologists bear the responsibility to guarantee the accuracy and reliability of the data that form the basis of research and clinical decisions [21]. Research efforts focusing on the development of models for evaluating real-world laboratory results for big data research are ongoing [22].

With the increasing availability of digital health records and data analytics techniques, data-driven approaches to healthcare have offered the potential to improve clinical decision support and the healthcare industry as a whole [23]. In line with current trends, in 2020, the Medical Data-Driven Hospital Support Project was initiated in Korea [9]. A significant portion of respondents appeared to have limited knowledge of their hospital’s involvement in the project or the availability of a CDW or CDM within their institution. Familiarity with platforms such as the Healthcare Bigdata Hub and FeederNet was also limited.

The role of AI in healthcare and medical education, data interpretation, and reporting in LM is growing. The use of AI, particularly deep learning in radiology, has significantly increased, with studies growing from 14 in 2015 to 237 in 2019 [24, 25]. However, its application in routine LM practice remains limited [6, 26]. Clinical pathologists are essential in the development, training, and evaluation of AI algorithms.

Most respondents had a general understanding of AI, which was more advanced than that of medical students [27, 28], and anticipated its adoption in LM, particularly for image analysis and data interpretation. AI has shown effectiveness in diagnostic imaging [29, 30] and is used in data analysis. AI is expected to significantly transform healthcare in the future [29, 31-33]. The respondents were keen on AI adoption, emphasizing the need for education and skill development. Data analysis was viewed as the most beneficial AI application in LM, with molecular genetics and diagnostic hematology regarded as the most suitable areas for AI adoption. While AI is rapidly being adopted in various sectors, its integration in medicine poses technical and ethical challenges.

More than half of the respondents were open to AI supporting rather than replacing clinical pathologists, whereas 16.5% expressed concerns about potential job loss. Studies by Syed and Al-Rawi [34] and Ansari, et al. [35] revealed varying beliefs about AI replacing human roles in healthcare, with 17.8% of healthcare students and 85% of radiologists anticipating an impact of AI on jobs. Opinions on AI replacing humans differ according to education, training, and medical specialties. While some specialists view AI as influencing medical education, others do not foresee major changes in educational responsibilities. Adequate education is needed to address the healthcare risks associated with AI [36].

A significant portion of the respondents had a positive view of AI’s potential to improve quality in LM, expecting it to enhance interpretation accuracy and reduce diagnostic errors. However, concerns remained about technical challenges and unpredictability. Most respondents agreed that AI could improve quality across different phases of laboratory testing but were divided on its impact on patient diagnosis and treatment. Legal liability associated with AI-based test results is a significant issue debated by programmers, manufacturers, hospitals, governments, and users. Most respondents perceived that as users, they bear legal responsibility for AI-related medical errors, with two-thirds believing that manufacturers and users share responsibility. A minority of respondents argued for manufacturer liability in cases of defective AI products. The responsibility for AI-related errors remains a complex topic without a definitive answer. Opinions vary among physicians, manufacturers, and patients. Khullar, et al. [37] reported that physicians tend to believe that manufacturers and healthcare organizations are responsible, whereas recent studies suggested manufacturer liability if AI tools are appropriately validated and meet labeling requirements [38, 39].

The adoption of new technologies in the medical field is a complex process that involves not only technical aspects but also acceptance by healthcare professionals and patients [40]. Similarly, the integration of AI and ML into LM is a multifaceted and complex process. There is a critical need to understand human factors that influence technology adoption in LM, such as perceived utility, usability, and the readiness of the LM community to adapt to changes. The successful incorporation of advanced technologies in LM necessitates a balanced approach that considers both the technical prowess of these technologies and the human aspects crucial in this transformational phase. Paranjape, et al. [7] identified a significant AI knowledge gap in the medical community, underscoring the importance of continuous information updates and structured educational programs in LM, enabling laboratory professionals to stay informed and skilled in using AI and ML effectively in their work.

One limitation of our study was the low level of survey participation (17.9%), which may have led to a bias toward those with at least some awareness of AI and LM, potentially presenting an overly optimistic view. Second, the majority of survey respondents were under the age of 50 yrs and had less than 15 yrs of professional experience (Supplemental Data Table S1) and, therefore, may not fully represent the opinions within KSLM, suggesting that the findings may not include the perspectives of the entire membership.

In conclusion, this study was the first to examine how KSLM members view big data, AI, and terminology standards in LM. Our observations revealed that AI is considered a crucial tool in LM, particularly in areas such as molecular genetics and diagnostic hematology. Further, our findings showed that integrating AI into healthcare is complex because of technical and ethical issues, which led to varied opinions on its effect on jobs and training. This emphasizes the need for a well-rounded approach to adopting new technologies, balancing technical aspects with human factors. Finally, our findings highlight the importance of ongoing education and information updates to ensure that laboratory professionals can effectively use AI and ML in their work.

We sincerely thank the members of the Korean Society for Laboratory Medicine (KSLM) who participated in our survey.

Yu S and Cho EJ contributed to study conceptualization; Yu S, Jeon BR, Liu C, Kim D, Park HI, Park HD, Shin JH, Lee JH, Choi Q, Kim S, Yun YM, and Cho EJ contributed to the methodology and investigation; Shin JH and Kim S acquired the funding; Yu S, Park HD, Kim S, Yun YM, and Cho EJ contributed to project administration; Shin JH, Kim S, Yun YM, and Cho EJ supervised the study; Yu S and Cho EJ contributed to writing – original draft and writing – review & editing.

This study was funded by the Committee for Evidence-Based Laboratory Medicine of the Korean Society of Laboratory Medicine.

  1. Gupta A, Singh A. Healthcare 4.0: recent advancements and futuristic research directions. Wirel Pers Commun 2023;129:933-52.
    Pubmed KoreaMed CrossRef
  2. Pillay TS. Artificial intelligence in pathology and laboratory medicine. J Clin Pathol 2021;74:407-8.
    Pubmed CrossRef
  3. Rashidi HH, Albahra S, Robertson S, Tran NK, Hu B. Common statistical concepts in the supervised Machine Learning arena. Front Oncol 2023;13:1130229.
    Pubmed KoreaMed CrossRef
  4. Albahra S, Gorbett T, Robertson S, D'Aleo G, Kumar SVS, Ockunzzi S, et al. Artificial intelligence and machine learning overview in pathology & laboratory medicine: a general review of data preprocessing and basic supervised concepts. Semin Diagn Pathol 2023;40:71-87.
    Pubmed CrossRef
  5. Punchoo R, Bhoora S, Pillay N. Applications of machine learning in the chemical pathology laboratory. J Clin Pathol 2021;74:435-42.
    Pubmed CrossRef
  6. Rakha EA, Toss M, Shiino S, Gamble P, Jaroensri R, Mermel CH, et al. Current and future applications of artificial intelligence in pathology: a clinical perspective. J Clin Pathol 2021;74:409-14.
    Pubmed CrossRef
  7. Paranjape K, Schinkel M, Hammer RD, Schouten B, Nannan Panday RS, Elbers PWG, et al. The value of artificial intelligence in laboratory medicine. Am J Clin Pathol 2021;155:823-31.
    Pubmed KoreaMed CrossRef
  8. Lee GH, Park J, Kim J, Kim Y, Choi B, Park RW, et al. Feasibility study of federated learning on the distributed research network of OMOP common data model. Healthc Inform Res 2023;29:168-73.
    Pubmed KoreaMed CrossRef
  9. Choi IY. Present and future of utilizing healthcare data. Healthc Inform Res 2023;29:1-3.
    Pubmed KoreaMed CrossRef
  10. Bocquet F, Campone M, Cuggia M. The challenges of implementing comprehensive clinical data warehouses in hospitals. Int J Environ Res Public Health 2022;19:7379.
    Pubmed KoreaMed CrossRef
  11. Health Insurance Review and Assessment Service (HIRA) Bigdata Open Portal. https://opendata.hira.or.kr/home.do (Updated on Dec 2023).
  12. Popov VV, Kudryavtseva EV, Kumar Katiyar N, Shishkin A, Stepanov SI, Goel S. Industry 4.0 and digitalisation in healthcare. Materials (Basel) 2022;15:2140.
    Pubmed KoreaMed CrossRef
  13. Undru TR, Uday U, Lakshmi JT, Kaliappan A, Mallamgunta S, Nikhat SS, et al. Integrating artificial intelligence for clinical and laboratory diagnosis - a review. Maedica (Bucur) 2022;17:420-6.
    Pubmed KoreaMed CrossRef
  14. Mahmudova S. Study and comparative analysis of programming languages used for big data. Rev Inf Eng Appl 2021;8:1-9.
    CrossRef
  15. Cho EJ, Jeong TD, Kim S, Park HD, Yun YM, Chun S, et al. A new strategy for evaluating the quality of laboratory results for big data research: using external quality assessment survey data (2010-2020). Ann Lab Med 2023;43:425-33.
    Pubmed KoreaMed CrossRef
  16. Yoon YA, Lee YW, Kim S, Lee K, Park HD, Chun S, et al. Standardization status of total cholesterol concentration measurement: analysis of Korean external quality assessment data. Ann Lab Med 2021;41:366-71.
    Pubmed KoreaMed CrossRef
  17. Jeong TD, Cho EJ, Lee K, Lee W, Yun YM, Chun S, et al. Recent trends in creatinine assays in Korea: long-term accuracy-based proficiency testing survey data by the Korean association of external quality assessment service (2011-2019). Ann Lab Med 2021;41:372-9.
    Pubmed KoreaMed CrossRef
  18. Nam Y, Lee JH, Kim SM, Jun SH, Song SH, Lee K, et al. Periodic comparability verification and within-laboratory harmonization of clinical chemistry laboratory results at a large healthcare center with multiple instruments. Ann Lab Med 2022;42:150-9.
    Pubmed KoreaMed CrossRef
  19. Coskun A. Bias in laboratory medicine: the dark side of the moon. Ann Lab Med 2024;44:6-20.
    Pubmed KoreaMed CrossRef
  20. Kim S. Laboratory data quality evaluation in the big data era. Ann Lab Med 2023;43:399-400.
    Pubmed KoreaMed CrossRef
  21. Kim S, Cho EJ, Jeong TD, Park HD, Yun YM, Lee K, et al. Proposed model for evaluating real-world laboratory results for big data research. Ann Lab Med 2023;43:104-7.
    Pubmed KoreaMed CrossRef
  22. Cascini F, Santaroni F, Lanzetti R, Failla G, Gentili A, Ricciardi W. Developing a data-driven approach in order to improve the safety and quality of patient care. Front Public Health 2021;9:667819.
    Pubmed KoreaMed CrossRef
  23. Kelly BS, Judge C, Bollard SM, Clifford SM, Healy GM, Aziz A, et al. Radiology artificial intelligence: a systematic review and evaluation of methods (RAISE). Eur Radiol 2022;32:7998-8007.
    Pubmed KoreaMed CrossRef
  24. Hosny A, Parmar C, Quackenbush J, Schwartz LH, Aerts HJWL. Artificial intelligence in radiology. Nat Rev Cancer 2018;18:500-10.
    Pubmed KoreaMed CrossRef
  25. Ma C, Wang X, Wu J, Cheng X, Xia L, Xue F, et al. Real-world big-data studies in laboratory medicine: current status, application, and future considerations. Clin Biochem 2020;84:21-30.
    Pubmed CrossRef
  26. Pinto Dos Santos D, Giese D, Brodehl S, Chon SH, Staab W, Kleinert R, et al. Medical students' attitude towards artificial intelligence: a multicentre survey. Eur Radiol 2019;29:1640-6.
    Pubmed CrossRef
  27. Sit C, Srinivasan R, Amlani A, Muthuswamy K, Azam A, Monzon L, et al. Attitudes and perceptions of UK medical students towards artificial intelligence and radiology: a multicentre survey. Insights Imaging 2020;11:14.
    Pubmed KoreaMed CrossRef
  28. Rajpurkar P, Chen E, Banerjee O, Topol EJ. AI in health and medicine. Nat Med 2022;28:31-8.
    Pubmed CrossRef
  29. Burns BL, Rhoads DD, Misra A. The use of machine learning for image analysis artificial intelligence in clinical microbiology. J Clin Microbiol 2023;61:e0233621.
    Pubmed KoreaMed CrossRef
  30. Koski E, Murphy J. AI in healthcare. Stud Health Technol Inform 2021;284:295-9.
    Pubmed CrossRef
  31. Jiang F, Jiang Y, Zhi H, Dong Y, Li H, Ma S, et al. Artificial intelligence in healthcare: past, present and future. Stroke Vasc Neurol 2017;2:230-43.
    Pubmed KoreaMed CrossRef
  32. Khan AI, Khan M, Khan R. Artificial intelligence in point-of-care testing. Ann Lab Med 2023;43:401-7.
    Pubmed KoreaMed CrossRef
  33. Syed W, Basil A Al-Rawi M. Assessment of awareness, perceptions, and opinions towards artificial intelligence among healthcare students in Riyadh, Saudi Arabia. Medicina (Kaunas) 2023;59:828.
    Pubmed KoreaMed CrossRef
  34. Ansari I, Arfat M, Malik M, Bansal R. A cross-sectional survey on an insight into the current perceptions of Indian radiologists, radiographers, radiology trainee & medical imaging students on the future impact of artificial intelligence (AI) on the profession. J Pharm Neg Results 2023;14:1686-99.
  35. Sun L, Yin C, Xu Q, Zhao W. Artificial intelligence for healthcare and medical education: a systematic review. Am J Transl Res 2023;15:4820-8.
    Pubmed KoreaMed
  36. Khullar D, Casalino LP, Qian Y, Lu Y, Chang E, Aneja S. Public vs physician views of liability for artificial intelligence in health care. J Am Med Inform Assoc 2021;28:1574-7.
    Pubmed KoreaMed CrossRef
  37. Abràmoff MD, Tobey D, Char DS. Lessons learned about autonomous AI: finding a safe, efficacious, and ethical path through the development process. Am J Ophthalmol 2020;214:134-42.
    Pubmed CrossRef
  38. Bazoukis G, Hall J, Loscalzo J, Antman EM, Fuster V, Armoundas AA. The inclusion of augmented intelligence in medicine: a framework for successful implementation. Cell Rep Med 2022;3:100485.
    Pubmed KoreaMed CrossRef
  39. Safi S, Thiessen T, Schmailzl KJ. Acceptance and resistance of new digital technologies in medicine: qualitative study. JMIR Res Protoc 2018;7:e11072.
    Pubmed KoreaMed CrossRef