Article

Original Article

Ann Lab Med 2018; 38(3): 249-254

Published online May 28, 2018 https://doi.org/10.3343/alm.2018.38.3.249

Copyright © Korean Society for Laboratory Medicine.

Budget Impact of the Accreditation Program for Clinical Laboratories on Colorectal Cancer Screening via Fecal Immunochemical Testing: Results from the National Cancer Screening Program in Korea

Jae Kwan Jun, M.D.1, Na Young Sung, Ph.D.1, Seung Hoon Song, M.P.H.1, Seri Hong, M.D.1, Mi-Ae Jang, M.D.2, Junghan Song, M.D.3, Jeong-Ho Kim, M.D.4, Won-Ki Min, M.D.5, and You Kyoung Lee, M.D.2*

1National Cancer Control Institute, National Cancer Center, Goyang, Korea.

2Department of Laboratory Medicine and Genetics, Soonchunhyang University Bucheon Hospital, Soonchunhyang University College of Medicine, Bucheon, Korea.

3Department of Laboratory Medicine, Seoul National University Bundang Hospital, Seoul National University College of Medicine, Seongnam, Korea.

4Department of Laboratory Medicine, Yonsei University College of Medicine, Seoul, Korea.

5Department of Laboratory Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea.

Correspondence to: Corresponding author: You Kyoung Lee. Department of Laboratory Medicine and Genetics, Soonchunhyang University Bucheon Hospital, Soonchunhyang University College of Medicine, 170 Jomaru-ro, Wonmi-gu, Bucheon 14584, Korea. Tel: +82-32-621-5941, Fax: +82-32-621-5944, cecilia@schmc.ac.kr

Received: July 10, 2017; Revised: September 12, 2017; Accepted: November 29, 2017

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Background

False-positive fecal immunochemical test (FIT) results in the National Cancer Screening Program (NCSP) for colorectal cancer may lead to unnecessary procedures, such as colonoscopies, increasing the medical costs. We estimated reductions in the cost of National Health Insurance according to the accreditation status of screening facilities participating in the NCSP for colorectal cancer.

Methods

We used data collected between 2007 and 2010 from NCSP and the Korea Central Cancer Registry to identify patients with colorectal cancer. We also ascertained the history of the accreditation of each facility by the Korean Laboratory Accreditation Program (KLAP). Budget impact was defined as a reduction in medical costs achieved when the false-positive rate of the non-accredited facilities decreased relative to that of the accredited facilities.

Results

A total of 3,285 screening facilities participated in the NCSP. Of these, 196 were accredited by the KLAP. The false-positive rate of the accredited facilities was 2.47%, and that of the non-accredited facilities was 6.83%. Medical costs were estimated to be reduced by approximately 19 million US dollars (USD), and the cost of detecting one case of colorectal cancer was estimated to decrease from 9,212 USD to 7,332 USD if the false-positive rate of non-accredited facilities were decreased to that of the accredited facilities. Clinics were estimated to have the largest associated cost reduction.

Conclusions

Quality assurance in clinical laboratories could lower false-positive rates and prevent the use of unnecessary procedures, ensuring patient safety and increasing the cost-effectiveness of FIT screening in the NCSP for colorectal cancer.

Keywords: Quality improvement, Colorectal cancer, Fecal immunochemical test, Organized screening, Quality assurance, Laboratory accreditation, Cost reduction

The incidence of colorectal cancer is rapidly increasing, making it an important disease in Korea [1]. The National Cancer Screening Program (NCSP) was implemented in 2002 for stomach, breast, and cervical cancer screening. In 2004, colorectal cancer screening using fecal immunochemical tests (FITs) was introduced. FITs measure the concentration of hemoglobin in feces qualitatively or quantitatively [2], and are simple, noninvasive, and inexpensive tests, widely used as an organized population screening method. FITs have been shown to generate fewer false-positive results than guaiac fecal occult blood tests or an alternative test [3].

Although the participation rate for colorectal cancer screening has rapidly increased with the number of cancer screening facilities, issues with the quality assurance of these facilities have been noted [4]. Since 2008, Korean Society of Laboratory Medicine (KSLM), Korean Society of Gastrointestinal Endoscopy (KSGE), and the National Cancer Center of Korea have implemented the National Quality Improvement Program for colorectal cancer screening to evaluate facilities participating in the NCSP, with the goal of improving the quality of colorectal cancer screening [5,6,7,8].

Annually, approximately 3.8 million FITs are performed as a part of the NCSP. Of these, examinees with positive FITs undergo additional colonoscopies, with subsequent polypectomies or biopsies if a lesion or polyp found during initial colonoscopy appears suspicious for colorectal cancer [4,9]. Although false-positive results are often observed in FITs, they could be minimized with quality assurance efforts, and the unnecessary implementation of further tests could be reduced. Consequently, medical costs could be reduced.

The standardization of clinical laboratories should be considered in terms of laboratory practices (including laboratory procedures, policies, and personnel) and laboratory methods (commercial products). A recent report has indicated that the accreditation of clinical laboratories improved the accuracy of the laboratory results [10].

This study aimed to estimate the impact of false-positive results from the NCSP screening facilities with and without participation in the quality assessment program on the health insurance budget.

1. Measures of effectiveness

We reviewed the NCSP database between 2007 and 2010, including data of Korean men and women over 50 years of age. The results of FIT screening were reported as either positive or negative, regardless of the use of qualitative or quantitative methods. For elucidation of cancer occurrence, we used data from the Korea Central Cancer Registry as a gold standard. Individuals were diagnosed as having colorectal cancer in accordance with the International Classification of Disease, 10th revision (ICD-10), codes C18, C19, and C20, within one year of cancer screening. Details of the database construction have been previously described [4,11].

The number of detected colorectal cancer cases and false-positive and false-negative cases was calculated using the constructed database. To estimate the effects of colorectal cancer screening, we assessed the cost of diagnosing colon cancer as the outcome of positive FIT [12]. The financial impact of false-negative results of FIT screening was not included in the analysis of this study. This study was approved by the Institutional Review Board of the National Cancer Center (IRB; #NCCNCS12641).

2. Quality assurance in clinical laboratories

The Korean Laboratory Accreditation Program (KLAP), founded by KSLM in 1999, is a quality assessment program. Detailed information regarding the KLAP is available elsewhere [5]. The screening facilities participating in the NCSP for colorectal cancer were categorized by the number of patient beds as follows: general hospitals (100 beds or more), hospitals (30–99 beds), and clinics (less than 30 beds). The facilities were assessed annually to determine whether they received accreditation from the KLAP and were categorized as “accredited” or “non-accredited”.

3. Cost estimation

We considered the budget impact on the National Health Insurance, rather than the direct and indirect medical expenses of NCSP participants. Furthermore, medical expenses for this study included only the cost of FITs and additional confirmation tests, not any medical expenses incurred after the diagnosis. The cost of screening and diagnosis was calculated based on the costs of the clinic in 2010. We made several assumptions to calculate the expenses. First, only 60% of examinees with positive FIT results underwent colonoscopy [13]. We also conducted sensitivity analyses with fractions of 40% and 80%, which were arbitrarily chosen as the percentages of examinees undergoing colonoscopy. Second, 30% of the examinees who underwent colonoscopy had polyps and subsequently underwent polypectomy and biopsy. The cost of polypectomy and biopsy were imposed based on the number of polyps, but was calculated according to minimum cost standards (1–3 polyps). Third, other indicators, except false-positive rates, were not affected by the KLAP.

We defined the KLAP budget impact as a reduction in additional screening costs when the false-positive rate of non-accredited screening facilities decreased to that of the accredited facilities. We set up scenarios to evaluate budget impact on the increase in the number of screening facilities with KLAP accreditation based on the stage as follows: current, maintenance of the proportion of current accredited facilities; scenario I, assumption that all the screening facilities of general hospitals were accredited; scenario II, assumption that all the screening facilities of general hospitals and hospitals were accredited; ideal, assumption that all the screening facilities were accredited.

A total of 3,285 screening facilities participated in the NCSP between 2007 and 2010. Of these, 196 facilities were accredited by the KLAP. These facilities were mostly (95.4%) general hospitals. There were only five accredited clinics, and these included 272,521 examinees (representing 13.2% of the total number of FITs) (Table 1).

Conversely, most of the non-accredited screening facilities were clinics, and the number of facilities and FITs were 2,018 and 3,511,521, respectively. The false-positive rate for all the accredited screening facilities was 2.47%, which was lower than that for non-accredited facilities (6.83%). The false-positive rates for accredited general hospitals, hospitals, and clinics were 2.64%, 2.90%, and 1.37%, respectively, and those for non-accredited screening facilities were 5.52%, 8.51%, and 6.41%, respectively (Table 2).

Non-accredited facilities incurred costs of 81,373,334 US dollars (USD) for FIT expenses and additional tests; however, if the false-positive rate decreased to that of accredited facilities, these costs would decline to approximately 62,594,315 USD, resulting in a financial reduction effect of approximately 18,779,019 USD (Table 3). In the current status of accreditation, the cost of detecting a single case of colorectal cancer is approximately 9,212 USD; however, accreditation of all screening facilities would reduce the cost to approximately 7,332 USD. The greatest financial reduction effect would be achieved with accreditation of all the clinics (Fig. 1).

The false-positive rates of the FIT screening facilities participating in the NCSP differed according to the accreditation of the quality assessment program. Accredited screening facilities had remarkably lower false-positive rates than those of the non-accredited facilities. These differences were clearly shown to be associated with the type of screening facility. If the false-positive rates of non-accredited screening facilities decreased to that of accredited facilities, then colorectal cancer could be detected more efficiently, reducing insurance costs associated with the colorectal cancer NCSP. Notably, this budget-saving effect was most apparent to clinics.

According to the World Health Organization, accreditation is the most commonly used external mechanism to improve standard-based quality in the medical field [14]. The KLAP is a quality assurance system for clinical laboratories in Korea and is designed to assess a comprehensive quality standard checklist related to the practices of clinical laboratories through peer review. The KLAP checklist is designed to determine and manage the structure, process, and outcome of the laboratory practice, and to continually identify focus areas and encourage activities for improvement. This process appears to improve the quality of laboratory practice by enhancing the confidence and ability of laboratory workers [5].

Only 6% of the facilities participating in the NCSP for colorectal cancer screening were accredited by the KLAP; these facilities were primarily general hospitals. The five accredited clinics were institutions offering comprehensive health checkups and performing approximately 272,000 FITs. There were 2,018 (65.3%) non-accredited clinics, performing approximately 3,511,000 (57.1%) FITs. Of these non-accredited screening facilities, over 600 facilities examined fewer than 100 FITs annually. Screening facilities with lower hospital volume have a lower awareness of and willingness to participate in external quality control of their clinical laboratories, due to the financial burden involved. Since 2007, KSLM has conducted an external quality assessment of FITs, using external quality assessment materials. A total of 650 general hospitals and hospitals participated in the external quality assessment of KSLM between 2007 and 2009, and the number of participating facilities has not increased [6,7].

If all facilities participating in the NCSP for colorectal cancer could maintain the false-positive rates of accredited facilities, this would result in financial savings of approximately 19 million USD, with the largest effects observed in clinics and the smallest effects observed in general hospitals (clinics, 12,396,009 USD; hospitals, 6,512,547 USD; and general hospitals, 1,975,400 USD). However, there are 2,018 clinics requiring additional accreditation, compared with only 180 general hospitals and 891 hospitals. The financial reduction effect per additional accredited facility was the largest for general hospitals and the smallest for clinics (general hospitals, 10,974 USD; hospitals, 7,309 USD; and clinics, 6,143 USD).

In contrast to the considerable interest generated by quality assurance for invasive screening tests, such as colonoscopy, the importance of quality assurance for FITs has not yet been extensively studied [8,15]. However, in the NCSP, if the FIT result is positive, additional colonoscopy tests are recommended [16]. Therefore, appropriate assessment of quality assurance based on FITs may minimize unnecessary colonoscopies. Once the accuracy of FIT screening is improved and the harm from screening is minimized, the NCSP will be more effective and efficient [17,18].

The screening interval for colorectal cancer based on the NCSP was changed from two years to one year in 2012, and continuous efforts to increase the participation rates will increase the number of FIT examinees [4]. If four million FITs are implemented annually as a part of the NCSP, the health insurance budget related to the NCSP for colorectal cancer can save 10,168,208 USD each year by quality control efforts. However, it is not easy to implement a quality assessment program for all the screening facilities participating in the NCSP; therefore, general hospitals and hospitals are preferentially encouraged to participate in the quality assessment programs. Internal and external quality assessment programs for clinics need to be developed to provide high-quality colorectal cancer screening. Furthermore, strategies to increase the hospital volume of clinics participating in the NCSP should also be developed.

This study had several limitations. First, assessment items included in the KLAP did not include items related to FITs. The presence of accreditation in the KLAP did not directly reflect the reliability of the FIT process. This may explain the reason for lower false-positivity of accredited laboratories than that of non-accredited ones. However, KLAP accreditation could be used as an indicator of the overall status of a laboratory. Second, we did not consider different FIT cut-off levels according to equipment and test reagents from different manufacturers. Third, the range of the health insurance budget was restricted to the cost of screening and diagnosis and did not include any other medical expenses, such as treatment or out-of-pocket costs. Finally, we did not consider the effects of false-negative results on the budget. Although the impact on the budget was considered, we could not distinguish between preventable (missing interval cancers) and unavoidable cases (true interval cancers).

In conclusion, participation of laboratories in a quality assessment program could reduce false-positive rates and minimize the requirement of unnecessary tests, thereby increasing the cost-effectiveness of colorectal cancer screening programs. Strategies to encourage screening facilities to participate in quality assessment programs should be developed. Moreover, efforts to develop quality assessment programs according to hospital type are required to improve the quality of cancer screening services.

The authors declare that there is no conflict of interest relevant to this article.

This study was supported by the Soonchunhyang University Research Fund, and by a Grant-in-Aid for the Korea Centers for Disease Control and Prevention, Republic of Korea (#2014-187).

Fig. 1.

Changes in the reduction in medical costs according to the proportion of facilities accredited by the Korean Laboratory Accreditation Program (KLAP). The error bars on the gray bars and black circles represent the colonoscopy performed assuming 40% and 80% sensitivity, respectively.

Current, Maintenance of the proportion of KLAP-accredited facilities; Scenario I, Assumption of accreditation of all general hospitals by the KLAP; Scenario II, Assumption of accreditation of all general hospitals and hospitals by the KLAP; Ideal, Assumption of accreditation of all screening facilities by the KLAP.


Number of screening facilities and examinees in the National Cancer Screening Program for colorectal cancer between 2007 and 2010 according to accreditation by the Korean Laboratory Accreditation Program

Screening facilities*AccreditedNon-accredited
Facilities N (%)FITs N (%)Facilities N (%)FITs N (%)
General hospital187 (95.4)1,780,829 (86.2)180 (5.8)978,875 (15.9)
Hospital4 (2.0)13,044 (0.6)891 (28.8)1,658,602 (27.0)
Clinic5 (2.6)272,521 (13.2)2,018 (65.3)3,511,521 (57.1)
Total196 (100.0)2,066,394 (100.0)3,089 (100.0)6,148,998 (100.0)

Outcomes of the National Cancer Screening Program for colorectal cancer between 2007 and 2010 according to accreditation by the Korean Laboratory Accreditation Program

Screening resultsAccreditedNon-accredited
Cancer*No cancerTotalFPR (%)CancerNo cancerTotalFPR (%)
Overall2.476.83
 Positive2,12650,99253,1188,984419,178428,162
 Negative1,9912,011,2852,013,2765,4815,715,3555,720,836
General hospital2.645.52
 Positive1,86146,89648,7571,32453,91155,235
 Negative1,7551,730,3171,732,072846922,794923,640
Hospital2.908.51
 Positive143783922,486140,817143,303
 Negative1312,63912,6521,4441,513,8551,515,299
Clinic1.376.41
 Positive2513,7183,9695,174224,450229,624
 Negative223268,329268,5523,1913,278,7063,281,897

Estimated costs of the National Cancer Screening Program for colorectal cancer according to accreditation by the Korean Laboratory Accreditation Program

AccreditedNon-accreditedReducible medical cost (ab)§% Reducible medical cost (ab/a)
CostCost (a)Expected cost (b)
Overall
 FIT screening17,244,59451,314,98351,314,983
 Colonoscopy*1,787,38714,407,3835,406,340
 Polypectomy1,666,71713,434,7135,041,347
 Biopsy274,9502,216,255831,645
 Total20,973,64981,373,33462,594,31518,779,01923.1
General hospital
 FIT screening14,861,4808,168,9668,168,966
 Colonoscopy*1,640,6431,858,623911,787
 Polypectomy1,529,8801,733,144850,230
 Biopsy252,376285,908140,258
 Subtotal18,284,37812,046,64110,071,2411,975,40016.4
Hospital
 FIT screening108,85613,841,46413,841,464
 Colonoscopy*13,1914,822,0561,700,503
 Polypectomy12,3004,496,5101,585,698
 Biopsy2,029741,766261,584
 Subtotal136,37523,901,79617,389,2496,512,54727.2
Clinic
 FIT screening2,274,25829,304,55429,304,554
 Colonoscopy*133,5547,726,7041,785,125
 Polypectomy124,5387,205,0591,664,608
 Biopsy20,5441,188,581274,602
 Subtotal2,552,89545,424,89833,028,88912,396,00927.3

  1. Jung KW, Won YJ, Oh CM, Kong HJ, Lee DH, Lee KH. Cancer statistics in Korea: incidence, mortality, survival, and prevalence in 2014. Cancer Res Treat 2017;49;292-305.
    Pubmed
  2. Park MJ, Choi KS, Lee YK, Jun JK, Lee HY. A comparison of qualitative and quantitative fecal immunochemical tests in the Korean national colorectal cancer screening program. Scand J Gastroenterol 2012;47;461-466.
    Pubmed
  3. Young GP, Symonds EL, Allison JE, Cole SR, Fraser CG, Halloran SP, et al. Advances in fecal occult blood tests: the FIT revolution. Dig Dis Sci 2015;60;609-622.
    Pubmed
  4. Suh M, Song S, Cho HN, Park B, Jun JK, Choi E, et al. Trends in participation rates for the National Cancer Screening Program in Korea, 2002-2012. Cancer Res Treat 2017;49;798-806.
    Pubmed
  5. Shin BM, Chae SL, Min WK, Lee WG, Lim YA, Lee DH, et al. The implementation and effects of a clinical laboratory accreditation program in Korea from 1999 to 2006. Korean J Lab Med 2009;29;163-170.
    Pubmed
  6. Yoo SJ, Cha YJ, Min WK, Lee YK, Chae SL, Shin BM, et al. Current status of external quality assessment of fecal occult blood test. Korean J Lab Med 2010;30;726-733.
    Pubmed
  7. Jeon CH, Lee AJ, Kim KD. Annual report on external quality assessment scheme for urinalysis and faecal occult blood testing in Korea (2014). J Lab Med Qual Assur 2015;37;179-189.
  8. Cha JM, Moon JS, Chung IK, Kim JO, Im JP, Cho YK, et al. National Endoscopy Quality Improvement Program remains suboptimal in Korea. Gut Liver 2016;10;699-705.
    Pubmed
  9. Lin JS, Piper MA, Perdue LA, Rutter CM, Webber EM, O'Connor E, et al. Screening for colorectal cancer: updated evidence report and systematic review for the US Preventive Service Task Force. JAMA 2016;315;2576-2594.
    Pubmed
  10. Jang MA, Yoon YA, Song J, Kim JH, Min WK, Lee JS, et al. Effect of accreditation on accuracy of diagnostic tests in medical laboratories. Ann Lab Med 2017;37;213-222.
    Pubmed
  11. Shin A, Choi KS, Jun JK, Noh DK, Suh M, Jung KW, et al. Validity of fecal occult blood test in the National Cancer Screening Program, Korea. PLoS One 2013;8:e79292.
    Pubmed
  12. Lee HY, Park EC, Jun JK, Choi KS, Hahm MI. Comparing upper gastrointestinal X-ray and endoscopy for gastric cancer diagnosis in Korea. World J Gastroenterol 2010;16;245-250.
    Pubmed
  13. Choi KS, Lee HY, Jun JK, Shin A, Park EC. Adherence to follow-up after a positive fecal occult blood test in an organized colorectal cancer screening program in Korea, 2004-2008. J Gastroenterol Hepatol 2012;27;1070-1077.
    Pubmed
  14. Array. Quality and accreditation in health care services: a global review. Geneva: World Health Organization.
  15. Robertson DJ, Kaminski MF, Bretthauer M. Effectiveness, training and quality assurance of colonoscopy screening for colorectal cancer. Gut 2015;64;982-990.
    Pubmed
  16. Suh M, Choi KS, Park B, Lee YY, Jun JK, Lee DH, et al. Trends in cancer screening rates among Korean men and women: results of the Korean National Cancer Screening Survey, 2004-2013. Cancer Res Treat 2016;48;1-10.
    Pubmed
  17. Knudsen AB, Zauber AG, Rutter CM, Naber SK, Doria-Rose VP, Pabiniak C, et al. Estimation of benefits, burden, and harms of colorectal cancer screening strategies: modeling study for the US Preventive Services Task Force. JAMA 2016;315;2595-2609.
    Pubmed
  18. Lee KS. Cost-effectiveness of colorectal cancer screening interventions with their effects on health disparity being considered. Cancer Res Treat 2016;48;1010-1019.
    Pubmed