Skip to main content
Download PDF
Download ePub
  • Research article
  • Open access
  • Published:

Analysis of preoperative computed tomography radiomics and clinical factors for predicting postsurgical recurrence of papillary thyroid carcinoma

Cancer Imaging volume 23, Article number: 118 (2023) Cite this article

Abstract

Background

Postsurgical recurrence is of great concern for papillary thyroid carcinoma (PTC). We aim to investigate the value of computed tomography (CT)-based radiomics features and conventional clinical factors in predicting the recurrence of PTC.

Methods

Two-hundred and eighty patients with PTC were retrospectively enrolled and divided into training and validation cohorts at a 6:4 ratio. Recurrence was defined as cytology/pathology-proven disease or morphological evidence of lesions on imaging examinations within 5 years after surgery. Radiomics features were extracted from manually segmented tumor on CT images and were then selected using four different feature selection methods sequentially. Multivariate logistic regression analysis was conducted to identify clinical features associated with recurrence. Radiomics, clinical, and combined models were constructed separately using logistic regression (LR), support vector machine (SVM), k-nearest neighbor (KNN), and neural network (NN), respectively. Receiver operating characteristic analysis was performed to evaluate the model performance in predicting recurrence. A nomogram was established based on all relevant features, with its reliability and reproducibility verified using calibration curves and decision curve analysis (DCA).

Results

Eighty-nine patients with PTC experienced recurrence. A total of 1218 radiomics features were extracted from each segmentation. Five radiomics and six clinical features were related to recurrence. Among the 4 radiomics models, the LR-based and SVM-based radiomics models outperformed the NN-based radiomics model (P = 0.032 and 0.026, respectively). Among the 4 clinical models, only the difference between the area under the curve (AUC) of the LR-based and NN-based clinical model was statistically significant (P = 0.035). The combined models had higher AUCs than the corresponding radiomics and clinical models based on the same classifier, although most differences were not statistically significant. In the validation cohort, the combined models based on the LR, SVM, KNN, and NN classifiers had AUCs of 0.746, 0.754, 0.669, and 0.711, respectively. However, the AUCs of these combined models had no significant differences (all P > 0.05). Calibration curves and DCA indicated that the nomogram have potential clinical utility.

Conclusions

The combined model may have potential for better prediction of PTC recurrence than radiomics and clinical models alone. Further testing with larger cohort may help reach statistical significance.

Background

Papillary thyroid carcinoma (PTC) is the most prevalent histological type of thyroid cancer, accounting for more than 80% of all thyroid malignancies. Unlike most other malignancies that focus on overall survival, postsurgical recurrence is of greater concern for PTC. Because of its indolent biological behavior, the mortality of patients with PTC is much lower, with an overall 10-year survival rate reaching ≥ 93% [1, 2]. However, the recurrence of PTC is relatively high, reported at 14–26% [1, 3,4,5,6,7,8], among whom, more than 30% may succumb to the disease [8]. One previous study with a total of 12 years of follow-up found that most patients developed recurrence within 5 years after surgery [9]. Furthermore, postsurgical recurrence exacerbates the psychological and economic burdens on patients. Thus, it is crucial to identify patients with PTC who are at high risk of recurrence so that individualized treatment can be tailored, including initial surgical planning, postoperative complementary therapy, intensiveness of postoperative supervision, and other management strategies.

It has been reported that tumor factors (e.g., aggressive histology, extrathyroidal extension (ETE), locoregional tissues invasion, and distant metastases) and lymph node (LN) factors (e.g., LN metastases, the size and number of involved LN) are important risk factors for PTC recurrence after surgery [7, 8, 10,11,12,13,14]. They were also included into the American Thyroid Association (ATA) risk stratification system declared in 2015 [15]. Computed tomography (CT), a routine clinical imaging modality, is capable of depicting detailed and objective anatomical information and, accordingly, can potentially provide many prognostic factors of patients with PTC [16, 17].

Moreover, large amounts of available data in CT images remain underutilized. Radiomics allows the conversion of digitally encrypted CT images into quantitatively mineable feature information on tumor morphology and pathophysiology, which may be related to clinical events in tumor management [18,19,20]. Radiomics based on CT has been demonstrated to be useful in predicting outcome for hepatocellular carcinoma, lung cancer, esophageal carcinoma, and colorectal cancer [21,22,23,24,25,26,27]. Remarkably, in those cancers, models that combined radiomics features with clinical risk factors achieved better performance than conventional approaches. Multiple studies have demonstrated that radiomics models and nomogram are useful for the prediction of PTC prognostic factors such as LN metastases and ETE [28,29,30]. And the usefulness of radiomics based on ultrasound for predicting PTC prognosis has been confirmed [31, 32].

However, to the best of our knowledge, no previous study has focused on CT-based radiomics to predict PTC recurrence. Hence, we aimed to investigate the value of CT-based radiomics features and conventional clinical factors in predicting the postsurgical recurrence of PTC.

Methods

Patients

This retrospective study was approved by our Institutional Review Board and the requirement for patient informed consent was waived. Between January 2012 and June 2015, 7286 consecutive patients underwent thyroid surgery at our institution. Our inclusion criteria were as follows: (a) pathologically confirmed papillary thyroid carcinoma with size ≥ 10 mm; (b) enhanced CT examination of the neck performed within 2 weeks before surgery; and (c) complete clinical and histopathology information. We excluded patients (a) for whom CT images were unavailable or degraded with significant artifacts; (b) who had a history of other malignancies, and (c) who underwent anti-tumor treatment before surgery. Finally, a total of 280 patients were recruited in our study. These patients were randomly divided into a training cohort (169 patients) and a validation cohort (111 patients) at a ratio of 6:4. The screening process is illustrated in Fig. 1. We utilized a combination of medical records review and telephone callbacks to follow up patients. Recurrence was defined as a cytology/pathology-proven disease or morphological evidence of lesions on imaging examinations detected within 5 years after surgery.

Fig. 1
figure 1

Flowchart of patient enrollment and allocation. CT: Computed tomography; PTC: Papillary thyroid carcinoma

Full size image

Acquisition of clinicopathological characteristics

Clinicopathological characteristics were obtained from the patients’ medical records, and included age, sex, tumor size, number of metastatic LN, surgical options (subtotal or semi-total thyroidectomy, or total thyroidectomy), T stage, N stage, presence of bilaterality, multifocality, extrathyroidal extension, background concomitant thyroid diseases (e.g., nodular goiter and Hashimoto’s thyroiditis), history of 131I radiotherapy, and family history of PTC. The T and N stages were determined based on the seventh edition of the American Joint Committee on Cancer staging system.

CT image evaluation

Preoperative enhanced CT was performed using three multi-slice spiral CT scanners (Discovery CT750 HD, Optima CT660, and LightSpeed VCT; GE Healthcare, Milwaukee, WI, USA). The imaging and post-processing protocols are detailed in Additional file 1. Two radiologists (Z.Y. and X.H.J., with 6 and 4 years of experience in head and neck imaging, respectively) independently reviewed the CT images from the picture archiving and communication system. Any differences were resolved by consensus through discussion and confirmed by L.L. (with 20 years of experience in head and neck imaging). All radiologists were blinded to the clinical outcomes. To be more precise and accurate, if multifocal lesions were present, we focused only on the largest lesion, while matching the corresponding tumor on the CT images to those examined by gross pathology based on location and size [13, 33]. The morphological CT image characteristics of the tumors were obtained, including shape (regular or irregular), margins (well-defined or ill-defined), presence of calcification, and CT-reported LN status (positive or negative). Positive LN status was defined by the presence of at least one of the following CT features: enhancement pattern (heterogeneous or rim), suspicious calcification, and cystic or necrotic changes, based on published criteria [34,35,36,37].

Tumor segmentation and radiomics feature extraction

Reader 1 (W.W.L., with 15 years of experience in head and neck imaging) manually segmented the tumors on each consecutive transverse section of the contrast-enhanced CT images using ITK-SNAP (version 3.6.0, http://www.itksnap.org), which was then reviewed by a senior radiologist (L.L.). Interobserver consistency in tumor segmentation was assessed by calculating the Dice similarity coefficient (DSC). Readers 1 (W.W.L) and 2 (X.H.J.) independently segmented the tumors from the images of 30 randomly selected cases, before calculating the DSC between segmentations for absolute agreement from each case. A DSC index of more than 0.70 represented good consistency [38]. We carried out image pre-processing and feature extraction in FeAture Explorer (version 0.5.2), which incorporates the open-source package Pyradiomics [39]. To ensure a consistent intensity resolution across all tumor images, the voxel spacing was standardized using B-Spline interpolation, resampling the images to a voxel size of 1 × 1 × 1 mm3. Additionally, for gray-level discretization, a fixed bin width of 25 HU was chosen to reduce the noise and to normalize the intensity of the image.

Feature reduction and selection

We extracted 1218 radiomics features from each three-dimensional segmentation. Least absolute shrinkage and selection operator (LASSO) regression was conducted to identify the most significant features related to recurrence. LASSO regression analysis is a penalized technique for feature selection of high-dimensional data to avoid overfitting [40]. Features with zero variance or high collinearity with other features (i.e., no variation or multicollinearity in feature values across patients) were removed from the analysis [41]. To reduce the redundancy of radiomics features, Pearson’s correlation analysis was conducted, and one of the paired features with a correlation coefficient > 0.6 was eliminated. Multivariate logistic regression analysis was performed using the backward selection method to identify clinical features associated with recurrence. Akaike information was used as the stopping criterion.

Model construction and validation

Radiomics, clinical, and combined models were constructed separately using the following four classifiers for predicting PTC recurrence: logistic regression (LR), support vector machine (SVM), k-nearest neighbor (KNN), and neural network (NN). The radiomics model was established on selected radiomics features, the clinical model was established on independent clinical features, and the combined model was established on both radiomics and clinical features. Receiver operating characteristic (ROC) curves were plotted, and the area under the curve (AUC) was calculated to evaluate the predictive performance of these models in the training and validation cohorts.

Model interpretation

A respective radiomics signature (named “Rad-score”) was constructed by combining selected radiomics features. We then constructed a nomogram in R using the “rms” package, which involved integrating the Rad-score and the selected clinical risk factors. Calibration curves of the nomogram were obtained by plotting the predicted probability and actual observed proportion of recurrence using bootstraps with 1000 resamples. A good degree of calibration was achieved when the curve approximated the diagonal line, indicating high accuracy of the nomogram [42]. Decision curve analysis (DCA) was implemented in R using the “rmda” package, which involved the quantification of the clinical net benefits at a variety of risk threshold probabilities. The highest curve at a given threshold probability indicates the best prediction model with potential clinical utility in predicting PTC recurrence [43]. Figure 2 shows the workflow of the radiomics analysis.

Fig. 2
figure 2

Workflow scheme of the radiomics analysis. KNN: K-nearest neighbor; LR: Logistic regression; NN: Neural network; PCC: Pearson’s correlation coefficient; SVM: Support vector machine

Full size image

Statistical analysis

The Shapiro–Wilk test was used to determine whether the distribution of continuous variables was normal. Comparisons of the clinical features were performed using the Student’s t-test or Mann–Whitney U test for continuous variables and the chi-square test or Fisher’s exact test for categorical variables, as applicable. The DeLong test was used to compare the AUC of different models. The accuracy, specificity, and sensitivity of the models were calculated for each model. All statistical analyses were performed using R (version 4.0.2) and SPSS (version 26.0) software. All levels of statistical significance were two-sided, and P-values < 0.05 were considered a statistically significant difference.

Results

Characteristics of the study cohort

A total of 280 patients with pathologically confirmed PTC, including 186 women (40.40 ± 13.71 years; range: 19–77 years) and 94 men (41.40 ± 13.46 years; range: 21–70 years), were enrolled in this study. One hundred and seventy-nine patients were regularly followed up at our hospital, and the other 101 patients were called for the prognosis information. The training and validation cohorts had similar clinicopathological-radiologic characteristics of the patients, with no significant differences, which are summarized in Table 1. The clinicopathologic and morphological CT features of patients with and without disease recurrence were compared in Table 2, which showed significant differences in age, sex, tumor size, number of metastatic LN, T stage, N stage, bilaterality, history of 131I radiotherapy, and CT-reported LN status. For patients with and without recurrence, the follow-up period was 6 to 59 months (median 14.5 months) and 60 to 112 months (median 78 months), respectively. Consequently, the follow-up durations for the study cohort ranged from 6 to 112 months, with 68 months as the median. During follow-up, recurrence was detected in 89 patients within 5 years after surgery.

Table 1 Baseline characteristics of patients in the training and validation cohorts
Full size table
Table 2 Baseline characteristics of patients with and without disease recurrence
Full size table

Feature extraction and selection

Two readers showed good consistency in manual segmentation with a DSC of 0.83 ± 0.04 (range: 0.76–0.90). A total of 1218 radiomics features were initially extracted, which are listed in Additional file 2. One-hundred and seventy features related to recurrence were selected after LASSO regression. No features had a near-zero variance, and one feature was removed from the dataset because of its high collinearity with other features. After Pearson’s correlation analysis, the following five radiomics features associated with recurrence were selected: original-shape-sphericity, log-sigma-2-0-mm-3D-GLCM (Grey-Level co-occurrence matrix)-informational measure of correlation 2, wavelet-HLL-firstorder-mean, log-sigma-3-0-mm-3D-firstorder-90 percentile, and wavelet-LLL-firstorder-skewness. A flowchart of the radiomics feature selection process is shown in Additional file 3. After multivariate logistic regression analysis using backward selection, six clinical features, including age, number of metastatic LN, CT-reported LN status, T stage, presence of bilaterality, and multifocality, were identified to be related to recurrence (Table 3). The first three radiomics features and the presence of multifocality were negatively correlated with PTC recurrence, whereas the other features were positively correlated.

Table 3 Clinical features associated with recurrence identified by multivariate logistic regression analysis using backward selection
Full size table

Model development and validation

The ROC curves for the radiomics, clinical, and combined models in the training and validation cohorts are shown in Figs. 3 and 4. The predictive performances of the models in the validation cohort are detailed in Table 4. Figure 5 shows the P-value calculated using Delong test to compare the AUC values of the models. Among the 4 radiomics models, the LR-based and SVM-based radiomics models outperformed the NN-based radiomics model (P = 0.032 and 0.026, respectively). Among the 4 clinical models, only the difference between the AUC of the LR-based and NN-based clinical model was statistically significant (P = 0.035). The combined models had higher AUC values than the corresponding radiomics and clinical models based on the same classifier, although most differences were not statistically significant. However, the SVM-based combined model significantly outperformed the clinical model, and the NN-based combined model had significant improvement than the radiomics model (P = 0.034 and 0.041, respectively). This finding indicates that the combination of radiomics and clinical features have potential improvement in predicting recurrence of PTC. In the validation cohort, the AUCs of the combined models based on the LR, SVM, KNN, and NN classifiers were 0.746 (95% [confidence interval (CI)]: 0.640–0.852), 0.754 (95% CI: 0.649–0.859), 0.669 (95% CI: 0.552–0.785), and 0.711 (95% CI: 0.607–0.816), respectively. The accuracies were 0.739, 0.766, 0.730 and 0.766, respectively. However, the AUCs of these combined models had no significant differences (all P > 0.05).

Fig. 3
figure 3

Receiver operating characteristic (ROC) curves for the radiomics models (A) and clinical models (B). AUC: Area under the receiver operating characteristic curve; KNN: K-nearest neighbor; LR: Logistic regression; NN: Neural network; SVM: Support vector machine

Full size image
Fig. 4
figure 4

Receiver operating characteristic (ROC) curves for the combined models. AUC: Area under the receiver operating characteristic curve; KNN: K-nearest neighbor; LR: Logistic regression; NN: Neural network; SVM: Support vector machine

Full size image
Table 4 Performance of the models for predicting PTC recurrence in the validation cohort
Full size table
Fig. 5
figure 5

The P-values calculated by comparing the AUC between models using the Delong test. (A: radiomics model, B: clinical model, C: combined model) The P-value was calculated by comparing the AUC of the model with that of the same type of model based on another classifier. (D: LR classifier, E: SVM classifier, F: KNN classifier, G: NN classifier) The P-value was calculated by comparing the AUC of the model with that of another model based on the same classifier. *Statistically significant difference. AUC: Area under the receiver operating characteristic curve; KNN: K-nearest neighbor; LR: Logistic regression; NN: Neural network; SVM: Support vector machine

Full size image

Model interpretation with the nomogram and DCA

The formula for calculating the Rad-score is as follows:

log (Rad-score) = 11.504 + -12.463 × original-shape-sphericity + -4.323 × log-sigma-2-0-mm-3D-GLCM-informational measure of correlation 2 + -0.049 × wavelet-HLL-firstorder-mean + 0.014 × log-sigma-3-0-mm-3D-firstorder-90 percentile + 0.001 × wavelet-LLL-firstorder-skewness.

A nomogram was constructed by combining the Rad-score with six clinical features using multivariate logistic regression to provide individualized risk estimates (Fig. 6A). The calibration curves of the nomogram approximated the diagonal line in Fig. 6B, especially in the validation cohort, indicating high accuracy for recurrence prediction. According to the DCA results (Fig. 7), the LR-based combined model provided the highest net benefit in comparison to the other two models and simple strategies (tracking all patients or none) when the patients’ threshold probability was within a reasonable range.

Fig. 6
figure 6

Nomogram established to provide individualized risk estimates (A), which was verified by calibration curves (B). Calibration curves describe the agreement between the probability of recurrence predicted by the nomogram and the actual positive proportion of recurrence. The red and green solid lines represent the apparent and bias-corrected predictive performances of the nomogram, respectively, whereas the diagonal line represents the ideal performance

Full size image
Fig. 7
figure 7

Decision curve analysis of models for predicting PTC recurrence in the validation cohort. The x-axis represents the threshold probability. The y-axis represents the net benefit calculated by summing the benefits (true-positive results) and subtracting the harms (false-positive results). The LR-based combined model provided the highest net benefit compared to simple strategies (tracking all patients or no patients) and the other two models when the patients’ threshold probability was within a reasonable range. LR: Logistic regression; PTC: Papillary thyroid carcinoma

Full size image

Discussion

In this study, we identified 5 radiomics features and 6 clinical risk factors that were associated with postsurgical recurrence of PTC. Radiomics, clinical, and combined models were constructed using four classifiers (LR, SVM, KNN, and NN) to predict PTC recurrence after the initial surgery. In the validation cohort, all models had favorable accuracy (0.676–0.766) and specificity (0.842-1) but relatively low sensitivity (0-0.486). The combined model integrating radiomics and clinical features exhibited highest AUC in the validation cohort. The nomogram incorporating all features enable us to obtain patient’s risk of postoperative recurrence in a short period of time after surgery, which will provide certain help to evaluate treatment schedules and follow-up protocols.

Only 280 of 7286 assessed patients were included in the final study. According to the ATA guidelines for the management of patients with differentiated thyroid cancer [15], the majority of patients with PTC did not undergo CT examination before surgery, which was the main exclusion factor of our investigation. Together with the influence of other factors (including incomplete clinical data, image artifacts, etc.), most patients were excluded. However, patients with larger and more advanced tumors tend to receive CT examination to detect the involvement extent. Our findings are valuable for predicting postoperative recurrence probability of these patients with PTC.

In our study, one shape-based feature (i.e., original-shape-sphericity), one texture feature (i.e., log-sigma-2-0-mm-3D-GLCM-informational measure of correlation 2), and three first-order features (i.e., wavelet-HLL-firstorder-mean, log-sigma-3-0-mm-3D-firstorder-90 percentile, and wavelet-LLL-firstorder-skewness) were selected as relevant predictors of PTC recurrence, and the first three were negatively correlated with the outcomes. Sphericity, which describes and quantifies the spherical shape of a tumor, has been reported as a stable radiomics shape feature that is rarely influenced by slice thickness, volume, or resampling [44]. A less spherical shape corresponds to an irregular tumor morphology, which is usually associated with a more aggressive nature of PTC, such as a larger tumor size and gross extrathyroidal invasion. Thus, consistently, a lower tumor sphericity was associated with a higher risk of recurrence in our study. In addition, GLCM features can quantify textural information and can be used to identify intra-tumor heterogeneity for a variety of cancer types [23, 45,46,47]. The information measure of correlation is a GLCM-based feature associated with the joint probability of the occurrence of pixel pair entropy. A lower value of this feature indicates a higher heterogeneity in the distribution of intensities of PTC. In our study, PTC with high risk of recurrence after surgery had higher heterogeneity in the intra-lesion texture, which needs further confirmation. Besides, quantifying gray-level frequency distribution, three first-order features selected were associated with the risk of postsurgical recurrence. Two of these features were extracted after wavelet transformation to measure more complex tumor heterogeneity parameters by reflecting the image properties at different scales and orientations [24, 25]. The value of these five radiomics features in predicting recurrence in patients with PTC needs confirmation in the future.

In this study, age, number of metastatic LN, and T stage were identified as high-risk clinicopathological factors for PTC recurrence, which is concordant with the results of previous findings [6, 7, 10, 11]. Another study has reported that the number of metastatic cervical LNs and the ratio of metastatic-to-total dissected cervical LNs are the main risk factors for PTC recurrence among patients younger than 55 years of age, while the size of the thyroid lesions (T stage) was recognized as a predictor in patients older than 55 years of age [14]. In addition, bilaterality and multifocality were associated with PTC recurrence, however, the roles of which in predicting recurrence of PTC are controversial [48,49,50,51]. Notably, multifocality was negatively correlated with PTC recurrence risk in this study. One possible reason is that most patients with multifocal tumors underwent total thyroidectomy (174/178) and therefore had a lower risk of locoregional recurrence compared to patients who underwent thyroid lobectomy because of more thorough surgical involvement. Furthermore, the proportion of multifocal lesions (63.6%) was much higher than that of previous studies (less than 40%) [52,53,54,55], and there may be a selection bias that affects the final accuracy of the results, which needs to be further confirmed in future studies. CT-reported LN status, a preoperative prognostic risk factor, may prompt the surgeons to determine the extent of surgical resection and LN dissection. It was obtained from medical images before surgery and was also incorporated into the models, suggesting the morphology of lymph nodes on CT images may be useful in predicting PTC recurrence after surgery.

Additionally, one previous study reported a positive relationship between PTC recurrence and ETE predicted by radiomics-based nomogram [30]. In our study, ETE was not relevant to the risk of recurrence, probably because of the inclusion of microscopic ETE, which has been reported to have no effect on PTC recurrence in several studies [55,56,57]. Kim et al. concluded that microscopic ETE was not associated with recurrence (p = 0.081), whereas macroscopic ETE was an independent risk factor for poor prognosis with a 13-fold increased relative risk of recurrence [57]. However, some studies argued that patients with PTC who have microscopic ETE are at an increased risk of recurrence compared to patients without ETE [58, 59]. Therefore, the role of ETE in predicting the recurrence of PTC requires further investigation through specialized design.

Our study has some limitations that warrant discussion. First, we used CT images with a 5-mm slice thickness because those with a thinner thickness were unavailable for most of our cohort, which might have influenced the detectability of the tumor and the accuracy of segmentation. However, all tumors were visible on at least two consecutive images because we only segmented lesions larger than 10 mm in diameter. And the manual segmentation had good accuracy and reproducibility because of a confirmation by a senior radiologist and a good interobserver consistency (DSC = 0.83). Second, for those patients with multiple lesions, we focused only on the single largest lesion, because it is challenging to delineate all tumors, which may not accurately reflect the tumor burden. Third, the recurrence rate (31.8%) is higher than that reported in some previous studies [1, 3,4,5,6,7,8]. This may be partly attributed to the exclusion of microcarcinomas in our study, which exhibit a relatively good prognosis. Finally, after four different feature selection methods, out of a total of 1218 radiomics features extracted from each segmentation, only 5 were found to be related to recurrence of PTC. Independent external validation datasets are lacking, which merits further investigation.

Conclusions

Five radiomics features and six clinical risk factors were identified to be associated with postsurgical recurrence of PTC. The combined model may have potential for better predicting PTC recurrence than radiomics and clinical models alone. Further testing with larger cohort may help reach statistical significance.

Data Availability

The datasets used and analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

AUC:

Area under the receiver operating characteristic curve

CT:

Computed tomography

DCA:

Decision curve analysis

DSC:

Dice similarity coefficient

ETE:

Extrathyroidal extension

GLCM:

Grey-Level Co-occurrence Matrix

KNN:

K-nearest neighbor

LASSO:

Least absolute shrinkage and selection operator

LN:

Lymph nodes

LR:

Logistic regression

NN:

Neural network

PTC:

Papillary thyroid carcinoma

ROC:

Receiver operating characteristic

SVM:

Support vector machine

References

  1. Tsang RW, Brierley JD, Simpson WJ, Panzarella T, Gospodarowicz MK, Sutcliffe SB. The effects of Surgery, radioiodine, and external radiation therapy on the clinical outcome of patients with differentiated thyroid carcinoma. Cancer. 1998;82(2):375–88.

    Article  CAS  PubMed  Google Scholar 

  2. Mazzaferri EL, Kloos RT. Clinical review 128: current approaches to primary therapy for papillary and follicular thyroid cancer. J Clin Endocrinol Metab. 2001;86(4):1447–63.

    Article  CAS  PubMed  Google Scholar 

  3. Mazzaferri EL, Young RL. Papillary thyroid carcinoma: a 10 year follow-up report of the impact of therapy in 576 patients. Am J Med. 1981;70(3):511–8.

    Article  CAS  PubMed  Google Scholar 

  4. Simon D, Goretzki PE, Witte J, Röher HD. Incidence of regional recurrence guiding radicality in differentiated thyroid carcinoma. World J Surg. 1996;20(7).

  5. DeGroot LJ, Kaplan EL, McCormick M, Straus FH. Natural history, treatment, and course of papillary thyroid carcinoma. J Clin Endocrinol Metab. 1990;71(2):414–24.

    Article  CAS  PubMed  Google Scholar 

  6. Hay ID, Thompson GB, Grant CS, Bergstralh EJ, Dvorak CE, Gorman CA, et al. Papillary thyroid carcinoma managed at the Mayo Clinic during six decades (1940–1999): temporal trends in initial therapy and long-term outcome in 2444 consecutively treated patients. World J Surg. 2002;26(8):879–85.

    Article  PubMed  Google Scholar 

  7. Simpson WJ, McKinney SE, Carruthers JS, Gospodarowicz MK, Sutcliffe SB, Panzarella T. Papillary and follicular thyroid cancer. Prognostic factors in 1,578 patients. Am J Med. 1987;83(3):479–88.

    Article  CAS  PubMed  Google Scholar 

  8. Lin J-D, Hsueh C, Chao T-C. Early recurrence of papillary and follicular thyroid carcinoma predicts a worse outcome. Thyroid. 2009;19(10):1053–9.

    Article  PubMed  Google Scholar 

  9. Ghori FY, Gutterman-Litofsky DR, Jamal A, Yeung S-CJ, Arem R, Sherman SI. Socioeconomic factors and the presentation, management, and outcome of patients with differentiated thyroid carcinoma. Thyroid: Official Journal of the American Thyroid Association. 2002;12(11):1009–16.

    Article  PubMed  Google Scholar 

  10. Sorrenti S, Carbotta G, Di Matteo FM, Catania A, Pironi D, Tartaglia F et al. Evaluation of Clinicopathological and Molecular parameters on Disease recurrence of papillary thyroid Cancer patient: a retrospective observational study. Cancers (Basel). 2020;12(12).

  11. Shin CH, Roh JL, Song DE, Cho KJ, Choi SH, Nam SY, et al. Prognostic value of Tumor size and minimal extrathyroidal extension in papillary thyroid carcinoma. Am J Surg. 2020;220(4):925–31.

    Article  PubMed  Google Scholar 

  12. Lee SH, Roh JL, Gong G, Cho KJ, Choi SH, Nam SY, et al. Risk factors for recurrence after treatment of N1b papillary thyroid carcinoma. Ann Surg. 2019;269(5):966–71.

    Article  PubMed  Google Scholar 

  13. Kim S-Y, Kwak JY, Kim E-K, Yoon JH, Moon HJ. Association of Preoperative US Features and recurrence in patients with classic papillary thyroid carcinoma. Radiology. 2015;277(2):574–83.

    Article  PubMed  Google Scholar 

  14. Carmel Neiderman NN, Duek I, Kuzmenko B, Ringel B, Warshavsky A, Muhanna N, et al. Histopathological characteristics of N1b papillary thyroid carcinoma are Associated with risk of recurrence. World J Surg. 2022;46(8):1917–25.

    Article  PubMed  Google Scholar 

  15. Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE, et al. 2015 American Thyroid Association Management Guidelines for adult patients with thyroid nodules and differentiated thyroid Cancer: the American Thyroid Association Guidelines Task Force on thyroid nodules and differentiated thyroid Cancer. Thyroid. 2016;26(1):1–133.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Seo YL, Yoon DY, Lim KJ, Cha JH, Yun EJ, Choi CS, et al. Locally advanced thyroid cancer: can CT help in prediction of extrathyroidal invasion to adjacent structures? AJR Am J Roentgenol. 2010;195(3):W240–W4.

    Article  PubMed  Google Scholar 

  17. Zou Y, Zhang H, Li W, Guo Y, Sun F, Shi Y, et al. Prediction of ipsilateral lateral cervical lymph node Metastasis in papillary thyroid carcinoma: a combined dual-energy CT and thyroid function indicators study. BMC Cancer. 2021;21(1):221.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Aerts HJ. The potential of Radiomic-based phenotyping in Precision Medicine: a review. JAMA Oncol. 2016;2(12):1636–42.

    Article  PubMed  Google Scholar 

  19. Lambin P, Leijenaar RTH, Deist TM, Peerlings J, de Jong EEC, van Timmeren J, et al. Radiomics: the bridge between medical imaging and personalized medicine. Nat Reviews Clin Oncol. 2017;14(12):749–62.

    Article  Google Scholar 

  20. Bi WL, Hosny A, Schabath MB, Giger ML, Birkbak NJ, Mehrtash A, et al. Artificial intelligence in cancer imaging: clinical challenges and applications. CA Cancer J Clin. 2019;69(2):127–57.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Ji GW, Zhu FP, Xu Q, Wang K, Wu MY, Tang WW, et al. Radiomic features at contrast-enhanced CT predict recurrence in early stage Hepatocellular Carcinoma: a multi-institutional study. Radiology. 2020;294(3):568–79.

    Article  PubMed  Google Scholar 

  22. Xu X, Zhang HL, Liu QP, Sun SW, Zhang J, Zhu FP, et al. Radiomic analysis of contrast-enhanced CT predicts microvascular invasion and outcome in hepatocellular carcinoma. J Hepatol. 2019;70(6):1133–44.

    Article  PubMed  Google Scholar 

  23. Kim J, Choi SJ, Lee S-H, Lee HY, Park H. Predicting Survival using pretreatment CT for patients with Hepatocellular Carcinoma treated with Transarterial Chemoembolization: comparison of models using Radiomics. AJR Am J Roentgenol. 2018;211(5):1026–34.

    Article  PubMed  Google Scholar 

  24. Thawani R, McLane M, Beig N, Ghose S, Prasanna P, Velcheti V, et al. Radiomics and radiogenomics in Lung cancer: a review for the clinician. Lung Cancer. 2018;115:34–41.

    Article  PubMed  Google Scholar 

  25. Larue R, Klaassen R, Jochems A, Leijenaar RTH, Hulshof M, van Berge Henegouwen MI, et al. Pre-treatment CT radiomics to predict 3-year overall survival following chemoradiotherapy of Esophageal cancer. Acta Oncol. 2018;57(11):1475–81.

    Article  CAS  PubMed  Google Scholar 

  26. Gong J, Zhang W, Huang W, Liao Y, Yin Y, Shi M, et al. CT-based radiomics nomogram may predict local recurrence-free survival in Esophageal cancer patients receiving definitive chemoradiation or radiotherapy: a multicenter study. Radiother Oncol. 2022;174:8–15.

    Article  CAS  PubMed  Google Scholar 

  27. Staal FCR, van der Reijd DJ, Taghavi M, Lambregts DMJ, Beets-Tan RGH, Maas M. Radiomics for the prediction of treatment outcome and survival in patients with Colorectal Cancer: a systematic review. Clin Colorectal Cancer. 2021;20(1):52–71.

    Article  PubMed  Google Scholar 

  28. Jiang M, Li C, Tang S, Lv W, Yi A, Wang B, et al. Nomogram based on Shear-Wave Elastography Radiomics can improve preoperative cervical lymph node staging for papillary thyroid carcinoma. Thyroid. 2020;30(6):885–97.

    Article  PubMed  Google Scholar 

  29. Zhou Y, Su GY, Hu H, Ge YQ, Si Y, Shen MP, et al. Radiomics analysis of dual-energy CT-derived iodine maps for diagnosing metastatic cervical lymph nodes in patients with papillary thyroid cancer. Eur Radiol. 2020;30(11):6251–62.

    Article  CAS  PubMed  Google Scholar 

  30. Xu XQ, Zhou Y, Su GY, Tao XW, Ge YQ, Si Y et al. Iodine maps from dual-energy CT to Predict Extrathyroidal extension and recurrence in papillary thyroid Cancer based on a Radiomics Approach. AJNR Am J Neuroradiol. 2022.

  31. Park VY, Han K, Lee E, Kim EK, Moon HJ, Yoon JH, et al. Association between Radiomics Signature and disease-free survival in conventional papillary thyroid carcinoma. Sci Rep. 2019;9(1):4501.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Lu B, Zhou Y, Lu X, Weng W, Wang S, Lou J. An ultrasound model for predicting recurrence of papillary thyroid carcinoma after complete endoscopic resection. Wideochir Inne Tech Maloinwazyjne. 2022;17(3):524–32.

    PubMed  PubMed Central  Google Scholar 

  33. Zhang H, Hu S, Wang X, He J, Liu W, Yu C, et al. Prediction of cervical lymph node Metastasis using MRI Radiomics Approach in Papillary thyroid carcinoma: a feasibility study. Technol Cancer Res Treat. 2020;19:1533033820969451.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  34. Eun NL, Son EJ, Kim JA, Gweon HM, Kang JH, Youk JH. Comparison of the diagnostic performances of ultrasonography, CT and fine needle aspiration cytology for the prediction of lymph node Metastasis in patients with lymph node dissection of papillary thyroid carcinoma: a retrospective cohort study. Int J Surg. 2018;51:145–50.

    Article  PubMed  Google Scholar 

  35. Som PM. Detection of Metastasis in cervical lymph nodes: CT and MR criteria and differential diagnosis. AJR Am J Roentgenol. 1992;158(5):961–9.

    Article  CAS  PubMed  Google Scholar 

  36. Wu Y-Y, Wei C, Wang C-B, Li N-Y, Zhang P, Dong J-N. Preoperative prediction of cervical nodal Metastasis in papillary thyroid carcinoma: value of quantitative dual-energy CT parameters and qualitative morphologic features. AJR Am J Roentgenol. 2021;216(5):1335–43.

    Article  PubMed  Google Scholar 

  37. Xing Z, Qiu Y, Yang Q, Yu Y, Liu J, Fei Y, et al. Thyroid cancer neck lymph nodes Metastasis: Meta-analysis of US and CT diagnosis. Eur J Radiol. 2020;129:109103.

    Article  PubMed  Google Scholar 

  38. Zijdenbos AP, Dawant BM, Margolin RA, Palmer AC. Morphometric analysis of white matter lesions in MR images: method and validation. IEEE Trans Med Imaging. 1994;13(4):716–24.

    Article  CAS  PubMed  Google Scholar 

  39. Song Y, Zhang J, Zhang Y-D, Hou Y, Yan X, Wang Y, et al. FeAture Explorer (FAE): a tool for developing and comparing radiomics models. PLoS ONE. 2020;15(8):e0237587.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Gui J, Li H. Penalized Cox regression analysis in the high-dimensional and low-sample size settings, with applications to microarray gene expression data. Bioinf (Oxford England). 2005;21(13):3001–8.

    Article  CAS  Google Scholar 

  41. Saladi SM, Javed N, Müller A, Clemons WM. A statistical model for improved membrane protein expression using sequence-derived features. J Biol Chem. 2018;293(13):4913–27.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Iasonos A, Schrag D, Raj GV, Panageas KS. How to build and interpret a nomogram for cancer prognosis. J Clin Oncol. 2008;26(8):1364–70.

    Article  PubMed  Google Scholar 

  43. Vickers AJ, Cronin AM, Elkin EB, Gonen M. Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers. BMC Med Inform Decis Mak. 2008;8:53.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Limkin EJ, Reuzé S, Carré A, Sun R, Schernberg A, Alexis A, et al. The complexity of Tumor shape, spiculatedness, correlates with Tumor radiomic shape features. Sci Rep. 2019;9(1):4329.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Song SH, Park H, Lee G, Lee HY, Sohn I, Kim HS, et al. Imaging phenotyping using Radiomics to Predict Micropapillary Pattern within Lung Adenocarcinoma. J Thorac Oncol. 2017;12(4):624–32.

    Article  PubMed  Google Scholar 

  46. Alongi P, Stefano A, Comelli A, Laudicella R, Scalisi S, Arnone G, et al. Radiomics analysis of 18F-Choline PET/CT in the prediction of Disease outcome in high-risk Prostate cancer: an explorative study on machine learning feature classification in 94 patients. Eur Radiol. 2021;31(7):4595–605.

    Article  CAS  PubMed  Google Scholar 

  47. Du R, Lee VH, Yuan H, Lam K-O, Pang HH, Chen Y, et al. Radiomics Model to Predict Early Progression of Nonmetastatic Nasopharyngeal Carcinoma after Intensity Modulation Radiation Therapy: a Multicenter Study. Radiol Artif Intell. 2019;1(4):e180075.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Wang W, Su X, He K, Wang Y, Wang H, Wang H, et al. Comparison of the clinicopathologic features and prognosis of bilateral versus unilateral multifocal papillary thyroid cancer: an updated study with more than 2000 consecutive patients. Cancer. 2016;122(2):198–206.

    Article  CAS  PubMed  Google Scholar 

  49. Polat SB, Cakir B, Evranos B, Baser H, Cuhaci N, Aydin C, et al. Preoperative predictors and prognosis of bilateral multifocal papillary thyroid carcinomas. Surg Oncol. 2019;28:145–9.

    Article  PubMed  Google Scholar 

  50. Feng JW, Qu Z, Qin AC, Pan H, Ye J, Jiang Y. Significance of multifocality in papillary thyroid carcinoma. Eur J Surg Oncol. 2020;46(10 Pt A):1820–8.

    Article  PubMed  Google Scholar 

  51. Wang F, Yu X, Shen X, Zhu G, Huang Y, Liu R, et al. The Prognostic Value of Tumor Multifocality in clinical outcomes of papillary thyroid Cancer. J Clin Endocrinol Metab. 2017;102(9):3241–50.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Harries V, Wang LY, McGill M, Xu B, Tuttle RM, Wong RJ, et al. Should multifocality be an indication for completion thyroidectomy in papillary thyroid carcinoma? Surgery. 2020;167(1):10–7.

    Article  PubMed  Google Scholar 

  53. Woo J, Kim H, Kwon H. Impact of Multifocality on the recurrence of papillary thyroid carcinoma. J Clin Med. 2021;10(21).

  54. Choi WR, Roh J-L, Gong G, Cho K-J, Choi S-H, Nam SY, et al. Multifocality of papillary thyroid carcinoma as a risk factor for Disease recurrence. Oral Oncol. 2019;94:106–10.

    Article  PubMed  Google Scholar 

  55. Ahn D, Lee GJ, Sohn JH. Recurrence following hemithyroidectomy in patients with low- and intermediate-risk papillary thyroid carcinoma. Br J Surg. 2020;107(6):687–94.

    Article  CAS  PubMed  Google Scholar 

  56. Arora N, Turbendian HK, Scognamiglio T, Wagner PL, Goldsmith SJ, Zarnegar R et al. Extrathyroidal extension is not all equal: Implications of macroscopic versus microscopic extent in papillary thyroid carcinoma. Surgery. 2008;144(6):942-7; discussion 7–8.

  57. Kim JW, Roh J-L, Gong G, Cho K-J, Choi S-H, Nam SY, et al. Extent of Extrathyroidal Extension as a significant predictor of Nodal Metastasis and Extranodal Extension in patients with papillary thyroid carcinoma. Ann Surg Oncol. 2017;24(2):460–8.

    Article  PubMed  Google Scholar 

  58. Tran B, Roshan D, Abraham E, Wang L, Garibotto N, Wykes J, et al. An analysis of the American Joint Committee on Cancer 8th Edition T staging system for papillary thyroid carcinoma. J Clin Endocrinol Metab. 2018;103(6):2199–206.

    Article  PubMed  Google Scholar 

  59. Park JS, Chang JW, Liu L, Jung SN, Koo BS. Clinical implications of microscopic extrathyroidal extension in patients with papillary thyroid carcinoma. Oral Oncol. 2017;72:183–7.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Fund program: Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College Scientific Research Project (SZ2020ZD005).

Author information

Author notes

  1. Yanfeng Zhao and Dehong Luo contributed equally to this work.

Authors and Affiliations

  1. Department of Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China

    Haijun Xu, Yanfeng Zhao, Dan Bao, Lin Li, Meng Lin, Xinming Zhao & Dehong Luo

  2. Medical Imaging Center, Liaocheng Tumor Hospital, Liaocheng, 252000, China

    Wenli Wu

  3. Department of Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China

    Zhou Liu, Ya Zhang & Dehong Luo

Authors
  1. Haijun Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wenli Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yanfeng Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhou Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dan Bao
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Lin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Meng Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Ya Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Xinming Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Dehong Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

XHJ conceived and designed the study, collected data, implemented the study, drafted and revised the manuscript. WWL, LL, and ZY implemented the study. ZYF conceived and designed the study, and performed statistical analysis. LZ analyzed and interpreted data, and critically reviewed and revised the manuscript. BD critically reviewed and revised the manuscript. LM analyzed and interpreted the data. ZXM provided administrative and technical support. LDH obtained the research funding, provided material support, and supervision. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Yanfeng Zhao or Dehong Luo.

Ethics declarations

Ethics approval and consent to participate

This retrospective study was approved by The Institutional Review Board of Cancer Hospital, Chinese Academy of Medical Sciences. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Supplementary Material 2

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, H., Wu, W., Zhao, Y. et al. Analysis of preoperative computed tomography radiomics and clinical factors for predicting postsurgical recurrence of papillary thyroid carcinoma. Cancer Imaging 23, 118 (2023). https://doi.org/10.1186/s40644-023-00629-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40644-023-00629-9

Keywords

Cancer Imaging

ISSN: 1470-7330

Contact us