Table 2 Classification performance of the various models on both the validation and independent test set
| Â | Â | Validation set | Â | Â | Â | Independent test set | Â | Â | Â |
|---|---|---|---|---|---|---|---|---|---|
Data | Model | AUC (95% CI) | ACC | SEN | SPE | AUC (95% CI) | ACC | SEN | SPE |
|  | VGG16 | 76.81(68.82–84.59) | 72.41 | 71.43 | 72.82 | 78.90(73.07–84.28) | 74.44 | 76.71 | 73.6 |
|  | Resnet50 | 89.20(82.50–95.03) | 85.52 | 83.33 | 86.41 | 87.10(81.73–92.04) | 83.33 | 76.71 | 85.79 |
|  | Efficientb0 | 88.58(82.34–93.55) | 81.38 | 80.95 | 81.55 | 85.23(78.75–90.74) | 79.63 | 76.71 | 80.71 |
All | COM-Net | 88.65(81.84–93.77) | 83.45 | 85.71 | 82.52 | 90.22(85.12–94.61) | 85.93 | 82.19 | 87.31 |
|  | MTTU-Net | 90.15(84.70–94.82) | 85.52 | 78.57 | 88.35 | 93.51(90.22–96.37) | 87.41 | 80.82 | 89.85 |
|  | Ours | 91.42(86.19–95.63) | 82.07 | 83.33 | 81.55 | 94.95(91.78–97.58) | 87.41 | 87.67 | 87.31 |
|  |  + clinical characteristics | 94.15(90.22–97.35) | 88.28 | 88.10 | 88.35 | 95.07(92.28–97.48) | 87.78 | 90.41 | 86.80 |
|  | VGG16 | 84.00(73.92–92.42) | 80.00 | 84.00 | 78.33 | 78.10(68.76–87.02) | 71.43 | 68.75 | 72.60 |
|  | Resnet50 | 91.33(84.54–97.06) | 85.88 | 84.00 | 86.67 | 80.01(69.81–89.83) | 75.24 | 68.75 | 78.08 |
|  | Efficientb0 | 91.80(84.90–97.13) | 85.88 | 88.00 | 85.00 | 78.00(67.07–88.49) | 73.33 | 78.12 | 71.23 |
Grade | COM-Net | 91.73(85.28–97.20) | 85.88 | 92.00 | 83.33 | 86.22(76.29–94.43) | 80.95 | 75.00 | 83.56 |
II | MTTU-Net | 91.13(84.36–96.74) | 85.88 | 80.00 | 88.33 | 92.81(86.47–97.42) | 84.76 | 78.12 | 87.67 |
|  | Ours | 93.50(87.64–98.05) | 85.88 | 80.00 | 88.33 | 95.25(91.09–98.23) | 87.62 | 84.38 | 89.04 |
|  |  + clinical characteristics | 98.07(95.39–99.82) | 94.12 | 96.00 | 93.33 | 94.91(90.10–98.77) | 91.43 | 90.62 | 91.78 |
|  | VGG16 | 63.89(40.26–85.58) | 64.00 | 55.56 | 68.75 | 85.07(73.64–93.75) | 80.00 | 93.75 | 75.93 |
|  | Resnet50 | 84.72(61.90–100) | 88.00 | 88.89 | 87.50 | 94.21(88.00–98.72) | 88.57 | 93.75 | 87.04 |
|  | Efficientb0 | 87.50(71.43–99.12) | 84.00 | 77.78 | 87.50 | 94.56(87.21–99.23) | 91.43 | 87.5 | 92.59 |
Grade | COM-Net | 76.39(53.00–94.81) | 76.00 | 77.78 | 75.00 | 97.34(93.06–100.00) | 91.43 | 87.5 | 92.59 |
III | MTTU-Net | 88.19(70.13–100) | 84.00 | 77.78 | 87.50 | 96.18(90.06–100.00) | 94.29 | 87.5 | 96.3 |
|  | Ours | 90.28(73.81–100) | 84.00 | 77.78 | 87.50 | 98.26(95.22–100.00) | 97.14 | 93.75 | 98.15 |
|  |  + clinical characteristics | 90.28(75.00–100) | 84.00 | 66.67 | 93.75 | 97.22(92.45–100.00) | 94.29 | 87.5 | 96.3 |
|  | VGG16 | 69.44(50.00–87.93) | 60.00 | 50.00 | 62.96 | 76.43(66.57–85.84) | 73.68 | 76.00 | 72.86 |
|  | Resnet50 | 89.35(76.67–98.67) | 85.71 | 87.50 | 85.19 | 92.00(84.51–97.81) | 86.32 | 84.00 | 87.14 |
|  | Efficientb0 | 82.41(63.33–97.06) | 68.57 | 75.00 | 66.67 | 86.69(76.01–95.70) | 81.05 | 80.00 | 81.43 |
Grade | COM-Net | 89.35(76.53–98.67) | 80.00 | 87.50 | 77.78 | 90.23(81.32–97.73) | 89.47 | 88.00 | 90.00 |
IV | MTTU-Net | 90.74(76.61–100) | 82.86 | 87.50 | 81.48 | 92.86(86.76–97.63) | 86.32 | 80.00 | 88.57 |
|  | Ours | 91.44(80.10–98.98) | 82.86 | 87.50 | 81.48 | 93.83(86.57–99.12) | 87.37 | 92.00 | 85.71 |
|  |  + clinical characteristics | 87.96(75.29–98.15) | 88.57 | 87.50 | 88.89 | 93.94(88.17–98.19) | 86.32 | 92.00 | 84.29 |