|  | Validation set |  |  |  | Independent test set |  |  |  |
---|---|---|---|---|---|---|---|---|---|
Number | Model | AUC (95% CI) | ACC | SEN | SPE | AUC (95% CI) | ACC | SEN | SPE |
 | VGG16 | 80.56 (68.09–90.84) | 71.11 | 77.78 | 69.44 | 84.08 (78.08–89.24) | 75.68 | 89.19 | 72.30 |
 | Resnet50 | 88.73 (76.55–97.10) | 87.78 | 88.89 | 87.50 | 93.22 (88.37–96.90) | 89.19 | 89.19 | 89.19 |
 | Efficientb0 | 90.74 (81.94–97.80) | 84.44 | 83.33 | 84.72 | 91.36 (84.77–96.67) | 84.86 | 86.49 | 84.46 |
One | COM-Net | 92.21 (85.64–97.21) | 83.33 | 88.89 | 81.94 | 97.55 (95.14–99.30) | 91.89 | 91.89 | 91.89 |
 | MTTU-Net | 92.75 (86.13–97.84) | 86.67 | 88.89 | 86.11 | 98.50 (96.49–99.85) | 93.51 | 94.59 | 93.24 |
 | Ours | 94.02 (88.58–98.00) | 86.67 | 88.89 | 86.11 | 98.90 (97.46–99.94) | 96.76 | 94.59 | 97.30 |
 |  + clinical characteristics | 96.26 (91.93–99.47) | 91.11 | 94.44 | 90.28 | 97.24 (94.83–99.21) | 95.68 | 89.19 | 97.30 |
 | VGG16 | 81.25 (66.35–93.81) | 80.00 | 75.00 | 83.33 | 77.33 (66.20–86.97) | 70.67 | 63.33 | 75.56 |
 | Resnet50 | 91.15 (80.53–98.47) | 85.00 | 87.50 | 83.33 | 81.26 (70.36–91.34) | 76.00 | 73.33 | 77.78 |
 | Efficientb0 | 91.41 (80.91–97.95) | 85.00 | 87.50 | 83.33 | 78.89 (67.36–89.08) | 73.33 | 76.67 | 71.11 |
Two | COM-Net | 89.06 (76.69–97.99) | 85.00 | 87.50 | 83.33 | 82.30 (70.99–91.90) | 78.67 | 76.67 | 80.00 |
 | MTTU-Net | 92.45 (82.34–98.93) | 80.00 | 81.25 | 79.17 | 87.56 (78.95–94.48) | 78.67 | 73.33 | 82.22 |
 | Ours | 91.93 (81.45–98.96) | 80.00 | 75.00 | 83.33 | 91.48 (84.27–97.08) | 85.33 | 80.00 | 88.89 |
 |  + clinical characteristics | 95.18 (86.89–100) | 92.50 | 87.50 | 95.83 | 94.44 (89.02–98.25) | 89.33 | 86.67 | 91.11 |
 | VGG16 | 58.33 (14.29–95.83) | 60.00 | 50.00 | 75.00 | 66.67 (25.00–100) | 80.00 | 66.67 | 100.00 |
 | Resnet50 | 100 (100–100) | 100 | 100 | 100 | 100 (100–100) | 100 | 100 | 100 |
 | Efficientb0 | 91.67 (66.67–100) | 80.00 | 83.33 | 75.00 | 87.50 (55.56–100) | 80.00 | 83.33 | 75.00 |
Three | COM-Net | 70.83 (22.22–100) | 70.00 | 66.67 | 75.00 | 79.17 (41.67–100) | 70.00 | 66.67 | 75.00 |
 | MTTU-Net | 83.33 (47.62–100) | 70.00 | 66.67 | 75.00 | 100 (100–100) | 80.00 | 66.67 | 100 |
 | Ours | 95.83 (77.78–100) | 80.00 | 66.67 | 100 | 100 (100–100) | 100 | 100 | 100 |
 |  + clinical characteristics | 100 (100–100) | 80.00 | 66.67 | 100 | 100 (100–100) | 90.00 | 83.33 | 100 |