- Research article
- Open Access
Effect of region of interest size on ADC measurements in pancreatic adenocarcinoma
Cancer Imaging volume 17, Article number: 13 (2017)
To investigate the influence of region of interest (ROI) size on tumor apparent diffusion coefficient (ADC) measurements in pancreatic cancer.
The study population consisted of 64 patients with pathologically proved pancreatic ductal adenocarcinomas (PDACs), who underwent preoperative magnetic resonance imaging (MRI) examinations including diffusion-weighted imaging (DWI). The tumor ADCs were measured by two independent readers using six round ROIs with sizes ranging from 20 to 214 mm2 (9 to 97 pixels) in both the six separate measurements. The intra- and inter-observer variabilities were analyzed by using the coefficient of variance (CV), the interclass correlation coefficient (ICC) and Bland-Altman analysis. The mean ADCs measured with the 6 different-sized ROIs were compared using one-way repeated analysis of variance. The sample sizes were calculated by using 80% power and a 5% significance level to detect 10 to 25% changes in ADC measurements.
The largest ROI (ROI214) yielded the best intra-observer repeatability (CV, 6.3%; ICC, 0.93) and inter-observer reproducibility (CV, 10.1%; ICC, 0.84). The mean differences in ADC measurements ± limits of agreement between the two readers were (0.06 ± 0.47) × 10−3 mm2 for ROI20, (0.08 ± 0.46) × 10−3 mm2 for ROI46, (0.05 ± 0.37) × 10−3 mm2 for ROI82, (0.07 ± 0.42) × 10−3 mm2 for ROI115, (0.05 ± 0.43) × 10−3 mm2 for ROI152 and (−0.02 ± 0.29) × 10−3 mm2 for ROI214.
ROI size had a considerable influence on the ADC measurements of PDACs.
Diffusion-weighted imaging (DWI) with quantitative measurement of apparent diffusion coefficient (ADC) values provide an alternative to conventional anatomical magnetic resonance imaging (MRI), such as T1- (T1WI) and T2-weighted imaging (T2WI), for the detection and characterization of pancreatic diseases. Descriptions of DWI techniques and their uses for pancreatic applications can be found in a review article by Barral et al. . Notably, several recent studies focusing on quantitative measurements of ADC based on DWI have indicated that DWI is a valuable tool in the assessment of pancreatic cancer. Lots of studies reported that ADC values in pancreatic cancer were significantly lower compared with benign pancreatic tissue [2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17]. However, there is still a diagnostic challenge to the use of DWI in pancreatic cancer as described by Fukukura et al., and the reported ranges of ADC values for neoplastic tissues varies dramatically across different studies [2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17]. One reason for this observation is the large variation in the region of interest (ROI) sizes in these studies (ranging from 20 to 789 mm2), which may significantly influence ADC measurements [18, 19]. The avoidance of the placement of smaller ROIs within lesions is commonly recommended, particularly for response assessment studies [1, 20]. There is a clear need for the standardization of ROI sizes for ADC measurements of pancreatic cancers to enable the validation of this quantitative parameter as a qualified biomarker for longitudinal clinical trials. To our knowledge, the effect of ROI size on tumor ADC measurements in pancreatic cancer and the intra- and inter-observer variabilities have never been systematically studied. Thus, the aim of this study was to investigate the influences of ROI size on tumor ADC measurements and intra- and inter-observer variabilities in pancreatic cancer.
This single-center retrospective study was reviewed and approved by the ethics committee of our hospital, and informed consent was waived in this study. We undertook a review of our institution’s histopathological database of patients who underwent pancreatic resection between January 2014 and December 2014 and identified 280 consecutive patients who were diagnosed with pancreatic ductal adenocarcinoma (PDAC). Among these patients, 72 patients received preoperative MRI evaluations that included a DWI sequence within two weeks prior to surgery. We excluded 6 patients because the sizes of their tumors were insufficient to clearly indicate the effects of ROI size or draw the defined ROIs on the ADC map. Additionally, 2 other patients were excluded due to the presence of severe motion artifacts in their diffusion-weighted images. Thus, the final study population consisted of 64 patients (41 males; mean age: 61.1 ± 8.7 years; range: 40–78 years). The mean tumor size was 37 ± 9 mm (range, 21–70 mm).
All of the patients underwent upper abdominal MRI examinations (3.0-T, Signa HDxt, GE, Milwaukee, USA), including respiratory-triggered DWI weighted along three orthogonal gradient directions (b-values, 0 and 600 s/mm2). Fat saturation was performed with selective presaturation with inversion recovery. The main parameters and orders of MRI sequences are summarized in Table 1. Contrast-enhanced T1WI was performed with a gadopentetate dimeglumine injection (contrast media, 0.2–0.3 ml/kg; physiological saline, 10–15 ml).
Based on the DWI images with b values of 0 and 600 s/mm2, ADC maps were calculated using a monoexponential model (ADC = (ln (SIb0/SIb600))/600) on a workstation (Function V9.4.05, AW 4.4, GE Healthcare). The ADC maps were reconstructed automatically with a 380 × 380 mm2 field of view (FOV) and a 256 × 256 matrix. The anonymous MR images of patients were sorted in a random order. The MRI data were evaluated and analyzed using ImageJ software (v1.47; http://rsb.info.nih.gov/ij). Six round ROIs (areas: 20, 46, 82, 115, 152, and 214 mm2; pixel numbers: 9, 21, 37, 52, 69, and 97) were drawn on the solid part of the tumor as identified on contrast enhanced T1WI (Fig. 1) while avoiding cystic lesion, dilated pancreatic ducts, and necrosis by referring to T2WI or T1WI images in both the six separate measurements. The mean ADC value and its standard deviation (SD) within each recorded ROI were obtained. All of the ADC values of the PDAC were independently measured by two observers (with 11 and 6 years of experience in abdominal radiology). To evaluate the intra-reader variability, the tumors ADCs were measured twice by reader 1 with an interval greater than three weeks. The first measurements of the tumor ADCs from reader 1 were further used to evaluate the inter-observer variability of the ADC values.
SPSS (v16.0, SPSS Inc., Chicago, IL, USA) was used for the statistical analyses. Normality assumptions were assessed using the Shapiro-Wilk’s test. The intra- and inter-observer variabilities of tumor ADC measurements were evaluated with the interclass correlation coefficient (ICC) and Bland-Altman analysis [21, 22]. The measurement errors between the intra- and inter-observer measurements were quantified with the coefficient of variance (CV). Based on a two-sample unpaired t-test (80% power and a 5% significance level) [23, 24], the sample sizes needed to detect 10 to 25% changes in the ADC measurements for each ROI size were calculated. The homogeneity indices (defined by the SD/mean ADC within each recorded ROI) were also calculated for the tumors at each ROI size. The mean ADCs obtained from the 6 different-sized ROIs were compared by one-way repeated analysis of variance (ANOVA). P < 0.05 was established as the threshold for significance of the statistical analyses.
Typical MRI images and the ADC maps used for the ADC measurements are demonstrated in Fig. 1. As illustrated in Table 2, no significant difference was observed in the mean ADCs among the 6 different-sized ROIs for all the three measurements of two observers (all P > 0.05). Box plots providing graphic illustrations of the study data are presented in Fig. 2. The homogeneity index increased with increasing ROI size (Table 2).
Intra-observer variability of ADC values
The bias, limit of agreement (LOA) and ICC values are summarized in Table 3. Good or excellent agreements (ICC > 0.78) were found for various ADC measurements with ROI20 (i.e. a ROI with an area of 20 mm2) to ROI214 between the two measurements from reader 1 (Table 3). The mean ADCs were more scattered with decreasing ROI sizes.
Inter-observer variability of ADC values
The bias, limit of agreement (LOA) and ICC values for the inter-observer comparison are summarized in Table 4. Similar to the intra-observer findings, the mean ADCs were more scattered with decreasing ROI sizes. The ICCs demonstrated moderate to excellent agreements from ROI20 to ROI214 between the ADC measurements from the two readers (ICCs, 0.59–0.84), and excellent agreement was only found for the ADC measurements with ROI214 between the two readers (ICC, 0.84; Table 4). The inter-observer agreements in the ADC measurements for each ROI were worse (i.e. smaller ICCs) than the intra-observer agreements.
Sample size calculation
The sample size calculations for detecting 10 to 25% changes in the ADC values for the 6 sizes of ROIs are summarized in Table 5. The use of the largest ROI (214 mm2) for ADC measurements of PDACs as the end point required the smallest sample size, and the smaller ROIs required 56 to 150% more patients to detect similar changes.
ADC measurements have been utilized to investigate pancreatic adenocarcinomas; nevertheless, few studies have investigated the effect of ROI size on the reliability of ADC measurements in PDACs. In prior studies, ROI sizes for ADC measurements of PDACs have greatly varied [3, 4, 11,12,13, 17], and although no formal recommendations exist, a minimum size of 100 mm2 is commonly used . ANOVA results show that the mean ADCs of tumors are independent of the ROI size in PDAC patients; however, ROI sizes have considerable influence on the intra- and inter-observer variabilities of ADC measurements of PDAC, regarding the inter-observer comparisons of the ADC values for the 6 ROIs, only the reproducibility of the mean ADC of the PDACs obtained from ROI214 was acceptable because the mean intra-observer biases of the ADC measurements did not exceed ± 0.10 × 10−3 mm2/s and the limit of agreement was less than ± 0.30 × 10−3 mm2/s (Tables 3 and 4) . Additionally, excellent agreement between the two readers was found only in the ADC measurements from ROI214 (ICC, 0.84; Table 4). Compared with ROI214, ROI115 exhibited a 39% larger CV, and required 92% more patients to detect similar ADC changes in clinical trials.
We also found that the heterogeneities of the PDACs were evident and increased with larger ROIs. The homogeneity index was over 0.10 when the ROI size was larger than 82 mm2 (Table 2). Such heterogeneities led to measurement errors in the ADC values when small ROIs were used. It is noting, this study firstly assesses the influence of ROI size on the ADC measurements and intra- and inter-observer variabilities associated with PDAC and to provide sample size calculations for longitudinal studies.
Three ROI methods, including the whole-volume ROI [19, 25, 26], single-slice ROI [8, 10] and small solid-sample ROI [11,12,13,14,15,16,17] approaches have been used to obtain ADC measurements from tumors. In our previous studies, we found that despite its larger inter-observer variability , small solid-sample ROIs on tumors provide greater diagnostic performance in the assessment of PDAC compared with single-slice and whole-volume ROI methods ,. In addition, it is difficult to perform ADC measurements with whole-volume or single-slice ROI method in many tumors of patients with PDAC because of the unclear boundaries of tumors on DWI images [13, 17, 25]. Solid-sample ROI is the most commonly used approach for ADC measurements of PDAC [2,3,4,5,6,7, 11,12,13,14,15,16,17]. The ROIs in the lesions are delineated to avoid pancreatic ducts, cystic lesions, and imaging artifacts. Therefore, the small solid-sample ROI approach was used in this study.
In addition to ROI methods, imaging acquisition parameters, including the field strength, respiratory compensation method, number of b values used, maximum b value selected, and post-processing approach, may influence tumor ADC measurements . In our study, the DWI examinations were performed with a respiratory-triggered DWI sequence on a 3.0-T scanner in a single hospital, and thus bias produced by the use of different MRI machines or sequences was avoided. Kartalis et al. suggested that respiratory-triggered DWI is the recommended method for imaging a PDAC . Additionally, the calculations of \ADC maps, based on DW images of b0 and b600, which were selected to balance the image contrast and signal-to-noise ratio for pancreas, were performed by using a monoexponential model. Numerous DWI studies using similar b values for imaging pancreatic diseases [8, 10,11,12, 30,31,32]. Moreover, Koc Z and Erbay G reported that 600 s/mm2 is the optimal b-value for differentiation of abdominal lesions .
Our study had several limitations. First, longitudinal data are not available and the effect of ROI size on therapy response evaluation has not yet been investigated. Future larger scale longitudinal studies are required to confirm our results. Second, all of the examined lesions were pancreatic adenocarcinomas, and no other pathological pancreatic conditions were included in this study. Third, we enrolled patients who had undergone MRI examinations that were performed on the same 3.0-T system. This scenario may be ideal. The sample sizes acquired would likely increase in a multi-center taril using variable scanners due to greater CVs . Finally, the effects of field strengths and selection of b-values on the ADC measurements were not evaluated; thus, field strengths and the selection of b-values may affect our results.
This focused DWI study demonstrated that ROI size had a considerable influence on the ADC measurements of PDACs at 3.0-T. A large ROI size reduces the intra- and inter-observer variabilities in ADC measurements. A ROI size of 214 mm2 or greater will require a small sample size for future clinical trials.
Apparent diffusion coefficient
One-way repeated analysis of variance
Coefficient of variance
Field of view
Interclass correlation CV
Limit of agreement
Magnetic resonance imaging
Pancreatic ductal adenocarcinomas
Region of interest
Barral M, Taouli B, Guiu B, Koh DM, Luciani A, Manfredi R, et al. Diffusion-weighted MR imaging of the pancreas: current status and recommendations. Radiology. 2015;274:45–63.
Matsuki M, Inada Y, Nakai G, Tatsugami F, Tanikake M, Narabayashi I, et al. Diffusion-weighed MR imaging of pancreatic carcinoma. Abdom Imaging. 2007;32:481–3.
Park MJ, Kim YK, Choi SY, Rhim H, Lee WJ, Choi D. Preoperative detection of small pancreatic carcinoma: value of adding diffusion-weighted imaging to conventional MR imaging for improving confidence level. Radiology. 2014;273:433–43.
Wiggermann P, Grützmann R, Weissenböck A, Kamusella P, Dittert DD, Stroszczynski C. Apparent diffusion coefficient measurements of the pancreas, pancreas carcinoma, and mass-forming focal pancreatitis. Acta Radiol. 2012;53:135–9.
Wang Y, Miller FH, Chen ZE, Merrick L, Mortele KJ, Hoff FL, et al. Diffusion-weighted MR imaging of solid and cystic lesions of the pancreas. Radiographics. 2011;31:E47–64.
Lee SS, Byun JH, Park BJ, Park SH, Kim N, Park B, et al. Quantitative analysis of diffusion-weighted magnetic resonance imaging of the pancreas: usefulness in characterizing solid pancreatic masses. J Magn Reson Imaging. 2008;28:928–36.
Lemke A, Laun FB, Klauss M, Re TJ, Simon D, Delorme S, et al. Differentiation of pancreas carcinoma from healthy pancreatic tissue using multiple b-values: comparison of apparent diffusion coefficient and intravoxel incoherent motion derived parameters. Invest Radiol. 2009;44:769–75.
Rosenkrantz AB, Matza BW, Sabach A, Hajdu CH, Hindman N. Pancreatic cancer: Lack of association between apparent diffusion coefficient values and adverse pathological features. Clin Radiol. 2013;68:e191–197.
Kamisawa T, Takuma K, Anjiki H, Egawa N, Hata T, Kurata M, et al. Differentiation of autoimmune pancreatitis from pancreatic cancer by diffusion-weighted MRI. Am J Gastroenterol. 2010;105:1870–5.
Kartalis N, Lindholm TL, Aspelin P, Permert J, Albiin N. Diffusion-weighted magnetic resonance imaging of pancreas tumours. Eur Radiol. 2009;19:1981–90.
Muraoka N, Uematsu H, Kimura H, Imamura Y, Fujiwara Y, Murakami M, et al. Apparent diffusion coefficient in pancreatic cancer: characterization and histopathological correlations. J Magn Reson Imaging. 2008;27:1302–8.
Fattahi R, Balci NC, Perman WH, Hsueh EC, Alkaade S, Havlioglu N, et al. Pancreatic diffusion-weighted imaging (DWI): comparison between mass-forming focal pancreatitis (FP), pancreatic cancer (PC), and normal pancreas. J Magn Reson Imaging. 2009;29:350–6.
Fukukura Y, Takumi K, Kamimura K, Shindo T, Kumagae Y, Tateyama A, et al. Pancreatic adenocarcinoma: variability of diffusion-weighted MR imaging findings. Radiology. 2012;263:732–40.
Kang KM, Lee JM, Yoon JH, Kiefer B, Han JK, Choi BI. Intravoxel incoherent motion diffusion-weighted MR imaging for characterization of focal pancreatic lesions. Radiology. 2014;270:444–53.
Koc Z, Erbay G. Optimal b value in diffusion-weighted imaging for differentiation of abdominal lesions. J Magn Reson Imaging. 2014;40:559–66.
Concia M, Sprinkart AM, Penner AH, Brossart P, Gieseke J, Schild HH, et al. Diffusion-weighted magnetic resonance imaging of the pancreas: diagnostic benefit from an intravoxel incoherent motion model-based 3 b-value analysis. Invest Radiol. 2014;49:93–100.
Legrand L, Duchatelle V, Molinié V, Boulay-Coletta I, Sibileau E, Zins M. Pancreatic adenocarcinoma: MRI conspicuity and pathologic correlations. Abdom Imaging. 2015;40:85–94.
Bilgili Y, Unal B. Effect of region of interest on interovserver variance in apparent diffusion coefficient measures. Am J Neuroradiol. 2004;25:108–11.
Kim SH, Lee JY, Lee JM, Han JK, Choi BI. Apparent diffusion coefficient for evaluating tumour response to neoadjuvant chemoradiation therapy for locally advanced rectal cancer. Eur Radiol. 2011;21:987–95.
Padhani AR, Liu G, Koh DM, Chenevert TL, Thoeny HC, Takahara T, et al. Diffusion-weighted magnetic resonance imaging as a cancer biomarker: consensus and recommendations. Neoplasia. 2009;11:102–25.
Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70:213–20.
Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10.
Grothues F, Smith GC, Moon JC, Bellenger NG, Collins P, Klein HU, et al. Comparison of interstudy reproducibility of cardiovascular magnetic resonance with two-dimensional echocardiography in normal subjects and in patients with heart failure or left ventricular hypertrophy. Am J Cardiol. 2002;90:29–34.
Zhang X, Zhu C, Peng W, Tian B, Chen L, Teng Z, et al. Scan-rescan reproducibility of high resolution magnetic resonance imaging of atherosclerotic plaque in the middle cerebral artery. PLoS One. 2015;10:e0134913.
Ma C, Liu L, Li J, Wang L, Chen LG, Zhang Y, et al. Apparent diffusion coefficient (ADC) measurements in pancreatic adenocarcinoma: A preliminary study of the effect of ROI on ADC values and inter-observer variability. J Magn Reson Imaging. 2016;43:407–13.
Sun YS, Zhang XP, Tang L, Ji JF, Gu J, Cai Y, et al. Locally advanced rectal carcinoma treated with preoperative chemotherapy and radiation therapy: preliminary analysis of diffusion-weighted MR imaging for early detection of tumor histopathologic downstaging. Radiology. 2010;254:170–8.
Liu L, Ma C, Li J, Wang L, Chen LG, Zhang Y, et al. Comparison of the diagnostic performances of three techniques of ROI placement for ADC measurements in pancreatic adenocarcinoma. Acad Radiol. 2015;22:1385–92.
Dale BM, Braithwaite AC, Boll DT, Merkle EM. Field strength and diffusion encoding technique affect the apparent diffusion coefficient measurements in diffusion-weighted imaging of the abdomen. Invest Radiol. 2010;45:104–8.
Kartalis N, Loizou L, Edsborg N, Segersvärd R, Albiin N. Optimising diffusion-weighted MR imaging for demonstrating pancreatic cancer: a comparison of respiratory-triggered, free-breathing and breath-hold techniques. Eur Radiol. 2012;22:2186–92.
Ma C, Pan CS, Zhang HG, Wang H, Wang J, Chen SY, et al. Diffusion-weighted MRI of the normal adult pancreas: the effect of age on apparent diffusion coefficient values. Clin Radiol. 2013;68:e532–537.
Wang Y, Chen ZE, Nikolaidis P, McCarthy RJ, Merrick L, Sternick LA, et al. Diffusion-weighted magnetic resonance imaging of pancreatic adenocarcinomas: association with histopathology and tumour grade. J Magn Reson Imaging. 2011;33:136–42.
Momtahen AJ, Balci NC, Alkaade S, Akduman EI, Burton FR. Focal pancreatitis mimicking pancreatic mass: magnetic resonance imaging (MRI)/magnetic resonance cholangiopancreatography (MRCP) findings including diffusion-weighted MRI. Acta Radiol. 2008;49:490–7.
Donati OF, Chong D, Nanz D, Boss A, Froehlich JM, Andres E, et al. Diffusion-weighted MR imaging of upper abdominal organs: field strength and intervendor variability of apparent diffusion coefficients. Radiology. 2014;270:454–63.
Supported by Grants from the Natural Science Foundation of Shanghai (14ZR1408300), medical guidance project of Shanghai Municipal Science and Technology Commission (14411960100).
Availability of data and materials
Please contact author for data requests.
Ma C, Li J, Wang L, Zhang J, Fang X, Shao C, and Lu J performed the majority of experiments, made substantial contributions to the data analysis and interpretation, and wrote the manuscript draft; Guo X, Liu L, Zhan Q, Zhu C, Qu J and Chen S participated in the design of the study and made substantial contribution to data analysis; Wang L made substantial contributions to the study conception and design, critically revised the manuscript draft for important intellectual content, and gave final approval of the version to be published; all the authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
This study was approved by our Institutional Review Board (Shanghai Changhai Hosptial Ethics committee). Informed consent was waived in this retrospective study.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Ma, C., Guo, X., Liu, L. et al. Effect of region of interest size on ADC measurements in pancreatic adenocarcinoma. Cancer Imaging 17, 13 (2017). https://doi.org/10.1186/s40644-017-0116-6
- Pancreatic cancer
- Region of interest