Analysis. A biopsy or referral rating of 4 or 5 was considered a decision to biopsy or refer (ie, a diagnostic decision consistent with melanoma or SDN warranting excision), whereas a selection of 1 to 3 was considered a decision not to biopsy or refer (ie, a diagnostic decision consistent with a benign PSL). The sensitivity and specificity of biopsy/referral decisions for melanomas and SDN, the proportion of missed melanomas and SDN, and the proportion of biopsy/referral decisions for benign lesions were separately determined for visual inspection alone and visual inspection with EIS score. Similarly, diagnostic accuracy was calculated for these clinical scenarios. These metrics were further stratified among different subsets of the respondent population. Differences in sensitivity, specificity, biopsy/referral decision proportions, and diagnostic accuracy were calculated using McNemar’s test for paired proportions.
RESULTS
Sixty-one respondents, comprising 44 physicians and 17 NPs, completed the survey, yielding a response rate of 43% (TABLE 1). In total, 1354 clinical decisions (677 based on visual inspection alone and 677 based on visual inspection plus EIS) were made. A biopsy/referral decision was made after assessing 416 of 677 cases (61%) with visual inspection alone and 360 of 677 cases (53%) when relying on visual inspection plus EIS. None of the respondents reported any prior experience with EIS.
When incorporating EIS scores, respondents’ mean sensitivity for melanomas and SDN increased from 69.2% to 90.0% (P < .001) and specificity from 44.0% to 72.6% (P < .001; TABLE 2). At baseline, physicians demonstrated a sensitivity and specificity of 74.6% and 46.5%, respectively, while NPs demonstrated a sensitivity and specificity of 56.1% and 37.9%, respectively.
All respondent subgroups stratified by occupation and years of experience saw significant increases in both sensitivity and specificity upon the incorporation of EIS scores, with NPs seeing a greater increase in sensitivity (56.1% vs 85.4%; P < .001) and specificity (37.9% vs 69.0%; P < .001) than physicians (sensitivity: 74.6% vs 91.9%; P < .001; specificity: 46.5% vs 74.1%; P < .001). The only difference in diagnostic performance based on years of experience was a greater pre-EIS sensitivity by clinicians who had been in practice for ≥ 15 years, compared with those in practice for shorter periods (TABLE 2).
Diagnostic accuracy increased significantly from 48% when based on visual inspection alone to 73% with the addition of EIS scores (P < .001; TABLE 3). Physicians and NPs each significantly increased their diagnostic accuracy upon the incorporation of EIS, with NPs exhibiting the greatest increase (from 36.9% to 65.7%; P < .001). PCPs with 6 to 14 years of experience saw the greatest increase in diagnostic accuracy when adding EIS (45.9% vs 76.4%; P < .001). Overall, the addition of EIS scores resulted in 58 fewer missed melanomas and SDN and 114 fewer benign referrals or biopsies (TABLE 4).
Continue to: DISCUSSION