Comparative Evaluation of AI-Based Pathogenicity Prediction Tools for BRCA Variants

2025

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.1016/j.procs.2025.10.210
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Accurate pathogenicity classification of BRCA1 and BRCA2 variants is critical for personalised risk management in hereditary breast and ovarian cancer. To benchmark current practice, we systematically evaluated 18 widely used in-silico predictors—SIFT, PolyPhen-2, MutationTaster, CADD, REVEL, and 13 others—on a balanced set of 1,803 pathogenic and benign variants curated from the BRCA Exchange database. Nine performance metrics (accuracy, sensitivity, specificity, PPV, NPV, FPR, FNR, Matthew’s correlation coefficient and AUC) were examined. We further integrated these metrics into a single composite score to facilitate ranking. ClinPred outperformed all other tools, achieving an AUC of 0.792, an MCC of 0.421, and the highest composite score (0.81). CADD (raw and phred-scaled), MetaRNN, VEST4, and AlphaMissense formed a robust second tier, whereas SIFT and LRT showed high missing-value rates and low sensitivity. These findings offer practical guidance for the interpretation of clinical variants and establish an up-to-date benchmark for future algorithm development in precision oncology.