PHYSICS-AWARE MASKED PRETRAINING FOR CROSS-BASIN WELL LOG FOUNDATION MODELS

2026

Closed access Metadata (CSL-JSON)
DOI 10.32014/2026.2518-1726.459
Data confidence 85 high
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Well log interpretation faces significant challenges due to data scarcity, distribution shift across geological basins, and a lack of physics-informed representations in current foundation models. While recent masked autoencoder approaches show promise for self-supervised pretraining on subsurface data, they fail to consider fundamental petrophysical constraints that govern measurement relationships. This paper presents a physics-aware masked pretraining framework that incorporates petrophysical consistency losses into self-supervised learning on multivariate well logs. The proposed method combines masked patch reconstruction with differentiable petrophysical forward models that use Archie's law, Wyllie's time-average equation, and density-porosity relationships as auxiliary objectives. A geologically adaptive masking curriculum also gradually increases task difficulty, moving from random point masking to cross-curve masking and stratigraphic interval masking. Extensive experiments on the FORCE 2020 benchmark show that physics-aware pretraining improves lithology classification accuracy by 4.2% and reduces porosity estimation error by 5.8% compared to standard masked autoencoders, while cross-basin transfer experiments show a 6.3% lower optimality gap when transferring datasets from Norwegian to Kansas wells. Ablation studies show that petrophysical consistency losses contribute 2.8 percentage points to classification improvement, while geologically adaptive masking adds another 1.4 percentage points. The framework maintains computational efficiency, with inference times of less than 12 milliseconds per well section, making it suitable for real-time drilling applications in data-scarce, multi-basin settings.