Skip to main content
Search

# Uncertainty Quantification

17 related articles

Subscribe to updates
  1. arXiv

    EviDTB adds uncertainty to DFT Hamiltonian prediction: dropping the 15% most uncertain structures cuts the error's 99th percentile from 16.63 to 3.72 eV²

    Universal DFT Hamiltonian models quickly map atomic structure to electronic properties, but their predictions carry no reliability information. EviDTB attaches evidential deep regression to the SLEM backbone in DeePTB, learns only the residual between the converged Hamiltonian and a reference Hamiltonian built from the initial density, and returns a per-atom uncertainty score in a single forward pass. On 5,478 held-out structures, removing the 15% most uncertain structures lowers the 99th percentile of the mean local squared prediction error from 16.63 to 3.72 eV²; on 636 generated structures evaluated without retraining, the score has a Spearman correlation of 0.743 with that error.

  2. arXiv

    Mediation analysis stops refitting per table: MediPFN learns interval error quantiles in advance and runs 59.1 times faster than bootstrap in paired timing

    Causal mediation analysis splits a treatment effect into an indirect pathway through mediators and a direct pathway through other processes, and attaching a confidence interval to the indirect effect usually means refitting several nuisance functions on every table and resampling repeatedly. MediPFN adapts a pretrained tabular foundation model to predict those nuisance functions, then a separate head learns quantiles of the estimator's standardized error from simulated tables with known indirect effects, with symmetrization and independent calibration producing the interval. On synthetic, distribution-shift and real-covariate tables its coverage sits closer to the 95% nominal level than several comparators, and paired timing gives a median 59.1-fold speedup over bootstrap.

  3. arXiv

    Retinal screening stops sending every case to review: RetinaGuard accepts about 37% of cases at a 5% unsafe level using evidence-gathering agents and conformal risk control

    Multi-disease retinal screening needs a per-image decision on whether an automated call can stand without review. RetinaGuard combines evidence from quality, diagnostic, uncertainty, verification and explanation agents into a learned probability that a decision is unsafe, invokes tools only when their expected value exceeds their cost, and certifies the acceptance threshold with conformal risk control. On the RFMiD test split with the weaker primary model (macro-AUROC 0.896), it captured 119 of 280 unsafe decisions at a 20% referral budget against 88 for lowest-confidence referral; with the stronger model (0.925) the verifier's gain shrank to a few percentage points.

  4. arXiv

    Every generative model eventually fails a large enough test: SIGMA profiles fit uncertainty and keeps the same model trustworthy on test sets an order of magnitude larger

    A generative model fitted to a finite training set is never exactly the true density, so any sufficiently powerful goodness-of-fit test will eventually reject it once the test sample is large enough, even when the model family is correct. SIGMA writes the parameter uncertainty of a Gaussian mixture model as a tractable covariance from its score functions and Fisher information, then promotes the conventional point-null test to a composite null in which that uncertainty is profiled as a nuisance parameter. On a two-dimensional toy model and on a QCD background benchmark in a learned jet embedding, including the uncertainty keeps the same model trustworthy on test sets an order of magnitude larger than the standard test allows.

  5. Robots mislabel what they remember: UQ-DAAAM fuses multiple views to fix captions, lifting accuracy 5%

    A robot that files a hallway defibrillator under fire extinguisher would carry that wrong description in memory. MIT researchers added uncertainty quantification to the existing DAAAM memory system, so the robot compares descriptions of the same object from different viewpoints, estimates how unsure it is about what it saw, and selects extra views to fuse a more accurate caption. Against baseline methods, the system raised object-description accuracy by 5 percent and resolved ambiguity for about 92 percent of objects using only two additional captions per object.

  6. arXiv

    Single-cell pairing gets a confidence score: a Bayesian posterior on the correspondence filters bad matches

    Cross-modal single-cell matching has returned a match but rarely a confidence. BASILISC places a Bayesian posterior over a siamese network of two modalities and defines uncertainty on the correspondence between a pair of cells, tested on multi-omics benchmarks where the true pairing is known. At the cell-type level, discarding the least certain fifth of pairs raises accuracy from 0.93 to 0.98; at the cell level, the posterior flags wrong matches that cross a cell-type boundary better than a deterministic read of the same scores, AUROC 0.68 against 0.64.

  7. Calibrated uncertainty often fails to beat random sampling: active learning on out-of-distribution materials data

    Active learning for materials and molecular property prediction treats high-uncertainty samples as the information a model is missing. Across formation energy, bandgap and solubility tasks, uncertainty came from loss-landscape sampling and from ensembles retrained with different seeds, then was calibrated with linear calibration factors and a neural network. Calibrated uncertainty generally did not reduce the data a model needed to improve on out-of-distribution data, showing no advantage over random sampling or uncalibrated estimates, and error bars overlapped.

  8. Flood alerts gain a 90% band: quantile LSTM ensemble flags risk across Australian catchments

    Flood warning for Australian catchments now comes as a 90% prediction band rather than a single flow curve: three independently trained LSTMs give the mean flow and the 5th and 95th percentiles, and the band's position against a 15% annual exceedance threshold becomes a high, moderate or low risk label. On CAMELS-AUS, the q=0.05 Quantile-LSTM reached the lowest RMSE of 0.0801 in South Australia against 0.0963 for a conventional LSTM, while peak timing error across states ran about 1.94 to 3.12 days with peaks underestimated by roughly 30%.

  9. Causal pairs pulled from nuclear event reports now carry a confidence score: reviewing the top 20% catches 82% of extraction errors

    Large language models extract cause-effect pairs from nuclear Licensee Event Reports as flat assertions, leaving risk analysts unable to separate reliable relations from spurious ones. A study stacks four signals, token-level probabilities, self-consistency across stochastic decoding runs, disagreement among three independently fine-tuned models, and conformal prediction, into a calibrated confidence score per pair. On a held-out test set the integrated score reached an expected calibration error of 0.067 and an AUROC of 0.84, above every individual signal, and uncertainty-guided review found 82% of extraction errors within the first 20% of relations reviewed, against 24% for random selection.

  10. Omani crude pipelines skip per-case CFD: a surrogate returns heat, head and power loss in milliseconds

    Omani crude oil flows non-isothermally as a viscoplastic fluid, and predicting its heat and head losses has meant running high-fidelity CFD case by case, too slowly for real-time decisions. A physics-informed surrogate trained on 962 COMSOL simulations, with a dimensionless Rheological Heat-Loss Index (RHLI) as an input feature, now predicts total heat loss, head loss and total power loss together. Under five-fold cross-validation heat loss was the most learnable target, with cross-validated R² near 1; uncertainty quantification gave a mean calibration error of 0.0211 and 97.4% empirical 95% coverage, and SHAP ranked ambient temperature as the dominant heat-loss driver.