Skip to main content
Search

# Conformal Risk Control

4 related articles

Subscribe to updates
  1. arXiv

    Delayed feedback meets a memory cap: CA-OCRC keeps online risk control on target with capacity growing only logarithmically in the maximum delay

    Online conformal risk control has assumed each round's loss arrives immediately and intact, yet real systems delay feedback and can track only a limited number of pending predictions, so some feedback is lost for good. CA-OCRC designs the tracking policy and the prediction sets together: each round draws a random proxy delay, is tracked while capacity allows until its feedback arrives or the proxy delay expires, and a two-level inverse probability weighting compensates for lost feedback. Risk bounds for arbitrary and stochastic delays follow, and optimizing the proxy delay distribution shows that capacity growing only logarithmically in the maximum delay suffices to match the convergence rate of OCRC with unlimited feedback.

  2. arXiv

    Compute only where the signal is: Conformal Adaptation certifies sparse inference, holding Dice close on brain-tumor segmentation

    Medical and astronomical images are orders of magnitude larger than natural images, yet tumors and galaxies occupy a tiny fraction of the data, and uniform compression such as quantization or pruning can erode precision exactly there. Conformal Adaptation first screens candidates with a low-resolution model, calibrates the selection threshold with conformal risk control so the discarded cells carry at most a user-set expected fraction of true signal mass, then refines only the selected regions. Across brain-tumor segmentation, head-and-neck segmentation, calcium spike-rate inference and galaxy flux super-resolution, the pipeline cuts computation while keeping accuracy close, and VISTA3D reaches an 82.10x FLOPs speedup in CPU-only inference.

  3. arXiv

    Clinical imaging decisions get a harm gate: HC-ROCP cuts severe-case misrouting from 4.68% to 0.54%

    A clinical image classifier that returns a set of possible diagnoses does not guarantee that a severe case avoids a harmful action. HC-ROCP adds a harm penalty weighted by predicted severe-class probability to frozen classifier probabilities, tests coverage and severe-action error on disjoint calibration splits, and then certifies, reports descriptively, or refuses each claim. On COVID-19 radiographs across ten calibration seeds, severe-action errors fall from the exact ROCP baseline's 4.68% to 0.54%, at higher modeled loss.

  4. arXiv

    Retinal screening stops sending every case to review: RetinaGuard accepts about 37% of cases at a 5% unsafe level using evidence-gathering agents and conformal risk control

    Multi-disease retinal screening needs a per-image decision on whether an automated call can stand without review. RetinaGuard combines evidence from quality, diagnostic, uncertainty, verification and explanation agents into a learned probability that a decision is unsafe, invokes tools only when their expected value exceeds their cost, and certifies the acceptance threshold with conformal risk control. On the RFMiD test split with the weaker primary model (macro-AUROC 0.896), it captured 119 of 280 unsafe decisions at a 20% referral budget against 88 for lowest-confidence referral; with the stronger model (0.925) the verifier's gain shrank to a few percentage points.

You’re all caught up