Skip to main content
Search

# Transfer Learning

16 related articles

Subscribe to updates
  1. arXiv

    Conditional flow matching can transfer too: a correction on top of a frozen source representation cuts energy discrepancy 26.4% on five-dimensional responses

    When target samples are limited, conditional flow matching can borrow a covariate representation learned from a related source population. TFM-Freeze keeps the source encoder fixed and trains only a target velocity head; TFM-Adapt jointly learns the head and a representation correction under a functional anchoring penalty. In simulations with related five-dimensional representations and 10000 source samples, unpenalized TFM-Adapt lowered energy discrepancy from 0.3158 for TFM-Freeze to 0.2325, a 26.4% reduction; target validation falls back to a target-only generator when transfer does not help.

  2. arXiv

    Superconductor data moves past critical temperature alone: AutoSuperCon mines 47,000 preprints for eight parameters across 6,793 materials

    Screening superconductors has long rested on a single experimental parameter, the critical temperature, while quantities that decide usefulness, such as the upper critical field and critical current density, sit unstructured in the literature. AutoSuperCon uses a large language model to extract eight experimental superconducting parameters from more than 47,000 open arXiv preprints in the superconductivity category, adds digitized entries from the Roberts 1976 survey, and yields 20,354 entries for 6,793 superconductors. On the 2,439 materials shared with NIMS SuperCon, critical temperatures show a median deviation of 0.25 K, or 3.5% relative; the database supports large-scale tests of empirical relations and composition-based prediction of critical temperature and upper critical field.

  3. Graph neural network maps PBE formation energies onto the r2SCAN scale, cutting the cross-functional gap to 14.3 meV/atom

    Formation energies from different exchange-correlation functionals have not been directly mergeable: in MatPES the same structures differ by 107 meV/atom on average between PBE and r2SCAN. Using more than 380,000 structurally paired PBE–r2SCAN entries, researchers trained a graph neural network to predict the energy residual between the two functionals and correct PBE formation energies onto the r2SCAN scale. With GPTFF as the backbone, the model reaches a mean absolute error of 14.3 meV/atom on the held-out test set, below the 18.2 meV/atom of CHGNet.

  4. bioRxiv

    Younger breast cancer survival models borrow from older cohorts: LSAT-EN tunes borrowing per omics layer and reaches 0.819 four-year AUC

    Younger breast cancer patients have too few samples to train reliable prognostic models, so LSAT-EN treats older patients as a source cohort and sets the strength of borrowing toward the source coefficients separately for each of six omics layers, while elastic-net regularization selects variables. In TCGA-BRCA, with patients aged 60 and older as source and those under 50 as target, four-year binary survival prediction reached an AUC of 0.819, above 0.774 for pooled fitting, 0.757 for target-only fitting, 0.728 for glmtrans and 0.780 for GAS-EN. In simulation the advantage grew as source-target differences and target-sample scarcity increased.

  5. Transition-state search stops assuming the ground state: global sampling plus a 30,000-parameter network remaps propane dehydrogenation

    Transition-state searches have long started from hand-chosen ground-state structures, which can miss metastable configurations that may govern rates at finite temperature. A workflow pairs global configurational search with a lightweight graph neural network: it samples many reactant, product and intermediate configurations on the potential energy surface, then predicts transition-state geometries with an edge-aware attention network of about 30,000 trainable parameters. On propane dehydrogenation over Pt4 supported on carbon nitride, the workflow recovers the known mechanism and yields competing pathways absent from earlier hand-built models; the authors also note that the metastable tetrahedral Pt4, though intrinsically more reactive, is too costly to form to dominate actual kinetics.

  6. Diffractograms are not photos: an ImageNet-only model reads phase fractions from background noise, while physics pre-training locks onto Bragg rings

    Synchrotron X-ray diffraction produces a 2D diffractogram per second, and image models seem able to read α and β phase fractions of Ti–6Al–4V from them. Two models reach similar accuracy after fine-tuning on 250 experimental diffractograms, yet robustness tests and attention maps show the ImageNet-only model infers fractions from background and pixel noise, while the model pre-trained on simulated diffractograms relies on Bragg reflections. Accuracy alone does not validate a model.

  7. arXiv

    One self-supervised encoder lifts CWRU fault-classification macro-F1 from 0.350 to 0.812, but not remaining-useful-life accuracy

    Across 47 public PHM datasets harmonized to one tensor contract, an 801,808-parameter channel-independent Transformer encoder pretrained with masked patch prediction raises fault-classification macro-F1 from 0.350 to 0.812 on the fully withheld CWRU set and from 0.569 to 0.951 on HSG18, with frozen linear probing alone reaching 0.705 and 0.906; the same pretraining does not reliably beat a from-scratch baseline on CMAPSS remaining-useful-life estimation. Simulated federated pretraining over ten clients grouped by physical domain retains part of the representation but trails the centralized encoder at matched budget, and the self-supervised loss does not predict downstream utility.

  8. A CRISPRi guide-efficacy model nearly fails on a new library; swapping the within-gene percentile label lifts transfer correlation from 0.008 to 0.136

    A CRISPRi guide-efficacy model trained in K562 cells barely transferred to the independent Dolcetto library from Sanson et al. 2018 in HT29 and A375 cells, reaching Spearman correlations of only 0.008 and 0.012. Keeping the same 101 features, architecture and hyperparameters but replacing the within-gene percentile label with a continuous cross-study z-score raised transfer to 0.136 in HT29 and 0.158 in A375, and leave-one-chromosome-out performance in K562 from 0.375 to 0.429. The transfer failure therefore traces mainly to label design rather than missing chromatin features.

  9. Grid conical shell milling gets a physics chain: predict cutting force first, then compute deflection, with accuracy above 93% on all four test sets

    When a thin-walled grid conical shell is milled, the rib layout makes local stiffness jump from tool position to tool position, and the cutting force pushes the workpiece into an elastic retreat along the shell normal, so the actual wall thickness falls short of the theoretical depth of cut. The new route treats finite-element simulation as the source domain and real milling experiments as the target domain, uses transfer learning to predict the normal cutting force first, then feeds that load into an equivalent-stiffness analytical model to compute deflection. Across four test sets the method reached 93.05% to 95.27% prediction accuracy, above the CNN, PINN and TL comparison models.

  10. Cells leave a fixed fingerprint for each signaling pathway, letting one model read their signal history across cell types

    Each signaling pathway leaves a consistent fingerprint of gene activity across cell types, so signaling history no longer has to be reconstructed separately for every cell type. IRIS is a neural-network model that reads a cell's overall gene activity and estimates which pathways were switched on at each developmental stage. Tested on single cells from mouse embryos during gastrulation, it predicted when and where pathways activate in heart, gut, muscle and spinal cord lineages, and its prediction for a lung-development cell type was confirmed in mouse embryo experiments.