Brain MRI foundation models lose accuracy on a new dataset: not because they remember the source, but because each dataset encodes the sequence along different directions
Across 17 public brain MRI datasets and eight frozen representations, the sequence is recognizable inside every dataset yet collapses on an unseen one, because each dataset encodes the sequence difference along different directions rather than because the features remember where a scan came from.