Skip to main content
Search

# Hidden Markov Model

4 related articles

Subscribe to updates
  1. arXiv

    Putting an Ising model inside a hidden Markov chain: pseudolikelihood sidesteps the partition function, and U.S. county gun-death weeks split into four states

    The hidden Markov Ising model makes an Ising model, a binary graphical model from statistical physics, the emission distribution of a hidden Markov chain, so that a binary network's dependence structure is modeled directly as its state changes over time. Because the Ising normalizing constant grows exponentially with the number of nodes, fitting uses pseudolikelihood inside Baum-Welch reestimation, with results on the algorithm's validity, model identifiability and large-network consistency. Exogenous covariates extend it to a hidden Markov autologistic model, applied to a five-year sequence of weekly gun-death events across 3109 continental U.S. counties from 2021 to 2025, where it identifies state changes in gun violence activity.

  2. arXiv

    Ottoman verse no longer needs a scholar's transliteration: full-line scansion accuracy rises from 26.8% to 77.6% on plain modern Turkish spelling

    Ottoman Divan poetry is written in aruz, a quantitative meter that counts each syllable as long or short, and modern Turkish spelling drops the marks that record long vowels, so length has to be inferred from context. A lattice-based hidden Markov model lays out candidate scholarly spellings of each word together with linking and lengthening choices as paths, is trained by EM from each poem's printed meter, and scans 77.6% of held-out lines fully correctly, against 26.8% for a rule-based scanner, 55.0% for a neural tagger trained with the same supervision and 63.6% for Claude Opus 5.5 few-shot on the same 500 lines. The code is open-sourced and the tool is released on the web.

  3. bioRxiv

    DUMMEST shrinks frameshift-aware alignment: 2–12× faster than BATH, better specificity on simulated reads

    Long-read DNA often carries frameshift errors, and aligning it to protein family profiles has meant either translating six reading frames or correcting errors first, both of which cost sensitivity. DUMMEST follows DUMMER's length-bias-free alignment idea and adds nucleotide-emitting indel states to the match, insert and delete states, approximating frameshifts with combinations of nucleotides and codons, with GPU-accelerated MMseqs2 multistage prefiltering. On simulated long reads it detects more alignments with greater average length, matches BATH in sensitivity, improves specificity under simulated sequencing artifacts, and runs 2–12× faster depending on dataset.

  4. arXiv

    Why the Jacobian lens favors slow features: a theory writes its choice as three coherence factors and predicts their ordering in toy models

    The Jacobian lens (J-lens), an interpretability tool that decodes a model's hidden states into words, had been used to find working-memory-like linear directions, but what makes a feature detectable to it was unclear. This work gives a mathematical theory: the lens preferentially selects directions that grow across layers, stay smooth across token positions, and remain consistent across contexts, that is, coherent Lyapunov modes. On a Bayes filter and a two-layer toy transformer, changing task parameters to modulate coherence shifts the ordering of latent states the lens selects, as predicted.

You’re all caught up