Skip to main content
Search

# Hybrid Architecture

3 related articles

Subscribe to updates
  1. Liquid AI

    Liquid AI packs text, vision, audio and decision models into one 2B backbone, about 25% faster than LFM2 at 8K context

    Liquid AI released LFM3, a family that puts text, vision, audio, omni and decision models on one shared backbone of roughly 2B parameters, with base and post-trained weights open-weight on Hugging Face and its API. The backbone mixes gated short convolutions, sliding-window attention and global attention, was pre-trained on 22T tokens, and a final 3.5T-token mid-training stage extends context to 256K. Per parameter, LFM3-1.7B matches LFM2-1.2B on short prompts across edge devices and is about 25% faster with 8K tokens in context.

  2. arXiv

    Dual-process framework cuts red-light-running collisions from 48 to 5 in autonomous driving tests

    The work proposes a dual-process-inspired hybrid framework in which a TransFuser++ neural planner generates human-like trajectories in routine driving while a meta-cognitive component, using risk fields shaped by knowledge-graph reasoning, decides when to switch to a model predictive control planner; tested in CARLA on out-of-distribution scenarios of vehicles (including an ambulance) running a red light, it reduced vehicle-to-vehicle collisions from 48 to 5 out of 160 simulations, an 89% reduction.

  3. arXiv

    A survey recasts attention evolution as contextual-memory organization, using 59 release records and 11 open-weight endpoints

    Treating model-internal contextual memory as the shared unit of analysis, this survey introduces five dimensions—Memory Representation, Memory Update, Access, Readout, and Integration—and reviews five research lines (Softmax Attention, Sparse Attention, Linear Attention, State Space Models, and Hybrid Architectures), using 59 release-level records across 14 major model lineages and a frozen comparison of 11 high-performing open-weight endpoints through September 22, 2026 to argue that attention design is diversifying rather than converging, with hybridization and cross-layer reuse making network depth a dimension along which contextual memory is organized.

You’re all caught up