EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Dynamic Division of Labor in Hybrid AI: Contrasting Encoder Strategies and Their Impact on LSTM Modulators

A. K. Zvereva, A. V. Grabovoy, M. S. Kaprielova

Doklady Mathematics · 2025-12 · 112 (3) · 541-552

DOI: 10.1134/s1064562425700590 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Doklady Mathematics, online erschienen am 22.03.2026. Verfasst von A. K. Zvereva und 2 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The collaboration between spatial encoders, such as CNNs and Vision Transformers (ViTs), and temporal modulators like LSTMs is fundamental to hybrid models, yet the dynamics of this interplay remain poorly understood. This study introduces a cross-domain framework, leveraging metrics from Information Theory and the Markov Information Bottleneck (MIB) principle, to quantify the internal information flows of these architectures. We analyze two distinct models—a CNN-LSTM for surveillance video and a ViT-LSTM for medical fMRI sequences—on both their native and foreign domains. Our analysis reveals two fundamentally different encoding strategies. The CNN employs a rigid, data-agnostic ‘Gradual Compression’ pipeline. The ViT, in contrast, demonstrates an ‘Adaptive Compression’ strategy, where the successful formation of an efficient information bottleneck is conditional on the data domain. We demonstrate that this adaptability is supported by a nuanced three-stage functional hierarchy within the ViT. Furthermore, we find the LSTM modulator’s role adapts to its partner: paired with the CNN, it acts as a conventional compressor, but when paired with the ViT, it switches to an ‘unpacker’ role to process the hyper-compressed representations it receives. We propose that this complex interplay exemplifies a principle of a ‘Dynamic Division of Labor,’ where functional roles are not fixed but emerge from the system’s interaction with the data. This insight challenges the static view of neural network components and opens a path toward more robust, context-aware AI.

Zitieren

APA

Zvereva, A. K., Grabovoy, A. V., & Kaprielova, M. S. (2025). Dynamic Division of Labor in Hybrid AI: Contrasting Encoder Strategies and Their Impact on LSTM Modulators. Doklady Mathematics, 112(3), 541-552. https://doi.org/10.1134/s1064562425700590

Vancouver

Zvereva AK, Grabovoy AV, Kaprielova MS. Dynamic Division of Labor in Hybrid AI: Contrasting Encoder Strategies and Their Impact on LSTM Modulators. Doklady Mathematics. 2025;112(3):541-552. doi:10.1134/s1064562425700590

BibTeX
@article{Zvereva2025,
  author = {Zvereva, A. K. and Grabovoy, A. V. and Kaprielova, M. S.},
  title = {Dynamic Division of Labor in Hybrid AI: Contrasting Encoder Strategies and Their Impact on LSTM Modulators},
  journal = {Doklady Mathematics},
  year = {2025},
  volume = {112},
  number = {3},
  pages = {541--552},
  doi = {10.1134/s1064562425700590}
}
Kostenlos starten →