Newshot

Hierarchical Latent Structure Learning through Online Inference

Summary

arXiv:2603.19139v3 Announce Type: replace Abstract: Learning systems must balance generalization across experiences with discrimination of task-relevant details. Effective learning therefore requires representations that support both. Online latent-cause models support incremental inference but assume flat partitions, whereas hierarchical Bayesian models capture multilevel structure but typically require offline inference. We introduce the \textbf{Hierarchical Online Learning of Multiscale Experience Structure (HOLMES) model}, a computational framework for hierarchical latent structure learning through online inference. HOLMES combines a variation on the nested Chinese Restaurant Process prior with sequential Monte Carlo inference to perform tractable trial-by-trial inference over hierarchical latent representations without explicit supervision over the latent structure. In simulations, HOLMES matched the predictive performance of flat models while learning more compact representations…

Original text(via arXiv cs.LG)

Computer Science > Machine Learning

Title:Hierarchical Latent Structure Learning through Online Inference

Abstract:Learning systems must balance generalization across experiences with discrimination of task-relevant details. Effective learning therefore requires representations that support both. Online latent-cause models support incremental inference but assume flat partitions, whereas hierarchical Bayesian models capture multilevel structure but typically require offline inference. We introduce the \textbf{Hierarchical Online Learning of Multiscale Experience Structure (HOLMES) model}, a computational framework for hierarchical latent structure learning through online inference. HOLMES combines a variation on the nested Chinese Restaurant Process prior with sequential Monte Carlo inference to perform tractable trial-by-trial inference over hierarchical latent representations without explicit supervision over the latent structure. In simulations, HOLMES matched the predictive performance of flat models while learning more compact representations that supported one-shot backward transfer to higher-level latent categories. In a forward transfer task, HOLMES additionally achieved above-chance outcome prediction for stimuli with never-before-seen feature combinations, by exploiting abstract shape-level representations learned across diverse training instances. These results provide a tractable computational framework for discovering hierarchical structure in sequential data.
Comments:4 figures, 6 supplementary figures under review Neural Computation
Subjects:Machine Learning (cs.LG) ; Neurons and Cognition (q-bio.NC)
Cite as:arXiv:2603.19139 [cs.LG]
(or arXiv:2603.19139v3 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2603.19139 arXiv-issued DOI via DataCite

Submission history

Access Paper:

  • HTML (experimental)

Additional Features

  • Audio Summary

Current browse context:

References & Citations

  • Google Scholar
  • Semantic Scholar

BibTeX formatted citation

Bookmark

Bibliographic and Citation Tools

Code, Data and Media Associated with this Article

Demos

Recommenders and Search Tools

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

The text above was extracted automatically from the source page and may miss images, tables or code blocks. The original is authoritative.

Published by arXiv cs.LG
This site only summarises and aggregates; copyright stays with the original author. Headlines and summaries follow the source — where they differ, the original wins.
Read the original ↗