Newshot

FoundCause: A Foundation Model for Causal Discovery with Latent Confounders from Observational Data

Summary

arXiv:2606.17516v2 Announce Type: replace-cross Abstract: Causal discovery from observational data requires recovering directed relations and latent confounding without interventions. We propose FoundCause, an {\em amortized causal discovery foundation model} trained only on synthetic structural causal models that maps datasets to causal graphs in a single forward pass. A permutation-equivariant transformer alternates attention over samples and variables to model cross-variable dependence and per-variable distributions. Pairwise dependence and asymmetry statistics guide its attention, edge decoder and confounder module. The decoder separates edge existence from direction, while triangular refinement incorporates evidence from chains and colliders. Learnable latent tokens predict which variable pairs share a hidden common cause, and a masked input representation handles missing data. To our knowledge, FoundCause is the first amortized causal discovery approach for i.i.d. observational d…

Original text(via arXiv stat.ML)

Computer Science > Machine Learning

Title:FoundCause: A Foundation Model for Causal Discovery with Latent Confounders from Observational Data

Abstract:Causal discovery from observational data requires recovering directed relations and latent confounding without interventions. We propose FoundCause, an {\em amortized causal discovery foundation model} trained only on synthetic structural causal models that maps datasets to causal graphs in a single forward pass. A permutation-equivariant transformer alternates attention over samples and variables to model cross-variable dependence and per-variable distributions. Pairwise dependence and asymmetry statistics guide its attention, edge decoder and confounder module. The decoder separates edge existence from direction, while triangular refinement incorporates evidence from chains and colliders. Learnable latent tokens predict which variable pairs share a hidden common cause, and a masked input representation handles missing data. To our knowledge, FoundCause is the first amortized causal discovery approach for i.i.d. observational data to predict latent confounding as a separate, explicit output. On 14 real-world and semi-synthetic datasets, FoundCause leads 11 classical and 7 amortized baselines in average AUROC, $F_1$, skeleton $F_1$, and normalized structural Hamming distance ($\mathrm{SHD}/d$): clearly in $\mathrm{SHD}/d$ ($0.875$ vs.\ $0.956$), narrowly in $F_1$ ($0.531$ vs.\ $0.516$). It also has the highest accuracy among amortized methods on bivariate cause--effect pairs.
Comments:Download the model at this https URL
Subjects:Machine Learning (cs.LG) ; Artificial Intelligence (cs.AI); Methodology (stat.ME); Machine Learning (stat.ML)
Cite as:arXiv:2606.17516 [cs.LG]
(or arXiv:2606.17516v2 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2606.17516 arXiv-issued DOI via DataCite

Submission history

Access Paper:

  • HTML (experimental)

Additional Features

  • Audio Summary

Current browse context:

References & Citations

  • Google Scholar
  • Semantic Scholar

BibTeX formatted citation

Bookmark

Bibliographic and Citation Tools

Code, Data and Media Associated with this Article

Demos

Recommenders and Search Tools

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

The text above was extracted automatically from the source page and may miss images, tables or code blocks. The original is authoritative.

Published by arXiv stat.ML
This site only summarises and aggregates; copyright stays with the original author. Headlines and summaries follow the source — where they differ, the original wins.
Read the original ↗