avatar
AstroAI
Developing Artificial Intelligence to Solve the Mysteries of the Universe
  • HOME
  • RESEARCH
  • EARTHAI
  • PEOPLE
  • EVENTS
  • LATEST NEWS
  • LUNCH TALKS
  • SUMMER PROGRAM
  • WORKSHOP
  • APPLY
  • CONTACT
Home AstroAI Workshop 2025
Workshop_abstract
Cancel

AstroAI Workshop 2025

Details Invited Speakers Abstracts Register Schedule Venue Accommodations Code of Conduct

Daniel Muthukrishna

Causally Motivated Foundation Models: Disentangling Physics from Systematics

Presenter: Daniel Muthukrishna (MIT, AstroAI)

Title: Causally Motivated Foundation Models: Disentangling Physics from Systematics

Date/Time: Friday, July 11th, 1:30 - 2:00 PM

Abstract: Foundation models for scientific data must contend with a fundamental challenge: observations often conflate the true underlying physical phenomena with systematic distortions introduced by measurement instruments. This entanglement limits model generalization, especially in heterogeneous or multi-instrument settings. I present a causally motivated foundation model that explicitly disentangles physical and instrumental factors using a dual-encoder architecture trained with structured contrastive learning. Leveraging naturally occurring observational triplets (i.e., where the same target is measured under varying conditions, and distinct targets are measured under shared conditions) our model learns separate latent representations for the underlying physical signal and instrument effects. Evaluated on simulated astronomical time series designed to resemble the complexity of variable stars observed by missions like NASA’s Transiting Exoplanet Survey Satellite (TESS), our method significantly outperforms traditional single-latent space foundation models on downstream prediction tasks, particularly in low-data regimes. These results demonstrate that our model supports key capabilities of foundation models, including few-shot generalization and efficient adaptation, and highlight the importance of encoding causal structure into representation learning for structured data.

-->

© 2025 AstroAI. Some rights reserved.

Powered by Jekyll with Chirpy theme.

A new version of content is available.