Multi-modal foundation model for materials science. Modality-specific foundation models encode the representations to the latent space where latent vectors are fused, so that a shared Platonic representation of molecules/materials that unifies all material representations can be learned.
Image: Changwen Xu, University of Michigan and Hongshuo Huang, University of Michigan