JUICE: Unified Multimodal Modeling in Pretrained Representation Spaces
Most unified multimodal models treat images and text asymmetrically: a pretrained language model generates text, an attached diffusion head generates images, and outputs that contain both are produced in a fixed order, so the first output cannot adapt to the second.
arXiv - cs.CV (CV)3 min read