DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling
DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling Diffusion language models intrinsically fail to capture correlations between decoded tokens, which leads to a harsh trade-off between sampling quality and throughput.
NVIDIA Research1 min read