Know a great AI tool or AI news source? Submit it to AiByts
2 min read

Speaking-Clock Mamba: Phoneme-Conditioned State-Space Modeling for Visual Forced Alignment

Visual forced alignment (VFA) locates phoneme and word boundaries in a silent talking-face video given its transcript. Existing methods mainly enforce transcript order at the decoding stage, leaving the encoder without an explicit mechanism to anchor its temporally evolving representation to…

By Nan Lu, Qifan LiangarXiv - cs.CV (CV)

Read the full story

Originally published by arXiv - cs.CV (CV) on Nov 17, 2026.

Read on arXiv - cs.CV (CV)(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.