LatLM: Line-Parallel Language Models with Deferred Commitment
Line-parallel language models advance multiple lines concurrently for substantial speedups. However, frameworks like the Line-Coupled Language Model (LCLM) enforce a fixed commitment schedule across lines.
arXiv cs.LG2 min read