AutoIndexer: Flexible-Order Decoding by Training Causal Models on Chains of Edits
Autoregressive decoding is less suited to non-causally ordered data, e.g., cross-references or future dependencies, since their outputs cannot be revised post hoc, unlike iterative human reasoning.
arXiv - cs.CL (NLP)2 min read