VANDAM: Viewing a nucleotide sequence with DNA molecular priors
Contemporary Genomic Foundation Models (GFMs) rely on a DNA-as-a-string paradigm that employs masked token prediction objectives for pretraining. However, this abstraction does not explicitly model the biochemical, structural, and physical properties essential to biological function.
arXiv - stat.ML2 min read