UltraData-Code2 min read
UltraData-Code: From Raw Repositories to Algorithmically Dense and Task-Oriented Code Data
Code generation has become a core capability of large language models (LLMs), and code data is central to the pre-training process that develops it. As obtaining public code of sufficient quality becomes more difficult, further progress cannot rely on corpus expansion alone.
By Chengying Tu, Hengyu Zhao, Shuaikang Xue, Zhongming Qu, Jihao Zhou, Xinle Lin, Junshao Guo, Zixuan Fu, Qiang Ma, Jie Zhou, Chaojun Xiao, Hongfei Yan, Yudong Wang, Xu Han, Zhiyuan Liu, Maosong SunarXiv cs.LG
Read the full story
Originally published by arXiv cs.LG on Oct 21, 2026.
Comments
Sign in to join the discussion.