Qwenfant: Train Big Character-level BabyLMs on Concise Parallel Text
This work concerns our submission for the Multilingual track of the 2026 BabyLM Challenge. We improve on our baseline using data that has been summarized and translated by an LLM, showing that higher-quality data can come from synthetic sources.
arXiv - cs.CL (NLP)1 min read