transformer25 min read
The Transformer Family
[Updated on 2023-01-27: After almost three years, I did a big refactoring update of this post to incorporate a bunch of new Transformer models since 2020. The enhanced version of this post is here: The Transformer Family Version 2.0. Please refer to that post on this topic.]
By Lilian WengLil'Log (Lilian Weng)
Read the full story
Originally published by Lil'Log (Lilian Weng) on Apr 7, 2020.
Comments
Sign in to join the discussion.