machine learning3 min read
Taking EmbeddingGemma-2 (577M) from Rank #26 to #1 on the MAEB audio benchmark by filling its 256d null space with PCA-reduced intermediate Conformer layers (zero training) [R]
I wanted to share an experiment on google/embeddinggemma-2 (577M) for MAEB, the 30-task audio benchmark on the MTEB leaderboard. By projecting intermediate Conformer layers into the unused null space of the model's final projection matrix using only PCA, the model's macro score jumps from 49.3% to…
By /u/JeanMichelRanuReddit - r/ML
Read the full story
Originally published by Reddit - r/ML on Oct 28, 2026.
Comments
Sign in to join the discussion.