
Summaries like this, in your inbox every morning.
Sign up free →Standard alignment metrics like Representational Similarity Analysis, Centered Kernel Alignment, and linear regression systematically underestimate similarity between neural networks operating in superposition
Neural systems compress multiple features into fewer neurons through superposition, but traditional metrics ignore this mechanism and only measure raw activation patterns
Differences in superposition matrices between two systems cause alignment scores to conflate what features are represented versus how they are represented, leading to misleading dissimilarity measures
The research provides closed-form mathematical expressions demonstrating that networks with identical feature content appear dissimilar when evaluated with conventional metrics
No comments yet. Be the first to share your thoughts!
Log in to join the discussion





Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.
Get Started FreeFree · takes 30 seconds · unsubscribe anytime
1 minute a day. The AI essentials.
200+ sources · Email / LINE / Slack