When Models Manipulate Manifolds: The Geometry of a Counting Tasktransformer-circuits.pub4 points·by 1wheel·9 mesi fa·0 comments
Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnettransformer-circuits.pub168 points·by 1wheel·2 anni fa·124 comments
The Claude 3 Model Family: Opus, Sonnet, Haiku [pdf]www-cdn.anthropic.com33 points·by 1wheel·2 anni fa·3 comments
1wheel·4 mesi fa·discuss2015 was about the last year you could get away with publishing an interactive graphic with a fixed width — this made it harder do really creative/original work.
1wheel·4 mesi fa·discusshttps://visxai.io/ has a bunch more too — see the Hall of Fame section at the bottom for some of the highlights.I also made a dozen of these a couple years ago, my two favorites:- https://pair.withgoogle.com/explorables/fill-in-the-blank/- https://pair.withgoogle.com/explorables/grokking/
1wheel·anno scorso·discussIt can be! Here's a circuit showing how the model processes "PCB tracing stands for" to output "printed":https://www.neuronpedia.org/gemma-2-2b/graph?slug=pcb-tracin...
1wheel·anno scorso·discussBrowsers won't use http2 unless https is on — chrome only allows six concurrent requests to the same domain if you're not using https!