When Models Manipulate Manifolds: The Geometry of a Counting Tasktransformer-circuits.pub4 ポイント·投稿者 1wheel·9 か月前·0 コメント
1wheel·4 か月前·議論2015 was about the last year you could get away with publishing an interactive graphic with a fixed width — this made it harder do really creative/original work.
1wheel·4 か月前·議論https://visxai.io/ has a bunch more too — see the Hall of Fame section at the bottom for some of the highlights.I also made a dozen of these a couple years ago, my two favorites:- https://pair.withgoogle.com/explorables/fill-in-the-blank/- https://pair.withgoogle.com/explorables/grokking/
1wheel·昨年·議論It can be! Here's a circuit showing how the model processes "PCB tracing stands for" to output "printed":https://www.neuronpedia.org/gemma-2-2b/graph?slug=pcb-tracin...
1wheel·昨年·議論Browsers won't use http2 unless https is on — chrome only allows six concurrent requests to the same domain if you're not using https!