LLM Neuroanatomy II: Modern LLM Hacking and Hints of a Universal Language?(dnhkng.github.io)

7 pointsby zdw4 ay önce1 comments

dnhkng.github.io

LLM Neuroanatomy II: Modern LLM Hacking and Hints of a Universal Language?

https://dnhkng.github.io/posts/rys-ii/

2 comments

vibe424 ay önce

Pretty sweet hack as it's orthogonal to quantisation. And while it uses more compute, it doesn't require more VRAM.

Maybe in the future circuits will become modular and composable like models are today?

dnhkng4 ay önce