How might LLMs store facts [video](youtube.com)
youtube.com
How might LLMs store facts [video]
https://www.youtube.com/watch?v=9-Jl0dxWQs8
1 comments
Loved the part at the end of the video about the Johnson-Lindenstrauss Lemma. Really great visualizations of how high dimensionality can encode so much information.