Abstract Wikipedia(abstract.wikipedia.org)
abstract.wikipedia.org
Abstract Wikipedia
https://abstract.wikipedia.org/wiki/Abstract_Wikipedia:Main_page
10 comments
It's not that different from how LLM tokens work, only in a tree structure as opposed to a plain sequence. Having a tree structure makes it easier to formally define rewrite rules (which is key for interpretability), as opposed to learning them from data as LLM do.
Also tokens don't represent meaning in themselves, but are assigned points in a multidimensional space, they can only represent meaning in the network as a whole when combined with other tokens in context and order.
And the abstract concepts of Abstract Wikipedia are human-defined, top-down ways of carving the world into distinct categories which make some kind of logical sense, whereas LLM's work bottom-up and create overlapping, non-hierarchical, probabilistic networks of connections with nearly no imposed structure except the principle that you shall know a token by the company it keeps.
But you can type them both out with keys on a keyboard so in that sense I guess they're not that different.
And the abstract concepts of Abstract Wikipedia are human-defined, top-down ways of carving the world into distinct categories which make some kind of logical sense, whereas LLM's work bottom-up and create overlapping, non-hierarchical, probabilistic networks of connections with nearly no imposed structure except the principle that you shall know a token by the company it keeps.
But you can type them both out with keys on a keyboard so in that sense I guess they're not that different.
One issue with projects like this just show me what it is on the front page.
Even the featured article section is empty!
Even the featured article section is empty!
Correct, what is this and why is this?
Are they trying to reinvent Cyc?
https://en.wikipedia.org/wiki/Cyc
https://en.wikipedia.org/wiki/Cyc
For context, this was proposed way back in 2013 (https://meta.wikimedia.org/wiki/Abstract_Wikipedia), when machine translation is just plain bad (and LLMs are only known in academic circles). Surprised that AWiki is now active though.
[deleted]
So rather than machine translation... really primitive machine translation with extra steps?
Would you rather use a compiler, or have an LLM generate assembly code based on source code?
The purpose is to establish a new high-level lanugage
The purpose is to establish a new high-level lanugage
Haha that's like John Wilkins' "Real Character, and a Philosophical Language"
https://en.wikipedia.org/wiki/La_Ricerca_della_Lingua_Perfet... is a great intro to the weird and wonderful world of abstract/universal/ideal/a priori languages.