I’m guessing they adjusted the activations of certain edges within the hidden layers during forward propagation in a manner that resembles the difference in activation between two concepts, in order to make the “diff” seem to show up magically within the forward prop pass. Then the test is to see how the output responds to this forced “injected thought.”
I ended up going the opposite direction. My 11th grade trigonometry teacher forced me to repeat trig despite my having gotten a B. I was angry at the time! She did me a favor because by the time I got to Calculus in University it was very intuitive and I didn’t have much of a problem with it.
I went looking for mentions of Semantic Networks, RDF, triplets, taxonomy, or other common knowledge-related terms but I found nothing. Thoughts about pre-existing knowledge graph systems and how they may or may not apply to System? Thanks!