Mhh... my hunch is that part of this is that all python keywords are 1 token, I assume. And for those very weird languages, tokenizing might make it harder to reason over those tokens.
Would love to see how the benchmarks results change if the esoteric languages are changed a bit to make them have 1-token keywords only.
I learned chess when I was 5, and didnt have a chess computer in the first like 5 years and by then I have progressed quite far.. so i cannot really tell
You seem knowledgeable about this.. Care to test my old project for music recommendation? I built it by looking at co-occurrence of artists in Spotify playlists, which gives me word2vec-style vectors, and then its just kNN.
No login needed, just enter some artist names and see what you get:
Maybe the post was edited afterwards?