That may be true, but if you look at the distribution it puts out for this, it definitely smells funny. It looks like a very steep normal distribution, centered at 0 (ish). Seems like it should have two peaks? But maybe those are just getting compressed into one because of resolution of buckets?
Those are not the right population metrics to compare. If you're talking full Bay Area, you might as well talk NYC metro area (MTA claims to serve 15.3 million [1]). Tokyo's even trickier, but I think 36 million [2] seems closer to right.
It's probably not worth arguing about too much, because ultimately I agree with you that there's a lot more to be done to reduce car ridership. But pointing at those places and saying "copy them" misses a lot of structural differences.
Why so negative? Given that the served population is conservatively a quarter of either of those areas, doesn't seem like a fair comparison.
More to the point, I've been favorably impressed with the transit options since moving here, and in terms of reliability it's been better than NYC, though obviously there are fewer trains/branches.
I'd love to see BART open later, like NYC, but even Tokyo trains stop at midnight.
> I believe this sort of core knowledge is learnable through movement and interaction data in a simulated world and it will not present a very difficult barrier to cross.
Maybe! I suppose time will tell. That said, spatial intelligence (connection/movement included) is the whole game in this evaluation set. I think it's revealing that they can't handle these particular examples, and problematic for claims of AGI.
Personally, I think it's fair to call them "very easy". If a person I otherwise thought was intelligent was unable to solve these, I'd be quite surprised.