Yes but you now have the ability to run queries with a shortcut from your Mac, as well as switch to a local model using a dedicated keyboard shortcut. See demo: https://x.com/cyrilzakka/status/1838618605648490974
I see what you mean although I was specifically referring to the delta column. I might be misunderstanding it - can you explain the huge flux in the confidence intervals there? That’s what struck me.
Well not exactly - Table 6 is a bit concerning. It's meant to show that despite significant data contamination between testing and training datasets, the model still performs 'well'. Except look at those confidence intervals - they're all over the place, meaning the model performance isn't very reliable. You have confidence intervals comprising 30-40 percentage points!