We have found similar when plugging GLM 5.2 into actual benchmarks in our product. The open-source models are really dialled into the public benchmarks, until you try them in context you won't have a solid idea of how they perform (Sonnet is a higher quality model than 5.2, both in prose, reasoning, and alignment).
Most companies have legal agreements called "Zero Data Retention" with these providers that bans them from storing any data that you send them (we are one of those companies).
The difference here is that for the first time Anthropic have said that's not available for 'Mythos class' models.
I'm on the team who built this, I don't understand how you think these would be used. We need to use a b-tree index to give us ordered results that we then filter by the bloom column, how would an index on the bloom filter column help if we need the ordering?
Context is we didn't think these would work, and did look quite closely. We may have missed something though.
We use CC to power some of our code features and override this setting so we can provide our own attribution. So there are several legit reasons to permit this.
I hadn't come across GPTZero before and wondered if it worked. Just testing on a sample of my blog posts (I do one each year) I got a 100% AI generated mark for a post in... 2022, and 2023. Both before AI tools were around.
Not to say this post isn't AI generated but you might want a better tool (if one exists)
This is my colleague Mike’s write-up about using bloom filters to make our list alerts endpoint much faster for filtering and pagination.
In a past life I’d struggled a lot with a public API that had some really tricky pagination performance problems. It was something we were always fighting, be it awkward edge case data shapes or the Postgres planner having bad statistics, where everything would get difficult past >5TB in the table.
Was really happy to see the team find a solution that feels scalable and can be generically applied to a lot of our endpoints at incident. Quite a great outcome where I think we’ll be safely scalable for the next few years instead of hitting other problems that would crop up had we gone with gin indexes or otherwise.