Cloudflare's data platform and the AI agent on top of it(blog.cloudflare.com)
blog.cloudflare.com
Cloudflare's data platform and the AI agent on top of it
https://blog.cloudflare.com/our-unified-data-platform/
4 comments
Interesting.
> Apache Trino for that: a single SQL query can join a Postgres table, a ClickHouse table, and an Iceberg table on R2 without a need to materialize the intermediate results into a different system.
How does it manage to do that? I'd think you'd need intermediate results somewhere.
> Apache Trino for that: a single SQL query can join a Postgres table, a ClickHouse table, and an Iceberg table on R2 without a need to materialize the intermediate results into a different system.
How does it manage to do that? I'd think you'd need intermediate results somewhere.
Congratulations for this ! Did you consider https://github.com/obi1kenobi/trustfall to query all your data sources ? If yes, what were the limits of this engine ?
Nice writeup, one nit though – I don't think Trino is in ASF :)
That's an interesting thing to say. Something inside me says log all queries so that someone can come in later and figure out that hey, 30% of queries in Q1 involve the Foo system and it is slow/expensive, and then go and optimize the Foo system and save the company specific amounts of time/money.