The next major release of Tributary will support Avro, Protobuf and JSON along with the Schema Registry it will also bring the ability to write to Kafka with transactions.
But really you should get excited for DuckDB Labs to build out materialized views. Materialized views where you can ingest more streaming data to update aggregates. This way you could just keep pushing rows through aggregates from Kafka.
It is going to be a POWER HOUSE for streaming analytics.
Yet again Hollywood is prescient. This post reminds me of the language of the aliens in Arrival. It seems like the OP would see that as a reasonable input to an LLM.
Without diversification, we’re just setting ourselves up for an economic rug pull the moment the AI growth hits the law of large numbers and people realize its not the magic they think it is. Economically? Don’t worry it’ll just be another “oops, your 401k lost a bit, here’s a bailout” moment. AKA, stimulus with sprinkles.
I'm not a biologist, but I grew up in West Yellowstone around the time wolves were reintroduced. Their return—and its impact—has been extensively studied by experts far more qualified than me.
That said, I believe wolves had a profound effect on the Yellowstone ecosystem, particularly on elk and deer populations. Before their reintroduction, those species had few natural predators beyond hunters, vehicles, bears, and the occasional mountain lion. The imbalance led to overgrazing and the spread of diseases like Chronic Wasting Disease (CWD) in elk.
Ada was the first language they threw at us in university back in '98. At the time, it felt like learning Latin to become a poet, but looking back, those lessons—rigor, clarity, and discipline—have aged better than some modern frameworks. Ada may not trend on GitHub, but it quietly shaped a generation of better programmers.
You’ll see how DuckDB can integrate with Arrow Flight for reading/writing/creating tables, scalar user defined functions, table returning functions, table in/out streaming functions, row/column filtering and anything else I can breeze through in 15 minutes.
It all starts with a single call to ATTACH with the URL of the Arrow Flight server.