DeltaStream secures cash to build real-time streaming databases(techcrunch.com)
techcrunch.com
DeltaStream secures cash to build real-time streaming databases
https://techcrunch.com/2022/07/13/deltastream-lands-10m-to-build-real-time-streaming-databases/
2 comments
Companies have built enormous batch processing systems to transform, format, and store data in systems that are ready to be queried by applications across their organizations. Batch processing is thus a result of the limitations of SQL since the data has to be queried repeatedly to keep it fresh.
What if the same data is processed in real-time as it flows in with applications instantly able to access, minus all the complexity of maintaining a batch processing pipeline? I believe this is going to be the promise of streaming database systems.
What if the same data is processed in real-time as it flows in with applications instantly able to access, minus all the complexity of maintaining a batch processing pipeline? I believe this is going to be the promise of streaming database systems.
The first piece is solved by solutions like Confluent Cloud and Apache MSK. Companies can now have a stream processing store on-demand using a credit card without managing self-hosted clusters in-house in production.
For the latter part, companies still need to hire a rare breed of engineers who are experts in distributed systems, database systems, stream processing, and infrastructure to do anything useful once the streaming stores are procured.
So far, this has been a luxury that only the likes of big technology conglomerates like Netflix, Uber, Lyft, etc. can hire an army of such engineers.
Deltastream, with its cloud-native distributed streaming database engine makes it available to any business to process streams of data from streaming data sources or traditional persistant data sources within minutes using a simple SQL interface.
This is an evolution of technology on how data is going to be managed henceforth. Remember what happened to systems like dBase, MSAccess once SQL came along.
Streaming SQL is going to do the same for SQL. SQL runs on past data, whereas Streaming SQL runs on data in flight as it flows. The result set of the queried data ends once SQL stops executing, but with Streaming SQL the query never stops exeucting, and the result set is returned as soon as new data flows in.