Great point re: the “Bespoke” style of programming. It takes some unlearning and getting used to tacit programming [0] and trains [1] to appreciate this.
I’ve worked on fairly complex systems using kdb/q that are a joy to debug because the codebase is a handful of files. q is admittedly a more simplified and “mainstream” cousin of J, but allows a fair bit of expressiveness. The powerful data store (kdb) and q-sql that comes along with it
makes it one of the most concise data platforms ever. Too bad it’s not free for commercial use!
> Now if it were possible for it to accept an event from Kafka but not guarantee that the event will eventually make it into the materialized view but may be lost, that'd be a problem.
This is usually not a problem these days as it’s possible to guarantee exactly once ingestion using Kafka offsets
You’re right. You don’t get read-your-own-writes guarantees in a typical Kdb tickerplant architecture, as the event streams are propagated to the real-time nodes asynchronously.
I suppose one can measure the risk of losing messages - I’m not suggesting that it’s always possible, but calling it an unmeasurable risk is probably not true
You can start the 32 bit instance with the -s switch (for q to be started with multiple slaves) for parallel execution of a function over data using the "peach" command [0].
But yes, I do agree that the 32 bit instances have limited use, as they can't be used in for-profit projects.
As mruts pointed out above, kdb+/q provides what you're imagining - it provides fantastic distributed computing support via its IPC protocol and also has multi-core support.
http://www.algopack.com/indexgb.php makes bottles out of seaweed (brown algae) and there're other companies trying to make reuseable bioplastic bottles out of sugarcane
Although not yet commercially viable there are a few companies trying to address this problem. Algopack[0], a French startup is making plastic like material from seaweed (brown algae) and there are others that are trying out bioplastics made from sugarcane
It’s possible to understand eigen-* without having an understanding of determinants. That’s how they’re introduced in “Linear Algebra Done Right” - http://linear.axler.net/
I’ve worked on fairly complex systems using kdb/q that are a joy to debug because the codebase is a handful of files. q is admittedly a more simplified and “mainstream” cousin of J, but allows a fair bit of expressiveness. The powerful data store (kdb) and q-sql that comes along with it makes it one of the most concise data platforms ever. Too bad it’s not free for commercial use!
[0] https://www.jsoftware.com/help/jforc/tacit_programs.htm
[1] https://www.jsoftware.com/help/learning/09.htm