25 years in industry, as staff engineer and CTO. Experienced across fields from safety critical embedded systems to distributed machine learning pipelines. Cross-disciplinarian, rabid learner, expert on system design and architecture.
Not impressed with the LLM hype or whatever latest crypto token you're hockin'
Have you just discovered the concept that humans are all humans, and all our achievements are just a mountain of knowledge we stand upon, from first principles?
Humans are human, someone being born in Africa doesn't magically mean that they will never understand technology.
Threads generally have less memory overhead and context switching between them is theoretically faster, but as I suspect you know it is situational and not as simple as just s/process/thread/g. There are many tradeoffs, including the loss of memory isolation, and since Postgres is a network application which holds a rather important position in most architectures, proper memory isolation is very important.
Switching to threads doesn't guarantee weaker isolation, just like it doesn't guarantee better performance, but those nuances are why "switching to threading yields performance improvements" is over simplified to the point of uselessness. It simply reeks of the same kind of ignorance that used to drive statements like "rust doesn't have vulnerabilities" and "rewrite it in javascript for web scale performance".
Ah yeah, what I figured. You clearly have no idea what you're talking about. Don't get all mad when someone calls you out on it.
By the way, just so you have some concept of what the actual problem is despite your resistance to education:
Simply switching from processes to threads will not yield the claimed performance increases. A 300x improvement on analytic workflows? From a direct transliteration? Your BS alarms should be going off. They should be screaming "5 Alarm Fire".
The only way they got that increase was by breaking the synchronization mechanisms that provide ACID guarantees in Postgres, otherwise a direct rewrite would expect very similar performance.
If you’re going to make a confident blanket claim, be ready to back it up - and asking for clarification is not trolling, by the way. You should be ready to engage in technical conversations if you want to make technical claims.
No I'm not missing anything. The existing specifications and tests provide a huge validation surface to work against for this kind of migration - they're the foundational pieces of the control loop. Without those two things, this kind of rewrite would not be possible.
We have known for decades that the hard part in programming isn't programming, it's making sure you have the right target! Bad designs and bad specifications have caused more bugs and broken software than anything else, and the time taken to develop the testing and validation suites (that is - the javascript spec tests) this rewrite used must be considered part of the engineering effort.
> and btw, if it can write code, it can write tests and test suite
You must be very early in your career. Again, the hard part is not writing the test, it's knowing which tests to write.
> I wished the two phases would have been tackled in reverse order.
Well, tackling them in reverse order would require the humans behind this to develop an actual understanding of the existing code and architecture before starting the project, instead of just asking claude to do it. So, here we are.
> Aiming for postgres compatible database with a 2026 architecture
Except you didn't improve the architecture, did you? You just asked an LLM to copy what was already there. Making real improvements to the database architecture requires understanding the database architecture, not just asking a calculator to do the work for you.
Better benchmark performance means nothing if the underlying guarantees break, and a 300x improvement sure makes me suspicious. I would look at something like this if it passes a Jepsen test, otherwise you simply will not be able to convince me that it's worth my time.
- They had an existing functional Zig implementation
- They had an existing test suite for the Zip implementation
- They had a separate JavaScript compliance test suite with ~ 1 million tests
- The person overseeing the rewrite was responsible for a huge portion of the existing codebase and was very familiar with the existing architecture and problems
I don't think that middle management at most companies is going to be starting from that same point when it comes to building or updating something. Generally, I don't think there are many projects out there that have such robust existing tests and specifications.
In this case, the engineering behind the tests and specifications need to also be considered part of the process, since without those you wouldn't be able to build a control loop in the same way.
If people have issues with how USAID was being run, they can address them through action in congress - congress established the agency and has authority.
What Musk participated in was illegal, motivated by self-interest and personal gain, and undermines our democratic processes. Don’t be surprised that people are mad at the oligarch acting like an oligarch. Musk deserves exactly as much say in the American government as anyone else - one vote - but in his arrogance he has taken his resources and used them to buy influence that is not his to own. It is fundamentally unamerican.
Claiming the left is incapable of objectivity while also claiming that it stands for “prostitution”, “unlimited immigration”, and “crime” just highlights how detached from reality your worldview has become.
> Bud, it's "narcissist". And all one has to be to love what one sees in the mirror is grateful and confident in who one is. I completely understand how that would be foreign to you.
God, it must hurt being that stupid. Like seriously, how do you even put your shoes on without strangling yourself? Do they even trust you with scissors?
You are a liar, it has been demonstrated. If you feel such a shame about your beliefs because you really do understand deep down that they’re wrong and that you are sinning, you should repent.
To continue to behave like you have been outs you as cowardly little worm.
Not impressed with the LLM hype or whatever latest crypto token you're hockin'