> we recommend using SGLang with excess tensor parallelism and EAGLE-3 speculative decoding on live edge Hopper/Blackwell GPUs accessed via low-overhead, prefix-aware HTTP proxies
Ahem, so some orgs are adopting a new technology effectively and others aren't. Whether that's because of the nature of their workflows, their organizational effectiveness, or available talent, this sounds like... the way these things work
coding was never supposed to be fun, it was supposed to be instrumental
you interface with a machine to get the machine to do what you, a human, want it to do relevant to your human purposes
but out of necessity - turns out we need to control a lot of machines - we made the act ergonomic
this fit the aesthetic of some people. All to do with them and little to do with the act. Akin to alchemists or other purveyors of exotic knowledge, the relevance of their skill always had a countdown on it
all that's left is to circle back. Coding is instrumental. Now our alchemy is one more level abstracted from the artifice of the machine. Good. It's closer to people now - like management, now. That's bad for the current generation of alchemist but good for the world
earnest RIP. On the upside, there's always a next generation
lord