HackerTrans
TopNewTrendsCommentsPastAskShowJobs

Misdicorl

no profile record

comments

Misdicorl
·6 เดือนที่ผ่านมา·discuss
Your place of last resort with kafka is simply to replay the message back to the same kafka topic since you know it's up. In a simple single consumer setup just throw a retry count on the message and increment it to get monitoring/alerting/etc. Multi consumer? Put an enqueue source tag on it and only process the messages tagged for you. This won't scale to infinity but it scales really really far for really really cheap
Misdicorl
·12 เดือนที่ผ่านมา·discuss
One way to measure this that isn't moral judgements is the ecological depth of an environment. If one part of the system is destroyed (e.g. a blight on plant A) how devastating to the rest of the system will that be?

One of the hallmarks of human engineered environments is how shallow and fragile they are. Changes, like the reintroduction of wolves, are "good" because they give us deeper and more resilient environments
Misdicorl
·ปีที่แล้ว·discuss
The story I've heard is that general motors down fall began when they stopped writing loans for other car manufacturers. They used to under write basically every car loan in the US.

I've never looked into how truthful it is, but it smacks of idiotic/arrogant executive tropes so well I almost don't want to discover it's false
Misdicorl
·ปีที่แล้ว·discuss
I'll throw my hat in the ring for "disagree". Few kinds of work have such clear and unambiguous results as optimization work (its now X% faster!). Few kinds of work have such incredible and detailed tools to guide your hand in finding where to invest your effort (look at this hot loop!).

The fact that sometimes optimization work is tricky or requires some pre-thinking, or is even gasp counter-intuitive is such a hilarious way to say "this is hard". That's just table stakes starting points for so-so-so much work.

Edit: Heck, even deciding whether to prioritize optimization work or feature work is usually a harder problem than the actual optimization work itself.
Misdicorl
·ปีที่แล้ว·discuss
Sometimes the vibes are wrong, and things go haywire. This is why zero tolerance policies have to be instituted in schools. That doesnt mean the general idea is wrong. Strict adherence to written law will always fail justice. The world is too nuanced and too fractal to handle every edge case well.
Misdicorl
·ปีที่แล้ว·discuss
Would be really interesting to see what it does with clearly wrong EXIF data
Misdicorl
·ปีที่แล้ว·discuss
Yeah I'd say kafka is not a great technology if your median and 99ths (or 999ths if volume is large enough) are wildly different which sounds like your situation. I use kafka in contexts where 99ths going awry usually aren't key dependent so I don't have the issues you see.

I tend to prefer other queueing mechanisms in those cases, although I still work hard to make 99ths and medians align as it can still cause issues (especially for monitoring)
Misdicorl
·ปีที่แล้ว·discuss
Follow on: If you're using kafka to publish messages to multiple consumers, this is even worse as now you're infecting every consumer with data processing issues from every other consumer. Bad juju
Misdicorl
·ปีที่แล้ว·discuss
I suppose it depends on your message volume. To me, processing 100k messages and then getting a page however long later as the broker (or whatever) falls apart sounds much worse than head of line blocking and seeing the problem directly in my consumer. If I need to not do head of line blocking, I can build whatever failsafe mechanisms I need for the problematic data and defer to some other queueing system (typically, just add an attempt counter and replay the message to the same kafka topic and then if attempts > X, send it off to wherever)

I'd rather debug a worker problem than an infra scaling problem every day of the week and twice on Sundays.
Misdicorl
·ปีที่แล้ว·discuss
And now imagine how easy dealing with email spam would be if the marginal fiscal cost was not 0 like physical spam. All the technology and tools available and less than 1% of the viable spam surface area
Misdicorl
·ปีที่แล้ว·discuss
> the goal should be to ensure that anyone who wants to do a thing can, with as few third party requirements as possible.

This is a good starting point, but if you have no barriers then you get abuse problems which is why email is terrible. I remember being horrified in the 90s about attempts to charge 1 cent per email. Now I long for a world where that actually happened.
Misdicorl
·ปีที่แล้ว·discuss
It wouldn't, but it might preclude using (future) optimizations that forgo those de-optimization hooks?
Misdicorl
·ปีที่แล้ว·discuss
I suppose serializing the JVM state itself to avoid the cold start problem might take advantage of this?
Misdicorl
·2 ปีที่แล้ว·discuss
The past decade is a difficult framing to ask the question in. Notable breakthrough results are usually understood in hindsight and a decade just isn't a lot of time for that context and understanding to develop. Science also doesn't necessarily develop in this way with consistent progress every X timespan. Usually you get lots and lots of breakthroughs all at once as an important paradigm is shattered and a new one is installed. Then observations with tiny differences slowly pile up and a very blurry/messy picture of the problems with the new paradigm takes shape. But none of those things feels like a breakthrough, especially to a layman.

That said: I'll submit the first detection of gravitational waves as two black holes merged together in 2020 as meeting the bar of "notable breakthrough in the last decade".
Misdicorl
·2 ปีที่แล้ว·discuss
Ignoring inexperience/incompetence as a reason (which, admittedly, is a likely root cause) domain fuzziness is often a good explanation here. If you aren't extremely familiar with a domain and know the shape of solution you need a-priori all those levels of indirection allow you to keep lots of work "online" while (replacing, refactoring, experimenting) with a particular layer. The intent should be to "find" the right shape with all the indirection in place and then rewrite with a single correct shape without all the indirection. Of course, the rewrite never actually happens =)
Misdicorl
·2 ปีที่แล้ว·discuss
You didn't understand the original claim which is that because Pi has an infinite decimal representation, every subsequence of it has a repeat
Misdicorl
·2 ปีที่แล้ว·discuss
This isn't true as you can build an infinite sequence that never repeats. An example sequence in binary is (the number of 0s between each 1 increases by 1 every time)

01001000100001...
Misdicorl
·2 ปีที่แล้ว·discuss
The goal can't be to solve every desperation case. But if the program wouldn't allow individuals living in dangerous and exploitative situations to confidently leave them (financially) Id argue the program was a failure
Misdicorl
·2 ปีที่แล้ว·discuss
True. It would be nice to decouple it from children and expand its scope of economic impact dramatically.
Misdicorl
·2 ปีที่แล้ว·discuss
$1000/month is $12,000/year. Thats far far below poverty levels. It needs to be enough that people can choose to supplement in order to engage with luxury consumption. If people are forced to supplement to just survive, then we need to maintain the minimum wage and a whole host of other weird baggage.