HackerTrans
トップ新着トレンドコメント過去質問紹介求人

enether

no profile record

投稿

Nobody Understands Kafka Costs

getkafkanated.substack.com
1 ポイント·投稿者 enether·2 か月前·0 コメント

Bufstream Sold to CoreWeave

buf.build
3 ポイント·投稿者 enether·2 か月前·0 コメント

Profile guided compiler optimization leads to 47% lower p99.9 in Redpanda

redpanda.com
2 ポイント·投稿者 enether·2 か月前·0 コメント

Ursa – a new Iceberg-first storage engine for Kafka

topicpartition.io
3 ポイント·投稿者 enether·3 か月前·2 コメント

Kafka Options Explorer

kafka-options-explorer.conduktor.io
1 ポイント·投稿者 enether·3 か月前·1 コメント

[untitled]

1 ポイント·投稿者 enether·4 か月前·0 コメント

How KIP-881 and KIP-392 Reduce Inter-AZ Networking Costs in Classic Kafka

getkafkanated.substack.com
1 ポイント·投稿者 enether·5 か月前·0 コメント

Nobody Ever Got Fired for Buying Confluent

tinybird.co
2 ポイント·投稿者 enether·5 か月前·0 コメント

Why Not?

wesmckinney.com
4 ポイント·投稿者 enether·5 か月前·0 コメント

Small Kafka: Tansu and SQLite on a Free T3.micro (AWS Free Tier)

blog.tansu.io
2 ポイント·投稿者 enether·6 か月前·0 コメント

When to Use a Columnar Database

tinybird.co
2 ポイント·投稿者 enether·6 か月前·1 コメント

Kafka is Topping Out (as a business)

bigdata.2minutestreaming.com
2 ポイント·投稿者 enether·8 か月前·0 コメント

No one will tell you the real cost of Kafka (2024)

blog.2minutestreaming.com
2 ポイント·投稿者 enether·8 か月前·0 コメント

Kafka is Fast – I'll use Postgres

topicpartition.io
561 ポイント·投稿者 enether·9 か月前·401 コメント

Confluent Explores Sale

reuters.com
1 ポイント·投稿者 enether·9 か月前·0 コメント

Sonnet 4.5 ranks #25 (below other Claude models) in generating SQL

tinybird.co
2 ポイント·投稿者 enether·9 か月前·1 コメント

[untitled]

1 ポイント·投稿者 enether·10 か月前·0 コメント

Why was Apache Kafka created?

bigdata.2minutestreaming.com
201 ポイント·投稿者 enether·11 か月前·221 コメント

コメント

enether
·先月·議論
The permission thing is a killer to productivity, if you're running Claude I think it's more efficient to just run in a disposable sandbox (like exe.dev[1]) or in some form of docker container with permissions you're personally ok taking the risk with on a personal machine[2]

[1] - https://exe.dev/ is a new cloud provider with some very useful agent UX [2] - I built https://github.com/stanislavkozlovski/dclaude/ for this; not perfect but gets my job done on the rare occassion I need to run the coding agent locally
enether
·2 か月前·議論
I have to say, it works pretty good. I tested it by creating a Kafka cluster here: https://x.com/kozlovski/status/2050943790580457646

In <15 minutes it got everything up and running - the Kafka brokers, the Kafka controllers, schema registry, Grafana. Pretty impressive
enether
·2 か月前·議論
are there really no other maintenance tools that do this already? seems like a low hanging fruit?
enether
·3 か月前·議論
the irony of using Claude to create this lol
enether
·3 か月前·議論
Yeah, which is why this Ursa-for-Kafka (UFK) fork can be a drop-in replacement. It holds both the classic Kafka topics with disks, and the Ursa engine topics that have higher latency.

I agree with your assessment re: latency. I've been very vocal about this ever since this type of architecture came out.
enether
·3 か月前·議論
It could also be that the world as a whole cares less about privacy today than they did seven years ago. Without a relative measurement from a similar platform, it's a bit of an empty statement

One thing that has certainly changed is that algorithms have become more aggressive. If your content isn't performing well, it gets hidden much faster and more aggressively than before. This makes sense when you consider it from the PoV of the platforms (they have much more content to choose from)
enether
·3 か月前·議論
A very in-depth tool that acts as a easily browse-able reference to many Apache Kafka internals like configuration options, error types, the wire format (by version), config advice and version upgrade diffs.
enether
·3 か月前·議論
They make $8-9B a year (~90% profit margins) selling software to mainframes, which were deployed ages ago but still have to be maintained because critical COBOL business code was written on their systems - and migration is too riskly/costly.

To give you an idea:

- of the risk in regulated industries like banking: a UK bank was once fined *$62 million* for botching a mainframe migration and causing downtime. - of the difficulty and risk in non-tech industries: Australia once spent *$120 million* trying to migrate its social security system off mainframes... and failed.

Mainframes are not their only business, of course, but it's a major cash cow that's under appreciated. I, for one, didn't know that business keeps growing.

Coincidentally, I wrote about the topic of mainframes with relation to IBM's acquisition of Confluent here today: https://blog.2minutestreaming.com/p/ibm-confluent-acquisitio...
enether
·5 か月前·議論
exactly. i posted about the same thing today https://x.com/twitter/status/2025949280251597291

It's an accelerant, both good and bad. How that plays out in companies where the majority are below-average is a nuanced and concerning case
enether
·5 か月前·議論
I think it's worth it to build your own miniaturized versions of OpenClaw/claw-like agents. It's easy enough to build and the confidence of it being in a language you're familiar with, small enough surface area to limit risk, etc. seems worth it imo
enether
·5 か月前·議論
In a way I think handing off digital tasks to an AI bot that does it behind the scenes IS reducing technology in your life.

But has to be done carefully to not increase the scope of things being done
enether
·5 か月前·議論
we will need some sort of payment-block checkmark for use of social media soon enough. This claw phenomenon is opening the floodgates of spam even more than before
enether
·5 か月前·議論
Mm, not at all. The usual LLM doesn't have its own file system, browser, persistent memory of all actions, etc. The usual LLM experience is you open chatgpt.com and have a singular chat session.
enether
·5 か月前·議論
> I built this because running Kafka locally for development is painful — gigabytes of RAM, slow startup, ZooKeeper/KRaft configuration. I just wanted something that accepts produce requests and gets out of the way.

This is not true. Kafka's latest `-native` images are very fast to start up (~100ms) and use relatively little memory.

https://cwiki.apache.org/confluence/display/KAFKA/KIP-974%3A...
enether
·5 か月前·議論
Would be cool to release the (miniscule amount of) code for this, and maybe have people standardize around a library for it.
enether
·5 か月前·議論
Has anyone actually built event-driven agents yet? Or any agents, outside some basic dev workflows? (PR review, etc)
enether
·5 か月前·議論
+1 from an European, it's beyond obvious and I don't understand why people are letting {politics, mainstream media painting of X} shape their belief on these extremely pressing and important issues.
enether
·6 か月前·議論
Peter (the author) is a really, really cool guy. We recorded a 3hr 30m podcast[0] with him a month ago. For anyone interested in the Kafka space, performance optimization in Rust and the general "why yet another Kafka", I'd shamelessly recommend the video:

[0] - https://www.youtube.com/watch?v=pJQ7hcsI1Dw
enether
·6 か月前·議論
to be fair, Kafka now has a GraalVM docker image[0][1] which was made for local dev/testing, and it has caught up fairly well to these alternatives re: memory and startup time

[0] - https://cwiki.apache.org/confluence/display/KAFKA/KIP-974%3A... [1] - https://hub.docker.com/r/apache/kafka-native
enether
·6 か月前·議論
+1.

Bluesky is a left-leaning political mess - I strictly follow tech-only accounts yet get posts on the timeline about what this week's monstrous White House act was. This is not a judgement against the left, but rather against Bluesky.

As another example - the Bitcoin/cypherpunk community went to Nostr. Nostr today is the same slop as Bitcoin Twitter was before. It has a tiny bit more of an organic feel to it - but it basically spiralled to the same cookie-cutter attention-grabbing content. Things like mindless cat videos.

X as we know is already problematic.

Basically the current state is that all platforms suck