HackerTrans
TopNewTrendsCommentsPastAskShowJobs

enether

no profile record

Submissions

Nobody Understands Kafka Costs

getkafkanated.substack.com
1 points·by enether·2 месяца назад·0 comments

Bufstream Sold to CoreWeave

buf.build
3 points·by enether·2 месяца назад·0 comments

Profile guided compiler optimization leads to 47% lower p99.9 in Redpanda

redpanda.com
2 points·by enether·2 месяца назад·0 comments

Ursa – a new Iceberg-first storage engine for Kafka

topicpartition.io
3 points·by enether·3 месяца назад·2 comments

Kafka Options Explorer

kafka-options-explorer.conduktor.io
1 points·by enether·3 месяца назад·1 comments

[untitled]

1 points·by enether·4 месяца назад·0 comments

How KIP-881 and KIP-392 Reduce Inter-AZ Networking Costs in Classic Kafka

getkafkanated.substack.com
1 points·by enether·5 месяцев назад·0 comments

Nobody Ever Got Fired for Buying Confluent

tinybird.co
2 points·by enether·5 месяцев назад·0 comments

Why Not?

wesmckinney.com
4 points·by enether·5 месяцев назад·0 comments

Small Kafka: Tansu and SQLite on a Free T3.micro (AWS Free Tier)

blog.tansu.io
2 points·by enether·6 месяцев назад·0 comments

When to Use a Columnar Database

tinybird.co
2 points·by enether·6 месяцев назад·1 comments

Kafka is Topping Out (as a business)

bigdata.2minutestreaming.com
2 points·by enether·8 месяцев назад·0 comments

No one will tell you the real cost of Kafka (2024)

blog.2minutestreaming.com
2 points·by enether·8 месяцев назад·0 comments

Kafka is Fast – I'll use Postgres

topicpartition.io
561 points·by enether·8 месяцев назад·401 comments

Confluent Explores Sale

reuters.com
1 points·by enether·9 месяцев назад·0 comments

Sonnet 4.5 ranks #25 (below other Claude models) in generating SQL

tinybird.co
2 points·by enether·9 месяцев назад·1 comments

[untitled]

1 points·by enether·10 месяцев назад·0 comments

Why was Apache Kafka created?

bigdata.2minutestreaming.com
201 points·by enether·11 месяцев назад·221 comments

comments

enether
·в прошлом месяце·discuss
The permission thing is a killer to productivity, if you're running Claude I think it's more efficient to just run in a disposable sandbox (like exe.dev[1]) or in some form of docker container with permissions you're personally ok taking the risk with on a personal machine[2]

[1] - https://exe.dev/ is a new cloud provider with some very useful agent UX [2] - I built https://github.com/stanislavkozlovski/dclaude/ for this; not perfect but gets my job done on the rare occassion I need to run the coding agent locally
enether
·2 месяца назад·discuss
I have to say, it works pretty good. I tested it by creating a Kafka cluster here: https://x.com/kozlovski/status/2050943790580457646

In <15 minutes it got everything up and running - the Kafka brokers, the Kafka controllers, schema registry, Grafana. Pretty impressive
enether
·2 месяца назад·discuss
are there really no other maintenance tools that do this already? seems like a low hanging fruit?
enether
·3 месяца назад·discuss
the irony of using Claude to create this lol
enether
·3 месяца назад·discuss
Yeah, which is why this Ursa-for-Kafka (UFK) fork can be a drop-in replacement. It holds both the classic Kafka topics with disks, and the Ursa engine topics that have higher latency.

I agree with your assessment re: latency. I've been very vocal about this ever since this type of architecture came out.
enether
·3 месяца назад·discuss
It could also be that the world as a whole cares less about privacy today than they did seven years ago. Without a relative measurement from a similar platform, it's a bit of an empty statement

One thing that has certainly changed is that algorithms have become more aggressive. If your content isn't performing well, it gets hidden much faster and more aggressively than before. This makes sense when you consider it from the PoV of the platforms (they have much more content to choose from)
enether
·3 месяца назад·discuss
A very in-depth tool that acts as a easily browse-able reference to many Apache Kafka internals like configuration options, error types, the wire format (by version), config advice and version upgrade diffs.
enether
·3 месяца назад·discuss
They make $8-9B a year (~90% profit margins) selling software to mainframes, which were deployed ages ago but still have to be maintained because critical COBOL business code was written on their systems - and migration is too riskly/costly.

To give you an idea:

- of the risk in regulated industries like banking: a UK bank was once fined *$62 million* for botching a mainframe migration and causing downtime. - of the difficulty and risk in non-tech industries: Australia once spent *$120 million* trying to migrate its social security system off mainframes... and failed.

Mainframes are not their only business, of course, but it's a major cash cow that's under appreciated. I, for one, didn't know that business keeps growing.

Coincidentally, I wrote about the topic of mainframes with relation to IBM's acquisition of Confluent here today: https://blog.2minutestreaming.com/p/ibm-confluent-acquisitio...
enether
·5 месяцев назад·discuss
exactly. i posted about the same thing today https://x.com/twitter/status/2025949280251597291

It's an accelerant, both good and bad. How that plays out in companies where the majority are below-average is a nuanced and concerning case
enether
·5 месяцев назад·discuss
I think it's worth it to build your own miniaturized versions of OpenClaw/claw-like agents. It's easy enough to build and the confidence of it being in a language you're familiar with, small enough surface area to limit risk, etc. seems worth it imo
enether
·5 месяцев назад·discuss
In a way I think handing off digital tasks to an AI bot that does it behind the scenes IS reducing technology in your life.

But has to be done carefully to not increase the scope of things being done
enether
·5 месяцев назад·discuss
we will need some sort of payment-block checkmark for use of social media soon enough. This claw phenomenon is opening the floodgates of spam even more than before
enether
·5 месяцев назад·discuss
Mm, not at all. The usual LLM doesn't have its own file system, browser, persistent memory of all actions, etc. The usual LLM experience is you open chatgpt.com and have a singular chat session.
enether
·5 месяцев назад·discuss
> I built this because running Kafka locally for development is painful — gigabytes of RAM, slow startup, ZooKeeper/KRaft configuration. I just wanted something that accepts produce requests and gets out of the way.

This is not true. Kafka's latest `-native` images are very fast to start up (~100ms) and use relatively little memory.

https://cwiki.apache.org/confluence/display/KAFKA/KIP-974%3A...
enether
·5 месяцев назад·discuss
Would be cool to release the (miniscule amount of) code for this, and maybe have people standardize around a library for it.
enether
·5 месяцев назад·discuss
Has anyone actually built event-driven agents yet? Or any agents, outside some basic dev workflows? (PR review, etc)
enether
·5 месяцев назад·discuss
+1 from an European, it's beyond obvious and I don't understand why people are letting {politics, mainstream media painting of X} shape their belief on these extremely pressing and important issues.
enether
·6 месяцев назад·discuss
Peter (the author) is a really, really cool guy. We recorded a 3hr 30m podcast[0] with him a month ago. For anyone interested in the Kafka space, performance optimization in Rust and the general "why yet another Kafka", I'd shamelessly recommend the video:

[0] - https://www.youtube.com/watch?v=pJQ7hcsI1Dw
enether
·6 месяцев назад·discuss
to be fair, Kafka now has a GraalVM docker image[0][1] which was made for local dev/testing, and it has caught up fairly well to these alternatives re: memory and startup time

[0] - https://cwiki.apache.org/confluence/display/KAFKA/KIP-974%3A... [1] - https://hub.docker.com/r/apache/kafka-native
enether
·6 месяцев назад·discuss
+1.

Bluesky is a left-leaning political mess - I strictly follow tech-only accounts yet get posts on the timeline about what this week's monstrous White House act was. This is not a judgement against the left, but rather against Bluesky.

As another example - the Bitcoin/cypherpunk community went to Nostr. Nostr today is the same slop as Bitcoin Twitter was before. It has a tiny bit more of an organic feel to it - but it basically spiralled to the same cookie-cutter attention-grabbing content. Things like mindless cat videos.

X as we know is already problematic.

Basically the current state is that all platforms suck