HackerTrans
TopNewTrendsCommentsPastAskShowJobs

int3trap

27 karmajoined 9 bulan yang lalu

comments

int3trap
·kemarin·discuss
5.6 SOL is basically useless, even on fast mode. It takes so long to do anything that it would be faster to do yourself. And it burns usage so quickly it's genuinely not worth it.
int3trap
·21 hari yang lalu·discuss
No. Customers will pay more across all markets.
int3trap
·29 hari yang lalu·discuss
The article does not say that. The author doesn't take the text the other person dumped into ChatGPT and evaluate its quality. That is what OP is referring to.
int3trap
·30 hari yang lalu·discuss
1. People don't like medium, rightly so.

2. The content is lower quality.
int3trap
·bulan lalu·discuss
Got a link to your project? I'm working on something that could make use of something like this.
int3trap
·3 bulan yang lalu·discuss
> regardless of what the contract or the law says

That is not really established. The Anthropic issue was specifically about DoD use and Anthropic's military use restrictions. What the Trump admin did was bad and coercive but its not proof that contract terms and law are irrelevant. For instance, why not just use eminent domain if they don't care about contracts and want whatever they want?

> either they were signing up for a supply-chain risk designation and whatever other punishments the Trump administration dreams up, or they're complying

Couldn't OpenAI have negotiated different terms, accepted a narrower scope, or drawn different red lines? Their public DoD terms still exclude things like mass domestic surveillance and autonomous weapons outside human control. Do you not believe that or believe it doesn't matter at all? Either of those is problematic to the conclusions that follow from them.

I also think the whole argument implies something about Anthropic's position that's not as clean in reality. NSA is already using Mythos despite the Pentagon dispute, and Anthropic is still talking to the administration. Trump even said they were "shaping up" recently.

Isn't it also a possibility that one company negotiated poorly and took a position of perceived moral authority that Trump et al threw a hissy fit over and over reacted to? That's happened countless times with this admin and is far more likely in my opinion given Anthropic hasn't cut all ties and continues to try and work out a contract.

I wholeheartedly agree the current administration is dangerous. I just don't think the conclusion "OpenAI must be complying with the same demands Anthropic refused" follows from what we've seen. And I think there are plenty of other far more plausible conclusions to draw from the events.
int3trap
·3 bulan yang lalu·discuss
Honestly I find comments like yours much more eerie. By all accounts they never agreed to any of that but you say it with such confidence like it's a fact.
int3trap
·4 bulan yang lalu·discuss
Not using a computer eventually meant failing to use the basic medium of modern work. Not using an LLM does not yet imply the same thing.
int3trap
·5 bulan yang lalu·discuss
> So it's possible to have a pipelined connection stash away a continuation for a response calculation and be woken up later on when it's ready.

Ahh, that's interesting. I think you still run into the issue where you have a case like this:

1. You get 10 pipelined requests from a single connection with a post body to update some record in a Postgres table.

2. All 10 requests are independent and can be resolved at the same time, so you should make use of Postgres pipelining and send them all as you receive them.

3. When finishing the requests, you likely need the information provided in the request object. Lets assume it's a lot of data in the body, to the point where you've reached you per connection buffer limit. You either allocate here to unblock the read, or you block new reads, impacting response latency, until all requests are completed. The allocation is the better choice at that point but that heuristic decision engine with the goal of peak performance is definitely nuanced, if not complicated.

Its a cool problem space though, so always interested in learning how others attack it.
int3trap
·5 bulan yang lalu·discuss
> In the steady state, a webserver would have almost no garbage collector activity

I recently wrote my own zero allocation HTTP server and while the above statement is possible to achieve, at some point you need to make a decision on how you handle pipelined requests that aren't resolved synchronously. Depending on your appetite for memory consumption per connection, this often leads to allocations in the general case, though custom memory pools can alleviate some of the burden.

I didn't see anything in the article about that case specifically, which would of been interesting to hear given it's one of the challenges I've faced.
int3trap
·6 bulan yang lalu·discuss
Why don't you just not use LLM's if it sucks the joy out of the process for you?
int3trap
·6 bulan yang lalu·discuss
You can't say they are "in no way" commercially successful when they have around one BILLION monthly users. That's just disingenuous.
int3trap
·7 bulan yang lalu·discuss
Yeah... no it's not.
int3trap
·8 bulan yang lalu·discuss
> Wrong, it makes good designs easy to write

It encourages good designs but it does not make them easy to write, but that's somewhat the point. Its not trivial to design a safe API that pushes performance limits.

> just write a lockless triple buffer for efficient memory sharing and wrap the unsafe usage of pointers with a safe API

This isn't practical or pragmatic.

And I say this as someone who likes rust and develops in it every day.
int3trap
·8 bulan yang lalu·discuss
This is top tier. Well written and insanely detailed.
int3trap
·9 bulan yang lalu·discuss
> Here's where SierraDB diverges from traditional distributed databases: reads don't require quorum.

Would we say this is divergent? Cassandra, DynamoDB, and many others allow you to specify the consistency of reads at the request level.

> Here's where SierraDB diverges from traditional distributed databases: reads don't require quorum. Instead, each event stores a confirmation count in its metadata. When a write achieves quorum, a background process broadcasts this confirmation to all replicas, updating their local confirmation counts. This means any single node can serve consistent reads without network round-trips - a massive performance win.

I have no context outside of this blog post, but this seems actually divergent from the typical definition of consistency given its not linearizable. What systems benefit most from this low latency stale-but-ordered consistency guarantee?
int3trap
·9 bulan yang lalu·discuss
There's been a massive talent exodus, especially among the principal and senior principal engineering roles, across all Amazon orgs since the RTO policies have been enforced. Its demoralizing to lose key engineers that you look up to and want to continue to learn from all because a few people far removed from the day to day make a bad call.

RTO in combination with Amazon being last place in AI innovation have led to departures of anyone that can leave, leaving.