civvv · HackerTrans

vor 26 Tagendiscuss

Yeah, I host three small-scale game servers for an indie-game, all out of pocket. 50-80 players hop on every day and the community is super nice. Its been possible because the price has been €16 per instance, but with these new prices, it will absolutely not be possible anymore. I imagine a lot of small game server communities will meet the same fate now, since Hetzner has been the go-to for this kind of stuff.

civvv

vor 2 Monatendiscuss

>Or as Jean Baudrillard has said:

It is nothing short of profoundly ironic to quote Jean Baudrillard in this context.

civvv

vor 2 Monatendiscuss

Yarvin is a basement dweller and 4chan intellectual, high on his own supply of pseudo-intellectual takes. What is sad and worrying is that these kinds of politics are increasingly moving out of the fringe internet and into pockets of power (eg. Thiel and Vance). It is problematic that these ideas now linger only one or two steps away from the most powerful and influential person in the world.

civvv

vor 2 Monatendiscuss

There are many indications that model progress is slowing down, so that is not entirely accurate.

civvv

vor 2 Monatendiscuss

Three of my favourite game series as a kid, what a legend.

civvv

vor 2 Monatendiscuss

Not sure about their other departments, but at least in March there was no LLM coding in their Source2 & game teams.

https://x.com/ZPostFacto/status/2035784300575305895

civvv

vor 3 Monatendiscuss

I am no insider and have never even tried to build an LLM, so I can only guess. But the general sentiment seems to be that this is the case. If you are interested, I would recommend you read the MIT paper "Superposition Yields Robust Neural Scaling" [0]. It confirms an interesting trend: models represent more features/concepts than they have clean independent dimensions, so features overlap. Increasing model dimension reduces this geometric interference, which lowers loss in a predictable way, but with diminishing returns.

This has, in my opinion, likely been the primary vector in getting better models thus far, but MIT mathematically proves that it yields diminishing returns for each new dimension added. It will get more and more expensive and the cost-return will or probably already has made it infeasible.

Ilya appear to support sentiment this as well. [1]

[0] - https://openreview.net/forum?id=knPz7gtjPW [1] - https://www.businessinsider.com/openai-cofounder-ilya-sutske...

civvv

vor 3 Monatendiscuss

This is likely true. I think model quality has stagnated and that its likely a non-trivial task to find a new improvement vector. Scaling the width of the model (which has been the driving force behind the speed of improvement thus far) seems to have reached its limit.

It will be interesting to see the implications of this. Tooling can only do so much in the long term.

civvv

vor 3 Monatendiscuss

Do you understand how LLM's work and that they are always behind in their knowledge? Unless Claude does a network call to check its own website, it will give you outdated information. Its a prediction model, its not magic.

civvv

vor 3 Monatendiscuss

If you scroll down, you can clearly see that the Pro plan has an "x" on Claude Code now.

civvv

vor 3 Monatendiscuss

Does this mean that for enterprises using per-seat pricing, only the $100 premium seat gets access to claude code?

civvv

vor 3 Monatendiscuss

You’re generalizing too much here. One of the biggest problems with LLM’s today is in-fact that they are not at the level being advertised. This is not solely a case of regulation standing in the way of a «revolution».

civvv

vor 3 Monatendiscuss

Literally a skill issue?

civvv

vor 4 Monatendiscuss

This one was pretty fun. Had zero expectations, but left pleasantly surprised.

https://opper.ai/ai-roundtable/questions/94e19d86-cc0

civvv

vor 4 Monatendiscuss

Fun little toy, tried to ask it some post-modern philosophy questions and they all mostly agreed with the statements of the philosopher, until the debate where Opus 4.6 managed to change their opinion to a resounding "maybe", pretty much every single time. It seems like the "better" frontier models often take a more grounded stance from the beginning, and even manage to influence the other models.

Here is an example: https://opper.ai/ai-roundtable/questions/79e6cdd4-515

Another fun debate: https://opper.ai/ai-roundtable/questions/81ee56e9-60f

civvv

vor 4 Monatendiscuss

That entirely depends on what you are buying. If you’re in need of a lawyer to keep you out of the bottom bunk, I’d happily spend a lot more for a little better.

civvv

vor 4 Monatendiscuss

Go touch some grass, please

civvv

vor 4 Monatendiscuss

You do a year worth of work in 3.65 days? These multipliers are getting pretty laughable

civvv

vor 4 Monatendiscuss

I think you are right in that the primary mechanisms remain the same, or at least similar, but that was not my point anyways. The surrounding adjectives describe more the context of which capitalism exists within.

The effects and consequences of capitalism under feudalism or the age of slavery is, for example, fundamentally different from capitalism under a freer modern democracy. A slave or serf did not have the opportunities of capitalism, which changes how the system behaves and its effects.

The term "capitalism" becomes kind of meaningless, because it just describes a broad set of mechanisms. In the case of the question in this thread it is much more descriptive to include the context of which it exists within.

civvv

vor 4 Monatendiscuss

The RAG models are very competent at programming. I am worried about my job as a SWE in the near future, but didn't the MIT paper about a week ago pretty much confirm that width-scaling the model is about to (or has already) stopped giving any measurable increase in quality because the training data no longer overfills the model?

Any authentic training data from pre-LLM's is assumed to have been used in training already and synthetic or generated data gives worse performing models, so the path of increasing its training data seems to be a dead end as well?

What is the next vector of training? Maybe data curation? Remove the low quality entries and accept a smaller, but more accurate data set?

I think the AI companies are starting to sweat a little, considering the promises they have made, their inability to deliver and turn a profit at its current state and the slowing improvements.

Interesting times! We are either all out of jobs or a massive market crash is imminent, awesome...

comments