HackerTrans
TopNewTrendsCommentsPastAskShowJobs

pseudony

no profile record

Submissions

Ask HN: How do you evaluate a LLM these days?

1 points·by pseudony·6 месяцев назад·0 comments

comments

pseudony
·10 дней назад·discuss
Someone or thing to help with chores would be great.

But abject exploitation? Sex slave, even? I should hope we can find a little decency within ourselves..
pseudony
·10 дней назад·discuss
Well India has a diverse set of languages spread across its regions. As I understand it, the degree to which English thrives there is largely because choosing any other administrative language would be seen as oppressive to the other languages. Again, only stuff I picked up from the various Indian colleagues I have had.

Point being; I don’t think that is any different really from Europe. If they can manage, so can we.
pseudony
·12 дней назад·discuss
“ a race condition that occurred only under specific conditions — in the hyper library”
pseudony
·12 дней назад·discuss
So “fearless concurrency” still only happens when one just decides to not be afraid… :)
pseudony
·14 дней назад·discuss
So the pennies on the dollar that Ireland gets by being the taxhole of the Eu will subsidize the arts.?

:)
pseudony
·14 дней назад·discuss
You are being very hostile and cherry-picking results- disregarding and denigrating those that don’t fit your narrative.

Wrt Linus - who knows? It is irrelevant; he is largely irrelevant. If he got ran over by a bus, the collective community (of whom quite a few are outside the US) will carry on.
pseudony
·16 дней назад·discuss
I don’t think many outside the US are actively hoping to be governed by Sam, Dario and Elon.
pseudony
·16 дней назад·discuss
As a third party I would rather be happy about the way Chinese labs are acting in the here and now while US labs first masquerade as a public good, then turn around, bail on all promises of open AI, turn into a corporation and attempt to own the world while its runner-up is trying to scaremonger people into buying their product.

I know most Americans are fed a steady diet of “evil China” and China MAY have issues. But on the AI front they are heaps better. Even if everything got closed tomorrow, we have a plethora of good models we can inspect and tweak while from the US labs we have… a single old 120b model ?

And with the way the US is treating its allies, maybe a bunch of us are quite content with a more even match rather than US hegemony.
pseudony
·16 дней назад·discuss
Seems like a bad idea to actively diverge from Lua, hostile even, especially without at least a clear change of name.
pseudony
·27 дней назад·discuss
Course not :)

I use pi (pi.dev).

I suspect some of the issue id that some harnesses are over-optimized for particular models and their preferences (tool calling, instructions to soften their deficiencies etc).

Pi is much more minimalist - probably a fairer point of comparison.

A different suspicion of mine is that some people over-specialize in a given model - or maybe become lazy with their prompts or suffer from skill issues.

Fwiw - I generally maintain a specs/ folder as I code.

I never use “plan” mode - I just tell the LLM to make no code changes, but discuss design with me.

At some point I am happy (I typically ask it to summarize and write the actual spec), I review; correct misunderstandings, ask for follow-up questions, we incorporate the additional details into the spec and move on.

I often have TODO’s/tasks in those specs too and I regularly update progress on them. It also happens that I ask the LLM to review my code (actual) against the spec and search for differences- we then resolve them. Sometimes by modifying the code; sometimes by modifying the spec.

For starters, I write an overview spec - nail down the big concepts and architectural choices at a high level. Moderately complicated facets of the application get their own spec - we write these as and when it gets relevant.

I think it helps the model a lot because I can refer to specs I feel relevant in drafting new specs or when solving tasks. And LLMs are generally better at proactively consulting these specs when getting an overview of the application and its design ahead of implementation.
pseudony
·27 дней назад·discuss
You seem to forget that there is a rather large world outside of the US - and we very much would be better off with non-gated, open weights models.
pseudony
·27 дней назад·discuss
And what do you base this on ?

How does one objectively quantify how it stacks upnto another model ?

Or even, what is your subjective evaluation based on ?

I really wonder - because I have just finished a fully vibe-coded gtk/rust/lua application with me basically writing 7% of the code (all in one module) and GLM 5.1 writing the rest. We haven’t had regressions, confusion or anything else. And I am pretty damned sure I couldn’t manage this one year ago with claude code and Sonnet.
pseudony
·28 дней назад·discuss
You don’t need a fancy kill switch, just stop sending parts and updates, any sustained conflict will do the work.

Any F35 bought by Europe is nothing short of lunacy. You don’t buy from people hell-bent on having conflicts with you.
pseudony
·в прошлом месяце·discuss
Congratulations :)

As a Dane, I would say yes. Especially among boomers there was always a genuine appreciation of the US and its role as guardian of a rules-based international order and western civilization more generally.

I think that sentiment has gone, even as younger generations have increasingly incorporated English words, music, TV and more into their own, but you seldom hear the same genuine trust in the US as a force for good.
pseudony
·в прошлом месяце·discuss
Yes, it is all a conspiracy.

Or. Have you considered that the erstwhile closest military ally of the US increasingly diversifying AWAY from US programs actually is pretty noteworthy. You have had canadians boycotting US products, cancel trips to the US, their PM encouraging elbows up attitude and delivering a pretty noteworthy speech in Davos about charting a course for middle powers and you think it’s business as usual?
pseudony
·2 месяца назад·discuss
Wrong - I am very far from a catholic, but this just doesn’t reflect history.

They did a lot to make the middle ages more tolerable. After that, maybe they overstayed their welcome.
pseudony
·2 месяца назад·discuss
He didn’t say that. He said that he agrees with the pope on this issue. You don’t become a catholic from agreeing on an issue
pseudony
·3 месяца назад·discuss
Sure — we can play that game. Worked for a state org in an EU country too.

I disagree, I note that multiple countries have digital ministries drafting plans to drop Microsoft products or to begin a wholesale migration due to sovereignty and security.

Once something becomes policy at the highest levels, the individual orgs will have to follow, even if slowly.

I really think you are grossly misreading the last 12 months or so. There is a big difference between a municipality migration as a cost-saving move and the very state saying declaring a national security threat from foreign-based vendors.
pseudony
·3 месяца назад·discuss
Definitely. And then one could start wondering if the direction might reverse.
pseudony
·5 месяцев назад·discuss
Look at what he does now, you honestly think a person this greedy would ever exercise less than maximum control?