HackerTrans
TopNewTrendsCommentsPastAskShowJobs

sudhirb

no profile record

Submissions

CTO bench: an online LLM coding benchmark

cto.new
3 points·by sudhirb·há 7 meses·0 comments

comments

sudhirb
·há 4 meses·discuss
Is this not the good kind of problem to have? Subnautica 2 is doing so well that the developers get their earn-out bonus?

Seems like pure profit-maximizing/greed!
sudhirb
·há 4 meses·discuss
I can hardly believe my eyes! I helped do some related research specifically concerning thin-film drainage from tubes, way back in my undergraduate days: https://doi.org/10.1016/j.expthermflusci.2018.04.015
sudhirb
·há 5 meses·discuss
a 90% saving is huge isn't it?

for long agent sessions, I would expect a very high cache hit rate unless you're editing the system prompt, tools, or history between turns, or some turns take longer than the cache timeout
sudhirb
·há 5 meses·discuss
So long as perceived LLM skill is still "spiky" - e.g. within a domain, still showing relatively high variation in ability (often depending on the task or user, to be fair), people will continue to dismiss it
sudhirb
·há 5 meses·discuss
In the general case I think this is a great idea - if we do a good job of documenting intent etc. in commit messages, agents have an easier time understanding why lines of code exist with no additional specs/mechanisms/etc.

Interested to see what techniques in this area pull ahead and gain traction!
sudhirb
·há 6 meses·discuss
Coding agents are such a congested space right now that to me this mostly reads as an advertisement.
sudhirb
·há 6 meses·discuss
I have 150Mb/s FTTP for £37/month - upgrading to gigabit would be £75/month, for example!
sudhirb
·há 6 meses·discuss
Interesting that non-salty water didn't make the string conductive(?) enough - I'd have thought that there might have been enough soluble stuff in string.

Also I believe this person runs the ISP I use (and I couldn't speak more highly of it - Andrews & Arnold).
sudhirb
·há 6 meses·discuss
For me, a lot of the draw is that it's cheaper than managed db services for small/toy projects of mine (that I don't want to use dynamo db for) - that and in a previous job it was useful as relatively temporary multi-tenant storage.
sudhirb
·há 7 meses·discuss
The partner for these projects has a benchmark that the top frontier LLM labs seem to be running on their new model releases - I think there's _some_ value to these numbers in helping people compare and contrast model performance.

https://andonlabs.com/evals/vending-bench
sudhirb
·há 9 meses·discuss
I think that "manipulate people for financial and political gain" is an outcome of what social media companies actually do - I was under the belief that in a general sense, they want to maximise the time people spend on their apps so that they can sell this attention to advertisers, independent of whether or not a given ad buyer wants to manipulate people.
sudhirb
·há 9 meses·discuss
Some mild whataboutery: is the purpose of a cancer ward to fail to cure a large fraction of its patients[0]?

https://www.astralcodexten.com/p/come-on-obviously-the-purpo...
sudhirb
·há 10 meses·discuss
Both miracles are illness-recovery related and feel to me quite like regression to the mean, but I can imagine this is somewhat of a strategic move from the Catholic church to bring some relatability into things.
sudhirb
·há 10 meses·discuss
For me, the USP Warp used to have was generating shell commands from prompts inside the terminal - but Cursor has had this in its embedded terminal for a while now so increasingly I find myself using Ghostty instead
sudhirb
·há 12 meses·discuss
I've had an ancient Parker 51 for a good decade or so now which I use almost daily, that originally belonged to my great-grandmother.

I'd expect there to be a reasonable amount of variation in how long these pens last due to differences in usage, machining tolerances, ink types and materials - though mine has done very well considering how many times I've chucked it into a bag, dropped it on hard floors, etc. (I've probably just been lucky so far).
sudhirb
·há 12 meses·discuss
I think the budget play is to get a cheap refillable fountain pen and some cheap fountain pen ink (I bought some Diamine bottled ink about 10 years ago and I've still got plenty left).

More expensive fountain pens are indeed luxury products - replicas are often available on places like aliexpress.

I think it probably feels like bullshit if you don't think you'll gain any satisfaction or derive any pleasure from the act of writing or the aesthetics of your writing instrument.