Flashtoo · HackerTrans

26 gün öncediscuss

One I've started noticing is the "quotation marks around a phrase awkwardly trying to bundle a concept" thing. Like all LLM cliches it's something that has been used in writing for a long time, but I've seen it so much more recently. I think lots of people have picked this up from seeing LLMs use it. But like you said, who knows.

Flashtoo

26 gün öncediscuss

> It's literally the free market at work--it's really simple, if you don't believe in whatever he says, don't speculate!

This, too, is actually addressed in the article - the whole point is that you're being forced to participate/speculate through this rapid inclusion in indices and mutual funds, because he's had the indices change the rules for him. So no, it's not that simple.

Flashtoo

2 ay öncediscuss

Same, but recently I discussed the LLM flood on Reddit with some friends IRL and they were surprised I had left Reddit, as they simply hadn't noticed significant bot activity. Mind you, these are very AI-aware people. I have little hope that normies will catch on and actually mind enough to leave.

Flashtoo

3 ay öncediscuss

There is a danger in chronic abuse resulting in upregulation. Mixing the two at once is no problem for the liver, which is also why patient information leaflets for paracetamol do not contain a warning to avoid alcohol, only about chronic alcohol abuse.

Your crappy source is vague in what consumption pattern constitutes a risk and actually cites a better source that supports the idea that acute alcohol consumption reduces paracetamol toxicity. https://www.biorxiv.org/content/10.1101/2020.07.07.191916v1....

That's a mathematical model, but this relationship between the two is what I was taught in medical school and it is still supported by the science. There's plenty of other sources, I just picked that one because your article cites it. Just search for "paracetamol ethanol" on Google Scholar.

Flashtoo

3 ay öncediscuss

This is correct.

Flashtoo

3 ay öncediscuss

These are good practices to keep in mind when setting up GenAI solutions, but I'm not convinced that this part of the job will allow "data scientist" as a profession to thrive. Here's my pessimistic take.

Data scientists were appreciated largely because of their ability to create models that unlock business value. Model creation was a dark magic that you needed strong mathematical skills to perform - or at least that's the image, even if in reality you just slap XGBoost on a problem and call it a day. Data scientists were enablers and value creators.

With GenAI, value creation is apparently done by the LLM provider and whoever in your company calls the API, which could really be any engineering team. Coaxing the right behavior out of the LLM is a bit of black magic in itself, but it's not something that requires deep mathematical knowledge. Knowing how gradients are calculated in a decoder-only transformer doesn't really help you make the LLM follow instructions. In fact, all your business stakeholders are constantly prompting chatbots themselves, so even if you provide some expertise here they will just see you as someone doing the same thing they do when they summarize an email.

So that leaves the part the OP discusses: evaluation and monitoring. These are not sexy tasks and from the point of view of business stakeholders they are not the primary value add. In fact, they are barriers that get in the way of taking the POC someone slapped together in Copilot (it works!) and putting that solution in production. It's not even strictly necessary if you just want to move fast and break things. Appreciation for this kind of work is most present in large risk-averse companies, but even there it can be tricky to convince management that this is a job that needs to be done by a highly paid statistician with a graduate degree.

What's the way forward? Convince management that people with the job title "data scientist" should be allowed to gatekeep building LLM solutions? Maybe I'm overestimating how good the average AI-aware software engineer is at this stuff, but I don't see the professional moat.

Flashtoo

3 ay öncediscuss

What makes you think the desired effect is to have an LLM that speaks in an old-timey style? The training process is the whole point.

Flashtoo

4 ay öncediscuss

> Prompts with more than 272K input tokens are priced at 2x input and 1.5x output for the full session for standard, batch, and flex.

Flashtoo

4 ay öncediscuss

Then just post your opinions rather than the text the LLM dreamed around your opinions. Short posts and tweets tend to be well-liked on HN, there is no need to puff it up to a big blog post.

Flashtoo

5 ay öncediscuss

This is true beyond software. It used to be that the proof of the thinking process was in the resulting artifact. No longer can you estimate from the existence of a piece of text and the level of polish behind it that the apparent author has put at least a reasonable amount of thought into it. This applies to comments, blogs, emails, and most troublingly I've seen this happen at my job with things like requirement specs. Now, the veneer of quality makes it much harder to know what is the appropriate amount of skepticism to judge the contents with. And it's too tiring to be maximally skeptical about everything.

Flashtoo

5 ay öncediscuss

What exactly are you claiming here? That a handful of theorems about the limits of mathematics and provability somehow combine to show that the current LLM-based AI developments will inevitably live up to what is expected of them? And that this is obvious to a select few? That all seems unlikely, to say the least.

Flashtoo

5 ay öncediscuss

Coffee grounds

Flashtoo

8 ay öncediscuss

> Evolution by natural selection is not a deterministic process so 4 billion years is just one of many possible periods of time needed but not necessarily the longest or the shortest.

That's why I say that is an upper bound - we know that it _has_ happened under those circumstances, so the minimum time needed is not more than that. If we reran the simulation it could indeed very well be much faster.

I agree that 20 watts can be enough to support intelligence and if we can figure out how to get there, it will take us much less time than a billion years. I also think that on the compute side for developing the AGI we should count all the PhD brains churning away at it right now :)

Flashtoo

8 ay öncediscuss

The notion that the brain uses less energy than an incandescent lightbulb and can store less data than YouTube does not mean we have had the compute and data needed to make AGI "for a very long time".

The human brain is not a 20-watt computer ("100 watts per day" is not right) that learns from scratch on 2 petabytes of data. State manipulations performed in the brain can be more efficient than what we do in silicon. More importantly, its internal workings are the result of billions of years of evolution, and continue to change over the course of our lives. The learning a human does over its lifetime is assisted greatly by the reality of the physical body and the ability to interact with the real world to the extent that our body allows. Even then, we do not learn from scratch. We go through a curriculum that has been refined over millennia, building on knowledge and skills that were cultivated by our ancestors.

An upper bound of compute needed to develop AGI that we can take from the human brain is not 20 watts and 2 petabytes of data, it is 4 billion years of evolution in a big and complex environment at molecular-level fidelity. Finding a tighter upper bound is left as an exercise for the reader.

Flashtoo

5 yıl öncediscuss

The undergraduate course was taught in Clean until a few years ago. Learning functional programming in Clean is a nightmare because it is impossible to find any helpful resources online about the language and the tooling is useless compared to Haskell's.

Flashtoo

7 yıl öncediscuss

You're still plagiarizing today:

https://gitlab.com/yo/hackathon-countdown/blob/master/js/ind...

is the same as

https://gist.github.com/iamkdev/6bcb79670f72ff346590#file-sc...

but you did not include his license.

The same is true for many other projects on your GitLab profile. Many of them are just snippets from Stackoverflow which you decided to turn into a repository with copyright in your name, for some reason.