HackerLangs
TopNewTrendsCommentsPastAskShowJobs

sisve

335 karmajoined 9 yıl önce

comments

sisve
·evvelsi gün·discuss
> Gosh, I don't think any game engines have particularly good test suites at all.

What? I do understand that a CRUD app with little to no logic do not focus on test.

But any kind of engine.. i can not understand that it's not a priority? In general I'm not a big fan of unit test on simple websites, they do not give any real value compared to effort

But I remember working on a complex codename. It was extremely important to have close to 100% unit test in the core part. Saved me a lot.
sisve
·7 gün önce·discuss
Nah, your doing great, you just reflect on you own position and adjust it. People are just (too) suspicious when people are not locked in their ways and are nice instead of hostile
sisve
·8 gün önce·discuss
If I understand the graph correctly;

Fable is using less tokens to achive that same tasks compared to sonet and opus. If so that is a good thing. It feels like we for a while there was spitting out tokens to get a better result. If the model themselves are getting better without generating more tokens that feels like a real win.

Q1: Why is number of steps relevant in this graph? What does it tell us?

Q2: and why have they flipped the horizontal graph so that 0 is to the right and not at origo? Is that some kind of new smart thing? can't say i have seen it before
sisve
·11 gün önce·discuss
Do you think we will get a self-improving model in 26 or 27? Maybe not a native one but some kind of hack so a model will learn something without loosing part of the context window?
sisve
·13 gün önce·discuss
Pure fun. Love it.
sisve
·21 gün önce·discuss
Based on the paper it hits harder on the brighter

From https://cepr.org/publications/dp21577 :

The losses are largest in social science subjects, followed by STEM and languages, and are especially large for junior students, high-achieving students, and boys.

No mention of the weakest student. Which probably means they did not have a significant worse or better score
sisve
·21 gün önce·discuss
Can agree on that.

The description of the paper also said:

AI users who maintain similar homework completion time as non-AI users experience small learning losses.

This was a surprise too me. I would have thought otherwise.

Would love to see some evidence about if more or less people fall behind and have worse results. In my head the AI should be able to get the weakest students a bit highere.
sisve
·21 gün önce·discuss
> reduces completion time by 30%

This is probably the big problem, or at least one of them.. If you use less time on learning, it will probably be harder to remember what you learned also. We need to spend some time to make it stick
sisve
·21 gün önce·discuss
There where no clear rules on the matter. Now the PM has given some guidance to schools so they know when they should use it and not.

If there are no guidance teachers and schools can do what they want and some teachers would probably go to far to early
sisve
·22 gün önce·discuss
Yes
sisve
·22 gün önce·discuss
Norwegian here.

- We have a lot of hydro, that are very cheap to produces and for some of the power plants we fill up water by using solar and wind when that is very cheap and generate power back when it's demand for it (meaning selling it expensive)

-Norway export more then we are importing. But that could shift in the coming years.

-Nuclear power are expensive, so with the current prices it do not make sense to have nuclear in Norway. Thought that could change (see point 2)

- not sure what you mean by "little land usable", you can absolutely be correct. in terms of size we are bigger then Germany. But I'm not sure how much usable land there is vs other countries. We do not have that big population but it's spread out and no one wants a wind park in their neighborhood
sisve
·24 gün önce·discuss
I did not think you sounded like claude. Then I looked again after the comment was made and then I saw some of the vibes. Like acknowledging a mistake you have done.

Before that would just made you top 5% (or maybe top 1%) of the nicest people to talk too.. know ppl think you are Claude.

We are all going crazy s a sibling comment said.
sisve
·geçen ay·discuss
You are right. I haven't considered that enough. I do agree with you that globalism will be decreased even in the context of a decade, but I think it will be on a level that still give us some cost reduction. But I do think (at least hope) geopolitics will be better in 5-7 years.
sisve
·geçen ay·discuss
All depends. The current technology will be cheaper in a year or two. The best cutting edge stuff will properly be even more expensive. But in 10 years time... we can run current SOTA models (or models that are equally good ) on our local hardware
sisve
·geçen ay·discuss
> I am not sure how many people will run AI models locally. It still seems like a niche application to me.

Bill Gates had a quote some years ago...

People have still not learned how fast we improve our tech and how much cheaper thing gets I guess :)
sisve
·geçen ay·discuss
>Similar to how Denmark already has invested in LLMs focused on the Nordic languages with money from Norway.

Would love to know more. Do you have a source on this?
sisve
·geçen ay·discuss
Yeah. Happens all the time since they released it
sisve
·2 ay önce·discuss
Did you not get 38B units? And a token = 2.5 unit (cache hit) or up to 600 unis (cache miss)
sisve
·2 ay önce·discuss
A model has many dimensions. You can't have them on one scale from good to bad. The model will most likely be poor at coding. But will give better answers about Norwegian cultur. I assume the tone of voice will be (by default) much closer to how Norwegians talk and write then what we current see from model from the US. They seem to be a bit to much.. Norwegian people are a bit more down to earth
sisve
·2 ay önce·discuss
The point is that norway willl have its own LLM. And will not have dependencies to another state or private company. The goal is not to be the best model. But to have a model that include more Norwegian data then other LLM and that it's not screwed against other sources.