HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jgehring

no profile record

comments

jgehring
·8 เดือนที่ผ่านมา·discuss
There's not that much Uranium actually that's economically sensible to extract. The NEA says in their 2024 report on Uranium [1]:

> Considering both the low and high nuclear capacity scenarios to 2050 presented in this edition, and assuming their 2050 capacity is maintained for the rest of the century, the quantities of uranium required by the global fleet – based on the current once-through fuel cycle – would likely surpass the currently identified uranium resource base in the highest cost category before the 2110s.

Their "high" scenario assumes having a bit more than double of today's capacity by 2050; today we have about 4-5% supply from nuclear energy worldwide.

[1] https://www.oecd-nea.org/jcms/pl_103179/uranium-2024-resourc...
jgehring
·2 ปีที่แล้ว·discuss
That's what happens in the very last layer. But at that point the embedding for "was" got enriched multiple times, i.e., in each attention pass, with information from the whole context (which is the whole novel here). So for the example, it would contain the information to predict, let's say, the first token of the first name of the murderer.

Expanding on that, you could imagine that the intent of the sentence to complete (figuring out the murderer) would have to be captured in the first attention passes so that other layers would then be able to integrate more and more context in order to extract that information from the whole context. Also, it means that the forward passes for previous tokens need to have extracted enough salient high-level information already since you don't re-compute all attention passes for all tokens for each next token to predict.