HackerTrans
TopNewTrendsCommentsPastAskShowJobs

halflings

no profile record

Submissions

Sampling from LLMs: Art and Science

kachkach.com
1 points·by halflings·3 個月前·0 comments

Generating one token at a time is a blessing in disguise

kachkach.com
3 points·by halflings·3 個月前·1 comments

comments

halflings
·3 個月前·discuss
> Youtube charges $10 per month and doesn't produce a single video

It is different from Netflix (that pays upfront for production costs), but there's of course a revenue share + the bulk of the revenue for creators is actually from sponsorships (which YT doesn't take a share of).
halflings
·3 個月前·discuss
LLMs generate their output one token at a time. The first thought when you learn this is that this is a huge performance bottleneck, as we are used to highly parallelized systems.

However, a large part of what makes LLMs feel so magical comes from this bottleneck.
halflings
·5 個月前·discuss
The main thing I noticed in the video is that they have heavily sped up all the code generation sections... seems to be on 5x speed or more. (because people got used to how fast and good Sonnet, and especially Gemini 3.0 Flash, are)
halflings
·5 個月前·discuss
Deploying from Antigravity is as easy as say connecting the Firebase MCP [1] and asking it "deploy my app to firebase".

[1] https://firebase.google.com/docs/ai-assistance/mcp-server
halflings
·7 個月前·discuss
+1, reading through the post, the PR updating the documentation... thanks for being transparent, but also don't be so hard on yourself!

That was a very niche error, that you promptly corrected, no need to be so apologetic about it! And thanks for all the hard work making Python faster!
halflings
·7 個月前·discuss
"The models perform differently when called via the API vs in the Gemini UI."

This shouldn't be surprised, e.g. the model != the product. The same way GPT4o behaves differently than the ChatGPT product when using GPT4o.
halflings
·7 年前·discuss
How do you want Google to show you your trips and your travel research (e.g search queries) if you disable search history?

If you don't want to see your search history (since you seem adamant on disabling it), then just use the other features on google.com/travel (destination/hotel/flight search).