Parent comment has the rhythm of an AI comment. Caught myself not realizing it until you mentioned it. Seems like I am more in tune with LLM slop on twitter, which is usually much worse.
But on second sight it's clear and it also shows the comment as having no stance, and very generic.
@dang I would welcome a small secondary button that one can vote on to community-driven mark a comment as AI, just so we know.
Not working on it (yet), but I wish the jj <-> github story was a little more ergonomic.
Additionally, I am really missing support for stacked diffs, ie, easily pushing a number of commits into one PR on github each such that they all show their incremental diff.
ezyang's gh stack was pretty useful, if a little bit fragile [0]
and graphite.dev is also very nice, but paid software with a strong VC based motivation to become everyone's everything instead of a nice focused tool.
This stance strikes me as questionable, to use the first hunch that comes to mind to seed doubt in a topic that is researched and reported by multiple fairly reputable sources and multiple people on the ground.
Thank you xethos, this has been exactly the kind of opinion and experience report that I've been looking for.
the one thing I really want beyond persistent over whatsapp is threads.
I hope matrix has a similarly trivial app/web/pc story as mattermost has, because the other users are not necessarily able to handle anything more complex than "download an app and sign in".
Skimmed through it; mostly reading the paragraphs above each picture. The irony of which is not lost on me :)
Really enjoyed the part talking about Tolkien. It reminds me of my own LOTR experience:
I finished the trilogy in three consecutive summers in the hilly countryside of Italy near Rome.
The first summer I made it through the fellowship of the ring with a lot of patience and trying for the slower moving parts.
The summer after that I started over and read book 1 and 2, and in year three I felt I was finally in sync with the pace of the book and enjoyed reading through book 1, 2, and 3 in a few weeks.
I recently switched a bunch of friends from a project-oriented whatsapp chat to self-hosted mattermost, because I wanted permanent storage for messages and attachments, and threads, and did not want to pay slack in perpetuity.
I feel that this idea is now in jeopardy, if I understand the 10k message history is the limit correctly.
And there I thought I had a solution to slowly bring over project channels, family related things etc. that was as reliable as "my linux box will be reachable on the public internet" and I am willing to manage that it does.
Seems I was wrong, but I don't know which other software has better future proofing.
I recently switched a bunch of friends from a project-oriented whatsapp chat to self-hosted mattermost, because I wanted permanent storage for messages and attachments, and threads, and did not want to pay slack in perpetuity.
I feel that this idea is now in jeopardy, if I understand the 10k message history is the limit correctly.
And there I thought I had a solution to slowly bring over project channels, family related things etc. that was as reliable as "my linux box will be reachable on the public internet" and I am willing to manage that it does.
Seems I was wrong, but I don't know which other software has better future proofing.
I think features of the language can make it much easier (read: possible) for the compiler to recognize when a function is tail call optimizable. Not every recursion will be, so it matters greatly what the actual program is.
Transformers try to give you capabilities by doing two things interleaved (in layers) multiple times:
- apply learned knowledge from its parameters to every part of the input representation („tokenized“, ie, chunkified text).
- apply mixing of the input representation with other parts of itself. This is called „attention“ for historical reasons. The original attention computes mixing of (roughly) every token (say N) with every other (N). Thus we pay a compute cost relative to N squared.
The attention cost therefore grows quickly in terms of compute and memory requirements when the input / conversation becomes long (or may even contain documents).
It is a very active field of research to reduce the quadratic part to something cheaper, but so far this has been rather difficult, because as you readily see this means that you have to give up mixing every part of the input with every other.
Most of the time mixing token representations close to each other is more important than those that are far apart, but not always.
That’s why there are many attempts now to do away with most of the quadratic attention layers but keeping some.
What to do during mixing when you give up all-to-all attention is the big research question because many approaches seem to behave well only under some conditions and we haven’t established something as good and versatile as all-to-all attention.
If you forgo all-to-all you also open up so many options (eg. all-to-something followed by something-to-all as a pattern, where something serves as a sort of memory or state that summarizes all inputs at once. You can imagine that summarizing all inputs well is a lossy abstraction though, etc.)
@dang I would welcome a small secondary button that one can vote on to community-driven mark a comment as AI, just so we know.