tpdly · HackerTrans

25 dni temudiscuss

Right. Five years ago the idea was you needed the capitalism to fund compute/training. Now, its clear that open weight models could be a public good. If my PC takes my job I'm still empowered and can still capture that value, so if Anthropic were pursing that end it wouldn't seem so hypocritical.

tpdly

w zeszłym miesiącudiscuss

Yeah, even though I like 'craftsmanship' here, stakeholders don't. I think "durability" is pretty good. 'Engineering standards' perhaps. I think we'll start to see the groundwork laid for software engineering as a proper engineering field, where specific performance characteristics are required for certain stakes.

Code can be like "heavy machinery", maybe needs license to operate. If an app has sensitive data in it, it becomes like a residential structure subject to building codes and inspections. I shudder to think of how this would play out it our oligarchic, anti-competitive environment though.

tpdly

w zeszłym miesiącudiscuss

I mean, not that I'm a huge fan of IP laws, but yes?

Like I said, if you provide an alternative to all these blogs and forums (because you trained on them or because you scrape them for RAG) then you are stealing their traffic. Search engines were/are already doing that, but the foundation training

tpdly

w zeszłym miesiącudiscuss

That sounds legit, but do you think its out of scope? Scam texts and emails result in exfiltrated data, maybe they have to require iMessage and iCloud Mail too?

If Facebook's Meta-Siri is being sketchy, that's a problem with Meta-Siri. Take it off the market, bring down the law. Promote competition, and bad actors must be made to loose. Can we not just status-quo fallacy that re dysfunctional consumer protections? or at maybe agree that the perfect-world scope is one that puts exfiltrators in jail, not just rejected from the app store.

Instead we'll just have Siri AI and Google Assistant AI, and no decent competition. I guess maybe we'll get a Meta phone, if the only way to compete is on the entire mobile computing vertical.

tpdly

w zeszłym miesiącudiscuss

Not foreseeably. As others have mentioned, DMA requires AI integrations to accommodate competition. To my mind, Apple's Webkit-only playbook is the prototype here. Waaaay too much money to be made as a GEO broker. Namely by selling position/advantages in the harness, or just use it to maintain ecosystem lock in.

tpdly

w zeszłym miesiącudiscuss

As an EU resident, I find no benefits-of-doubt needed to explain why competition against foreign mega-corps is being forced. Its protectionist to promote openness when the closed solutions funnel profit abroad.

tpdly

w zeszłym miesiącudiscuss

Apple would have to allow USERS the possibility of giving any virtual assistant direct access to their own private data.

Is that accurate?

tpdly

w zeszłym miesiącudiscuss

I think you undervalue the contribution of internet-scale data to foundation modeling, and because LLMs can obsolete the content they required, I think its fair to characterize it as theft. Obviously RL contributes a lot to capabilities, but the judgement that an LLM uses to 'synthesize information' is born from the training data. The scale of the data really is beyond intuition. books3, for example, would 230 yrs of continuous reading

I actually think the "proprietary non-determenistic database of the free internet" does a lot to characterize the capabilities and effects to a lot of people. Obviously coders are more in tune with how well agents can work, but that's also due more to the RL breakthroughs than foundation modeling.

tpdly

w zeszłym miesiącudiscuss

I like to think someone can come along with Jobs-like charisma and redefine the public's intuition for personal computing again. Foundation models with maximally deterministic harnesses, voice assistants with honest, tasteful amounts of roboticism, maybe data tenancy that doesn't make you feel like a surveilled ecosystem prisoner.

NVIDIA local AI builds are moving in that direction, but are wildly expensive. I think a lot of the current AI backlash (esp data-centers) comes from the public's accurate intuition that the current centralized, monopolistic, cloud-centric solution disempowers them, and eats any gains this magical technology would've brought them. Plugging a sliver box into the wall and your router, with no recurring fees; that would make people feel different about "taking our jobs" because they would be the unquestionable beneficiary.

tpdly

2 miesiące temudiscuss

Average density in an urban core (North America) is like 90 residents per acre, vs like 5 res/acre in suburbs. Not a very big exaggeration

tpdly

3 miesiące temudiscuss

I think it does have some network effects. When people are sending you 800 line markdown "planning documents" and "specs", drowning you in slop, it induces demand for LLMs to re-deflate that content into something manageable.

tpdly

3 miesiące temudiscuss

I know it sounds extreme to dismiss that workflow, but I don't think people are talking enough about the subtle psychological consequences of LLM writing for this kind of thing.

In the same way that googling for an SEO article's superficial answer ends up meaning you never really bother to memorize it, "ask chat" seems to lead to never really bothering to think hard about it.

Of course I google things, but maybe I should be trying to learn in a way that minimizes the need. Maybe its important to learn how to learn in way that minimizes exposure to sycophantic average-blog-speak.

tpdly

3 miesiące temudiscuss

Yeah, same. I like the silo idea, I'll have to explore that.

I'm relieved to hear this because the LLM hype in this thread is seriously disorienting. Deeply convinced that coding "by hand" is just as defensible in the LLM age as handwriting was in the TTY age. My dopamine system is quite unconvinced though, killing me.

tpdly

3 miesiące temudiscuss

Hey I understand you've gotten something out of it. You hired a robot to 3d-print a mug that fits your hand. There's a place for that. You understand that it might poison you a little bit? You understand that this doesn't make ceramics irrelevant?

Hobby-project vibe coding is pretty cool (if I'm being honest, its fucking miraculous; this tech is wild) but isn't it clear that there's a problem with the linkedincels, the investors, the management that are all convinced this will remove say 50% of programming jobs? I understand these things have legitimate uses, but I'm at my wits end hearing about how deep understanding, craftsmanship, patience and hard work aren't "results oriented".

There's definitely zealotry developing against AI, but I suspect it is a proportional (if unhelpful) response to the hype machine. Is it really zealotry to insist on the value of your mind and your competence? These people saying you should never "hand write" your code-- how the fuck did the discourse move so much that this isn't a laughably stupid thing to say? "I'm a CEO, and if you aren't using consultants to make your decisions you've already lost"

tpdly

3 miesiące temudiscuss

You're fooling yourself.

People yeating a (shitty) Github clone with Claude in a week apparently can't imagine it, but if you know the shit out of Rails, start with a good a boiler plate, and have a good git library, a solo dev can also build a (shitty) Github clone in a week. And they'll be able to take it somewhere, unlike the llm ratsnest that will require increasingly expensive tokens to (frustratingly) modify.

tpdly

5 miesięcy temudiscuss

Also trying to speak dispassionately: If your enemy presents as the most vulnerable as the most vulnerable of a population, shouldn't that be an indication that you're colonizing? That you're squeezing so hard, oppressing so vehemently that an entire people become your enemy? Or the entire people were your enemy the whole time.

tpdly

5 miesięcy temudiscuss

I think these are reasons that Mastodon and Nostr aren't ever going to have a critical mass of users, remaining a niche thing for people who care about the hypotheticals (which is fine). Imho, BlueSky is the only distributed social media project that has a chance of meeting users where there are with usable search, realtime discoverability, and other consequences of centralizing event-busses.

People wine about BlueSky being too centralized, but the fact is that this type of infrastructure isn't self-hostable. You can do social-media over email a la Mastodon (which admittedly is pretty great), but most people will trade that for a walled garden.

The big problem is that all this AT infra is pretty much charity, which doesn't feel sustainable. I wish it could be funded more like public libraries than ad tech.

tpdly

5 miesięcy temudiscuss

Lovely visualization. I like the very concrete depiction of middle layers "recognizing features", that make the whole machine feel more plausible. I'm also a fan of visualizing things, but I think its important to appreciate that some things (like 10,000 dimension vector as the input, or even a 100 dimension vector as an output) can't be concretely visualized, and you have to develop intuitions in more roundabout ways.

I hope make more of these, I'd love to see a transformer presented more clearly.

tpdly

6 miesięcy temudiscuss

True, but Bluesky really does solve pains that closed platforms can’t/won’t. Having a choice over your algorithm is like getting lead out of your pipes, or getting a bidet or something.

tpdly

6 miesięcy temudiscuss

I've found it somewhat valuable in two ways and unhelpful/misleading in another: 1. Making small notes is so intuitive and low-pressure. I was already essentially doing before but in the form of various lists of "ideas" or "thoughts on _blank_". You can't reliably decide where you would've put something, it becomes a mess. The fact its a single directory of .md's with a phrasal titles is a great organizing constraint. 2. Being able to find old thoughts/ideas easily and link them together lead to the clarification of a lot of my more unique ideas because of the ad hoc link-language that emerged. The big problems are the rabbit hole of manic articles promising too much, and the fact that after a while you simply have too many half-baked two-year-old notes that the whole thing becomes limiting and your declare note bankruptcy.

comments