malwrar

1,885 karmajoined 9 वर्ष पहले

My username at google’s mail service, if you wanna talk shit

comments

परसोंdiscuss

> We really need an open protocol to build on.

I’d bet making a slack-compatible client or bridge isn’t hard, we all just instinctively know whoever develops it is going to get sued or taken down.

It feels like we quietly gave up on adversarial interoperability awhile ago, and act like we need a whole separate “open walled garden” when what we actually need are legal protections that prevent companies from suing/banning people who call their APIs. Slack, Facebook, etc, are walled gardens only because they can ban/sue people who compete with their client experience.

I figure that will probably never happen in the US (maybe if someone rich starts it), but eventually someone outside of it will make such an adversarial integration and host it from some region that doesn’t care about US laws. Then, when they get away with it, we’ll all praise them as a genius and wonder how Slack could exist at all. The US has many international agreements keeping this illusion alive, but my guess is that even formerly stable markets like Europe could spawn such work if they decide to stop caring about ~1990s-2010s era contempt-of-business-model US laws.

15 दिन पहलेdiscuss

Perhaps “censorship” & manufacturing consent?

I think both political extremes have their own angles: liberals might be concerned that conservative censors will censor kids from learning about LGBT people and minorities, conservatives will be concerned that liberals will force too much LGBT and minority content onto kids. Or whatever issue, they want to control what your kids read!

This will almost certainly be used to censor adults too, the only reason we aren’t doing that is because it hasn’t been possible to consistently identify people before. Considering who is pushing for this, they’re absolutely going to tie this into advertising, and if they know who you are so do all of the spooky upper echelons who could implement a true censorship regime.

“The only way they can do this is by controlling what you read, shouldn’t that be the parent’s choice?”

17 दिन पहलेdiscuss

My proposal is that we increase the effectiveness of child controls on devices, so kids can’t get access to the adult world on them. Parents in other threads however tell me that this won’t work, they’ll just use the internet on their friends devices, and what we need is to completely exclude children from the adult internet by confirming the identity of every single person who wants to use it.

Now I’m trying to convince people that identifying adults won’t work either, because kids will still get around it. All the while, we adults live with the negative externality of no longer having anonymous communication. Woe betide us all should this come to pass, but I guess desperate people are how bad things like this tend to happen.

17 दिन पहलेdiscuss

I heard a billionaire is funding this, he’s probably afraid of the one famous instance of someone like him getting killed by one of those.

18 दिन पहलेdiscuss

My point is that the entire check is bypassed easily and instantly, and in the meantime the government gets data that someone _will_ figure out how to make personally identifying for adults, or will argue for changes to make it so. Alcohol age limits are a simple physical check for a vice that everyone accepts those who want it can get at. I’d rather demand that device manufacturers give parents effective controls before we try solving this problem by identifying internet users wholesale.

18 दिन पहलेdiscuss

Headline news: children infiltrate the universal adult one time password scheme for porn, parents panic! Turns out the 18 year olds started selling access to their younger friends, who resold it to their younger friends.

23 दिन पहलेdiscuss

These things passing the Turing Test makes anthropomorphizing their behavior awkward, but don’t forget it’s just an analogy to communicate an experience. If you convey a certain written voice to these models in your input, you get a somewhat consistent end effect. I think that’s all that is being communicated.

पिछला माहdiscuss

It was precisely that for me! Another commenter captures it well; “the bitter lesson” indeed.

पिछला माहdiscuss

I’d recommend my method of just drawing out the block diagram and drawing out + digging into the math at each step! I’m the kind of person who needs to take time to ask lots of questions before stuff clicks, and if you are too I strongly recommend it.

I picked it up from trying to teach myself that SLAM stuff. The papers are very short, but highly information dense and at the time there was no ChatGPT to help me. I got through them by just creeping my way through the math with a whiteboard, and something about drawing it out and having it there in my office made it all click. Trying to watch piecemeal lectures on YouTube or grind through foundational books like MVG just didn’t work for me, I used them instead as references for my drawings.

Same happened when I tried learning this GPT stuff. karpathy’s videos were out at the time, but I couldn’t really stay focused on them or connect the math with the code. Most other descriptions I could find were focused on getting you to use their inference library or harness. Assembling the picture together on my whiteboard by focusing on drawing out the block diagram continues to be my personal favorite method for deep understanding of complex systems.

पिछला माहdiscuss

Im also a mere mortal, and after putting a few years into it IMO I’d say people make it much more complicated than it actually is. I failed most of my math courses for lack of interest, but found passion later with the aforementioned SLAM stuff. I have no doubt you or any other programmer could learn this stuff, especially since you can ask ChatGPT clarifying questions.

I have no idea about careers at this point, I’m still doing fancy IT work as my day job I and look away from the future with dread. I also haven’t been looking for new roles on the open job market, so who knows maybe there’s multimillion pay packages for anyone who can articulate how attention works in an interview.

पिछला माहdiscuss

Back when ChatGPT came out, I was so shocked by how _good_ it was for an “AI” product that I simply had to know how it worked. Over the next month I ended up drawing out a block diagram on a whiteboard I have in my office, with the math involved next to each step in the blackboard. I’d puzzle about each step along the way, and the triumph of completing the drawing was also that of this sense of deep understanding. I kept that drawing up for many months after, and would gaze at it often during meetings and idle moments in wonder.

This is to say: the autoregressive decoder-only transformer llm architecture as pioneered by openai is wildly simple for how revolutionary its results are. I was reading about non-learned classical SLAM systems (uses video + handcrafted math to produce 3d mappings of physical spaces while also locating the camera in those spaces) at the time, and comparatively speaking I’d say the math is about as complicated as ONE of the components in those complex formulations. The only reason frontier LLMs need 6-figure computers to run is because the model designers made the middle bit in those models REALLY BIG, dimensionally speaking. They just took the steam engine, made a few gargantuan versions of it, and are selling them as the ultimate source of power.

This was openai’s entire breakthrough. Making this particular model architecture larger leads to emergent capabilities like being able to pick the best ending to a story/set of instructions or answer questions about broad factual knowledge. I’ve been meanwhile watching these AI companies attempt, successfully, to sell this capability as some sort of robot consciousness hand-crafted by supergeniuses. The fact that they are getting away with it is almost as shocking to me as the discovery itself.

पिछला माहdiscuss

How do you verify someone’s age reliably without identifying them? Unless there’s some standard around zero-knowledge proofs they’re implementing that I’m not aware of, they’re probably going to end up identifying everyone as part of this system, since kids will try and bypass it and parents will demand it be made more robust. Kids will still bypass it no matter what we do.

पिछला माहdiscuss

I don’t understand how video evidence from a mass surveillance network would have helped here. They found your car without it! Shouldn’t your issue be with the prosecutor, and thus your ineffective local government?

Otherwise, what’s to stop them from just telling you video evidence isn’t enough, because jurors have become accustom to thinking that video evidence can be faked by vindictive cops?

पिछला माहdiscuss

Indeed sad, congrats on publishing your book though. I’ve certainly felt a bit of that same angst myself.

I think SWGEmu (cool project, just learned of it from you!) do represent some optimism though. Maybe these sorts of passion projects will take over the space?

पिछला माहdiscuss

Really hate to say it, but I’ve stopped publishing my work too for this reason. I spend most of my time now building my own little software ark, and I aspire to no longer think of programming in the next few years. I feel like the creative economy in general will be unrecognizable in the near future, maybe nonexistent. I wonder what modes of collaboration on ideas might form in the next few years.

पिछला माहdiscuss

I don’t think people realize that these devices can even be used that way. I talk with people outside of the tech scene frequently, and they are routinely surprised when I tell them about this sort of capability. The ring doorbell Super Bowl commercial about finding lost dogs was a genuine shock to people! I think there’s a degree of visibility you need to get people’s attention on an issue, and it’s just difficult to see a doorbell as a threat for the average person.

पिछला माहdiscuss

You know how when you finish prompting some code generator to build something, and you look over what it has built and feel a sense of emptiness even if it does what you want? I think about what I wish the prototype looked like, and basically start describing details that I expect to exist (think longer versions of e.g. “this should be using our internal graph library, and I figure we can model this task as a traversal, how far have you strayed from this and why?”) and let the agent analyze what it built against my expectations. I’ve spent hours in conversation just “refining the context” this way, and then I channel that into an update process. I figure the prototype is just about proving out behavior, and this next phase is about refining it into the pieces I’ll use elsewhere. It’s kinda fun, I’d absolutely burn out a coworker if I grilled their PRs the way I roast AI contributions :P

पिछला माहdiscuss

I’m still pretty skeptical about OpenRouter. I have a client implemented for them so I can use them with my harnesses, but at the same time that client was generated and tested in an hour or so just like all of the other llm provider clients that I have. Using these services interchangeably by just swapping out clients has so far been working well for me. I think when it comes down to it, the only real inconvenience that they’re solving is where I put my credit card number. Is there something key that I’m missing about this service (besides it being a nexus of attention) that warrants this kind of investment? Or is this truly the bar for starting a successful AI company :P

पिछला माहdiscuss

I once had someone start _arguing with me_ about stuff using generative text on Slack or generated email replies. Not even to provide information, but just to write flat denials to even continue discussion on the subject. This person had a very distinctive writing style, and the shift to the AI writing style felt pretty obvious and uncanny.

I can’t describe how disturbing it was to realize that my voice suddenly no longer mattered, and that I was speaking to something that would never get tired of creatively dismissing my ideas without ever really addressing them. This behavior compounded and was unaddressed by anyone, no one I talked to seemed willing to try actually pushing back against it. Best solution they had was to have physical meetings w/ n>1 people on each side in the room. Trust plummeted, and eventually all meetings with that team were recorded and transcripted, and people started talking like they were on stage vs trying to solve shared problems. Work ground to a halt on even basic things, and I ended up leaving. This was on a pretty major project that has a name people here would know, but don’t ask me what!

2 माह पहलेdiscuss

Lucky find! Just picked up one of those for a build, ohhhh boy was that a painful purchase. Thank god for my fortune to work in tech.