awongh

1,349 karmajoined 16 ปีที่แล้ว

awongh.com

[email protected]

comments

เมื่อวานซืนdiscuss

It's interesting that all models seems to be unbiased out of the box so far- that is, mostly reflecting the training data (the internet).

The whole mecha-hitler thing doesn't seem to reflect fine-tuning, it was just a prompt change.

There's been some studies that suggest that certain usage of LLMs reduces political bias, which seems reasonable. Like, how credible is climate change, are Haitians eating pets, etc. THings that have a basis in fact.

I don't put it past Elon to train a model with political bias, just that it hasn't happened yet.

11 วันที่ผ่านมาdiscuss

> But your brain works the other way around. First there is a concept, a feeling, an image, and then the words come out to describe it.

After this I can't take the essay seriously- this sort of blanket statement about the one true hierarchy of consciousness and knowledge is BS.

While it seems to have been disproven that words in other languages cause people to speak and think differently, that also doesn't mean that words don't have any effect on the way we think, or that the concept of a word always has to come before the word itself.

The reason why we experience the uncanny valley of LLMs is because they don't represent a true consciousness, BUT it's also clear that the architecture represents certain qualities of consciousness- as the models have scaled we can see that it has some other non-word related understanding.

The evidence points to consciousness as a set of interlocking systems- attention, long term memory, short term memory, emotions, etc.

18 วันที่ผ่านมาdiscuss

For a lot of Americans the credit card system is another tax on being poor:

People with stable jobs and good credit qualify for no-fee credit cards with rewards / cashback. As a consumer you benefit financially from having a credit card. Those elsewhere in the thread worried about "debt" - you just set to auto-withdrawl the entire balance of the card every month from your bank account. Now you have free money. I can't think of a reason not to take advantage of this system in some way.

But people with unstable jobs and poor credit help subsidize these "higher-end" credit cards when they pay high interest rates on their because they missed payments or hold a balance over multiple months. For those people credit cards could help with monthly cashflow issues but are essentially a scam and not much better than payday loans.

Yet another system that American consumers are kind of forced to participate in that's a sort of tragedy of the commons (high-reward cards wouldn't exist without the exploitation of other people not savvy enough to avoid high interest and fees)

25 วันที่ผ่านมาdiscuss

It’s all about perspective, because Vercel is probably another 3-10x markup on AWS?

These kinds of choices are kind of pricing range as engineering decisions in the end.

25 วันที่ผ่านมาdiscuss

afaik prices for the big cloud providers haven't changed this much. Their instance prices are already inflated and they're probably willing to eat into their own margins to keep prices stable and just wait out the capex increase (also probably a drop in the bucket next to the hyperscale rollout).

People love to say how great it is for these alt clouds to have lower prices, until they're exposed to market forces with a company unable or unwilling to eat their profit margins.

25 วันที่ผ่านมาdiscuss

As a teacher I understand how difficult it is to explain complex topics in a simple step by step way.

The site has some really impressive technical aspects, but the educational angle is the most rare and special! The simplicity of the language and explanations disguise how difficult this is to do.

This is the original use of the internet- giving away free knowledge to people, perfectly suited for the medium of a website.

25 วันที่ผ่านมาdiscuss

That's true now, but long-term (maybe just a few years) it doesn't seem feasible for the status quo to continue from a financial point of view.

Spend for compute seems like it needs to increase to get the next iterations of models, and even if they IPO the money might run out before they can solidify their revenue streams.

All while Google just needs to survive long enough with their good-enough models and do it without really putting themselves in any existential financial risk.

And ideally the chinese models are also still there keeping everyone honest.

The true dystopic worst case is a Google monopoly on cutting edge AI.

26 วันที่ผ่านมาdiscuss

I've started to have different models review things like architectural planning docs- and I think for these more "fuzzy" outputs the differences between the outputs can be quite different and I can use my own "taste" to pick the best one.

I don't think it would work without a human in the loop but it is surprising to me how varied models' vibes are and how a system design varies by what it thinks is important to include and emphasize.

26 วันที่ผ่านมาdiscuss

afaik you are not the customer for customer support, and in the vast majority of cases human phone support is setup for the opposite case where people just want to be walked through something they can't find in the UI.

So this isn't as much of a financial engineering cost cutting move as it feels like to the type of person who truly calls because the require a human. It truly provides better service to the majority of people because they get their answer faster and more efficiently.

This is also demonstrated in the pricing of these systems at a per "open cases resolved"- they're putting their money where their mouth is.

Of course I'm also personally in the group where I call because I can already read a support page and I really need a human.... It could conceivably put true human support into another tier higher of perceived value.

26 วันที่ผ่านมาdiscuss

Both things can be true. If you're truly pessimistic this is the only thing you would expect, and not the other stuff that happened- a globally coordinated vaccine rollout to every country on earth.

27 วันที่ผ่านมาdiscuss

Since covid I’ve actually become less convinced of this. Yes there were national interests at play and there was a lot of general chaos.

But. The level of international coordination with vaccine rollouts and agreements between countries was way more than I had initially expected. Of course this feeling depends on what your own baseline expectations are.

My takeaway was that if the conditions arise that we all decide to do something about climate change (because of political conditions or because of actual effects) we (humanity) are willing to make big sudden changes

เดือนที่แล้วdiscuss

People surprised by this don’t know that the expertise that incubated silicon chips at Stanford and around the valley was based on electrical engineering work done for world war II / cold war radar technology, among other things.

Stanford and SV have always had deep defense ties. Palmer Luckey and Palantir etc are just the latest iteration of this.

เดือนที่แล้วdiscuss

That’s what Virgin Galactic was.

เดือนที่แล้วdiscuss

I think it's clear that crypto has real market-based utility as an exchange of value. It's just that much of that utility is illegal, for a spectrum of meanings of that word. Paying crypto to murder people is not the same as wanting to get out from under your shitty government's currency into another more stable one.

The whole Epstein thing (the money, I mean) just shows that money has always wanted to be moved around, and a certain class of people don't care how it gets done- I mean the arms dealers, but also the billionaires hiding money in their charities. A libertarian would say that crypto democratizes that for everyone. I don't think it can last forever though.

เดือนที่แล้วdiscuss

The real problem is that when it matters there's no way to tell them apart.

Because one wants to look like the other for very obvious reasons.

เดือนที่แล้วdiscuss

The unfortunate thing is that, while their academic position sounds plausible on paper, just like with most crypto things it's just a money grab.

How many crypto people (with legitimate backgrounds just like the founders of Polymarket and Kalshi) stood up and said big things about freedom and the unbanked etc., turns out they were literally just scamming people- there are so many examples besides FTX.

Letting people bet on any random thing is not at all related to this "price everything" theory. If that was their real goal they wouldn't behave so much like a normal sports betting company. I have yet to actually hear anyone defend their actual actions in a plausible way.

2 เดือนที่ผ่านมาdiscuss

In the age of AI and npm supply chain attacks I feel like there are more reasons than ever to roll your own.

One other possible title of this article could just be, don’t break UI conventions. Which is not the same thing.

Instead of trying to download and configure a date time thing (for something app specific like domain specific date ranges) rather than having to rely on the configuration of a larger library, then having to manage all future major version upgrades (and some of these npm libraries have major versions every year!) why not just create your own smaller surface area component? It’ll be literally zero maintenance compared to managing an npm dependency in your app.

2 เดือนที่ผ่านมาdiscuss

How does this compare to the other legal tech ai startup products?

Harvey is valued at $11b

2 เดือนที่ผ่านมาdiscuss

Of course they know, their same governments have signed some kind of five eyes intelligence treaties before. Palantir will probably have new customers now that Europe is re-arming.

In any case these same governments are probably also approving the purchase of Huawei cell tower equipment.

2 เดือนที่ผ่านมาdiscuss

Palantir is a defense company. Meta might give away your data to the USA government spying agencies, but it's not on the same level.