HackerTrans
TopNewTrendsCommentsPastAskShowJobs

kvee

3,255 karmajoined il y a 13 ans
Trying to solve AI alignment by accelerating neglected approaches like prosocial AI and BCI to make us smart enough to solve the problem

https://ae.studio/ai-alignment

Submissions

Modular Pretraining Enables Access Control

alignment.anthropic.com
3 points·by kvee·il y a 5 jours·0 comments

The Possessed Machines: Dostoevsky's Demons and the Coming AGI Catastrophe

possessedmachines.com
3 points·by kvee·il y a 6 mois·0 comments

Death Is an Engineering Challenge

danburonline.substack.com
3 points·by kvee·il y a 6 mois·0 comments

If AI Becomes Conscious, We Need to Know

wsj.com
6 points·by kvee·il y a 7 mois·11 comments

Compute in Space: a first principles interactive model

astrocompute.dev
8 points·by kvee·il y a 7 mois·0 comments

AI threatens white-collar work, more young Americans choose blue-collar careers

cbsnews.com
3 points·by kvee·il y a 10 mois·0 comments

RFI: Neuroscience and the Path to Safe AGI

blog.amaranth.foundation
1 points·by kvee·il y a 12 mois·0 comments

Ending 'woke AI' isn't enough: fight the 'monster' within it

nypost.com
4 points·by kvee·il y a 12 mois·3 comments

AI-powered lab runs itself–and discovers new materials 10x faster

sciencedaily.com
1 points·by kvee·il y a 12 mois·1 comments

AI finds potential antibiotics in snake and spider venom

phys.org
2 points·by kvee·il y a 12 mois·0 comments

Who Is AI For, Anyway?

substack.com
1 points·by kvee·l’année dernière·0 comments

Every AI Datacenter Vulnerable to China, Report Says

time.com
3 points·by kvee·l’année dernière·0 comments

UAE Cabinet approves first-of-its-kind AI regulatory ecosystem

middleeastainews.com
1 points·by kvee·l’année dernière·0 comments

A mathematical model of serotonin neuron activity based on RL

brainpost.co
1 points·by kvee·l’année dernière·0 comments

East Asian personality may stem from Ice Age Siberia 20000 yrs ago

davidsun.substack.com
48 points·by kvee·l’année dernière·45 comments

The Widespread Adoption of Large Language Model-Assisted Writing Across Society

arxiv.org
2 points·by kvee·l’année dernière·0 comments

Humans overtrust machines in life-or-death decisions

studyfinds.org
6 points·by kvee·l’année dernière·0 comments

OpenAI Investigating Claim of 20M Stolen User Credentials

decrypt.co
1 points·by kvee·l’année dernière·1 comments

The AI Arms Race

city-journal.org
1 points·by kvee·l’année dernière·0 comments

Wake Up Call Letter to Accelerate Research in the Field of Consciousness Science

amcs-community.org
3 points·by kvee·l’année dernière·3 comments

comments

kvee
·il y a 12 mois·discuss
No, we should make it actually aligned and unbiased
kvee
·l’année dernière·discuss
Fun loss of control story to pair with this: https://x.com/joshua_clymer/status/1887905375082656117
kvee
·l’année dernière·discuss
https://archive.ph/NDzW4
kvee
·il y a 2 ans·discuss
On the other hand, it may be that "Alignment likely generalizes further than capabilities." - https://www.beren.io/2024-05-15-Alignment-Likely-Generalizes...
kvee
·il y a 2 ans·discuss
https://archive.ph/z5MMg
kvee
·il y a 2 ans·discuss
https://archive.ph/sOkH2
kvee
·il y a 2 ans·discuss
Future of Humanity Final Report from Anders Sandberg here:

https://static1.squarespace.com/static/660e95991cf0293c2463b...

and Google Doc version: https://docs.google.com/document/d/1jgl2KqtiJ6lLkpoZ1I_VeniP...
kvee
·il y a 2 ans·discuss
https://github.com/robertvacareanu/llm4regression
kvee
·il y a 2 ans·discuss
It does seem actually to be "feature working as intended" if you read the initial Gemini paper.

Some relevant concerning stuff pulled from it here: https://twitter.com/psychosort/status/1760849091171352956

https://twitter.com/psychosort/status/1761044625307963445

Paper itself here: https://storage.googleapis.com/deepmind-media/gemini/gemini_...
kvee
·il y a 3 ans·discuss
I think I can see how you interpret it that way.

I certainly didn't interpret as him disagreeing with his statement "I mean I have like lots of selfish reasons for doing this"

It's the "as you've said" part of "as you've said I get like all the power of running OpenAI" that would make me inclined to think what you wrote here.

But I do think there's a greater chance that he is saying that he does like the power.

There's also another quote either in this video or the other one I shared I think where he's asked why he's doing this, or what motivates him, or something like that, and he responds with something like "I'd be lying if I didn't say I really like the power"
kvee
·il y a 3 ans·discuss
Just went to the first video and got the following from 1:36, here's a link which starts at that point: https://youtu.be/3sWH2e5xpdo?si=bmum-8B02FLoVkWj&t=96

"I mean I have like lots of selfish reasons for doing this and as you've said I get like all the power of running OpenAI, but I can't think of anything more fulfilling to work on and I don't think it's particularly altruistic, it would be if I didn't already have a bunch of money, yeah, the money is gonna pile up faster than I can spend it"

Some other fascinating and relevant stuff in that video too.
kvee
·il y a 3 ans·discuss
Here are a couple I could find in notes I took while listening to podcasts, though there are more -

“I get like all of the power of running OpenAI” “I don’t think it’s particularly altruistic. Like it would be if I didn’t already have a bunch of money. The money is gonna pile up faster than I can spend it anyway.”

Those I think are either from https://www.youtube.com/watch?v=3sWH2e5xpdo or https://www.youtube.com/watch?v=_hpuPi7YZX8
kvee
·il y a 3 ans·discuss
He has said in podcasts he is motivated not by the money but by the power he has at OpenAI
kvee
·il y a 3 ans·discuss
You may be right here.

However, there seems to be a decent amount of evidence that Sam has done exactly what you're talking about.

He manipulated and was "not consistently candid" with the board, he got all the OpenAI employees to support him in his power struggles, he made them afraid to stand up to him (https://x.com/tobyordoxford/status/1727631406178672993?s=20), he exhibited delusions (though I guess they were correct) of grandeur with pg with a glint in his eye making clear to pg that he wanted to take over yc, he did little things like made it seem that he was cool with Eliezer Yudkowsky with a photo op but didn't really chat with him, etc.

Again, I am not sure this perspective is necessarily right (and I may be convinced just because he's such an effective psychopath).

In any case, I think this is a pretty good explanation of this perspective: https://x.com/erikphoel/status/1731703696197599537?s=20
kvee
·il y a 3 ans·discuss
In this case I think I just mean more effective at seeming good to others.

I think they both believe they are good and doing good.

People tend to be more suspicious of Mark Zuckerberg's motives than Sam Altman's.

Sam Altman himself even said he can't be trusted but that was ok because of the company structure and then, when he needed to, overpowered that structure he claimed was necessary: https://x.com/tobyordoxford/status/1727624526450581571?s=20
kvee
·il y a 3 ans·discuss
pg talks about how Sam Altman is the most powered person he's ever met. Seems we have a super powerful psychopath running perhaps the most important company in human history.

I do think he legitimately believes he's doing the right thing though all throughout, which maybe makes it more scary.

Sorta like how Mark Zuckerberg seemed to truly believe in Facebook's mission and wound up having all sorts of negative externalities for the world. Mark Zuckerberg just isn't quite as effective as Sam Altman, and it's easier to be suspicious of his motives.

Not to say that psychopaths are necessarily bad. Peter in Ender's Shadow turned out great!

But it does seem dangerous for 1 person to hold so much power over the future of humanity.

Sam Altman's reasoning for him having all the power, I think, is that “short timelines and slow takeoff is likely the safest quadrant of the short/long timelines and slow/fast takeoff matrix.”

If you believe that and believe that Sam Altman having complete control of OpenAI is the best way to accomplish that, everything seems fine.

I'd personally have preferred trying to optimize for long timelines and a slow takeoff too, which I think might have been doable if we'd devoted more resources to neglected approaches to AI alignment–like enhancing human capabilities with BCI and other stuff like that.
kvee
·il y a 3 ans·discuss
If of interest to anyone here, my company has built an open source software library for transcranial focused ultrasound stimulation: https://github.com/agencyenterprise/neurotechdevkit

Its goal is to accelerate the development of agency-increasing neurotechnology and lower the barrier of entry for any developers to be able to solve open problems in neurotech without having to have their own hardware or human subjects. It's starting with ultrasound, which we find quite promising, and we hope to expand in the future to other areas as well.
kvee
·il y a 3 ans·discuss
https://archive.is/3LaJF
kvee
·il y a 3 ans·discuss
I suspect treating screen use as "treats" may not be ideal.

I also have a 2 year old son and am very curious about this.

It's tough, because I do know whatever I do won't be ideal, and we won't know till later when we learn more about how our brains work what we really should be doing with regards to screen use by kids.

And, at the same time, things are accelerating fast, so there's a decent chance tech is totally different by the time our children are in high school, or even elementary school.

I think that in an ideal world, we'd all use technology all the time and it'd be a natural extension of ourselves letting us be fuller versions of ourselves and more present with each other. It's a shame we're not in that world yet, and I'm hopeful that as we get richer humanity starts designing tech to be more agency increasing with this target in mind rather than losing agency to shorter term incentives.

With our 2 year old, I think the highest impact thing we do is try to strict about being present with him and not on our phones. I suspect this might be much more important than whatever rules are established for a child's own use of technology.

Reminds me of the pretty compelling poem "Children Learn What They Live": https://www.freepoemsonline.net/poems-htm/children1.htm
kvee
·il y a 3 ans·discuss
When NFTs were hot, we made one that was intentionally tasteless thinking that it could raise awareness for people to donate to effective charities (pretending it was NFTs for needy children, but actually the proceeds from NFTs would go to the Against Malaria Foundation), but never could really get the whole thing right so decided not to launch it.

If anyone has an idea to actually execute that original idea right and do some good net net, here's the website: https://nftsforstarvingchildren.com/