HackerTrans
TopNewTrendsCommentsPastAskShowJobs

kvee

3,255 karmajoined قبل 13 سنة
Trying to solve AI alignment by accelerating neglected approaches like prosocial AI and BCI to make us smart enough to solve the problem

https://ae.studio/ai-alignment

Submissions

Modular Pretraining Enables Access Control

alignment.anthropic.com
3 points·by kvee·قبل 5 أيام·0 comments

The Possessed Machines: Dostoevsky's Demons and the Coming AGI Catastrophe

possessedmachines.com
3 points·by kvee·قبل 6 أشهر·0 comments

Death Is an Engineering Challenge

danburonline.substack.com
3 points·by kvee·قبل 6 أشهر·0 comments

If AI Becomes Conscious, We Need to Know

wsj.com
6 points·by kvee·قبل 7 أشهر·11 comments

Compute in Space: a first principles interactive model

astrocompute.dev
8 points·by kvee·قبل 7 أشهر·0 comments

AI threatens white-collar work, more young Americans choose blue-collar careers

cbsnews.com
3 points·by kvee·قبل 10 أشهر·0 comments

RFI: Neuroscience and the Path to Safe AGI

blog.amaranth.foundation
1 points·by kvee·قبل 12 شهرًا·0 comments

Ending 'woke AI' isn't enough: fight the 'monster' within it

nypost.com
4 points·by kvee·قبل 12 شهرًا·3 comments

AI-powered lab runs itself–and discovers new materials 10x faster

sciencedaily.com
1 points·by kvee·قبل 12 شهرًا·1 comments

AI finds potential antibiotics in snake and spider venom

phys.org
2 points·by kvee·قبل 12 شهرًا·0 comments

Who Is AI For, Anyway?

substack.com
1 points·by kvee·السنة الماضية·0 comments

Every AI Datacenter Vulnerable to China, Report Says

time.com
3 points·by kvee·السنة الماضية·0 comments

UAE Cabinet approves first-of-its-kind AI regulatory ecosystem

middleeastainews.com
1 points·by kvee·السنة الماضية·0 comments

A mathematical model of serotonin neuron activity based on RL

brainpost.co
1 points·by kvee·السنة الماضية·0 comments

East Asian personality may stem from Ice Age Siberia 20000 yrs ago

davidsun.substack.com
48 points·by kvee·السنة الماضية·45 comments

The Widespread Adoption of Large Language Model-Assisted Writing Across Society

arxiv.org
2 points·by kvee·السنة الماضية·0 comments

Humans overtrust machines in life-or-death decisions

studyfinds.org
6 points·by kvee·السنة الماضية·0 comments

OpenAI Investigating Claim of 20M Stolen User Credentials

decrypt.co
1 points·by kvee·السنة الماضية·1 comments

The AI Arms Race

city-journal.org
1 points·by kvee·السنة الماضية·0 comments

Wake Up Call Letter to Accelerate Research in the Field of Consciousness Science

amcs-community.org
3 points·by kvee·السنة الماضية·3 comments

comments

kvee
·قبل 12 شهرًا·discuss
No, we should make it actually aligned and unbiased
kvee
·السنة الماضية·discuss
Fun loss of control story to pair with this: https://x.com/joshua_clymer/status/1887905375082656117
kvee
·السنة الماضية·discuss
https://archive.ph/NDzW4
kvee
·قبل سنتين·discuss
On the other hand, it may be that "Alignment likely generalizes further than capabilities." - https://www.beren.io/2024-05-15-Alignment-Likely-Generalizes...
kvee
·قبل سنتين·discuss
https://archive.ph/z5MMg
kvee
·قبل سنتين·discuss
https://archive.ph/sOkH2
kvee
·قبل سنتين·discuss
Future of Humanity Final Report from Anders Sandberg here:

https://static1.squarespace.com/static/660e95991cf0293c2463b...

and Google Doc version: https://docs.google.com/document/d/1jgl2KqtiJ6lLkpoZ1I_VeniP...
kvee
·قبل سنتين·discuss
https://github.com/robertvacareanu/llm4regression
kvee
·قبل سنتين·discuss
It does seem actually to be "feature working as intended" if you read the initial Gemini paper.

Some relevant concerning stuff pulled from it here: https://twitter.com/psychosort/status/1760849091171352956

https://twitter.com/psychosort/status/1761044625307963445

Paper itself here: https://storage.googleapis.com/deepmind-media/gemini/gemini_...
kvee
·قبل 3 سنوات·discuss
I think I can see how you interpret it that way.

I certainly didn't interpret as him disagreeing with his statement "I mean I have like lots of selfish reasons for doing this"

It's the "as you've said" part of "as you've said I get like all the power of running OpenAI" that would make me inclined to think what you wrote here.

But I do think there's a greater chance that he is saying that he does like the power.

There's also another quote either in this video or the other one I shared I think where he's asked why he's doing this, or what motivates him, or something like that, and he responds with something like "I'd be lying if I didn't say I really like the power"
kvee
·قبل 3 سنوات·discuss
Just went to the first video and got the following from 1:36, here's a link which starts at that point: https://youtu.be/3sWH2e5xpdo?si=bmum-8B02FLoVkWj&t=96

"I mean I have like lots of selfish reasons for doing this and as you've said I get like all the power of running OpenAI, but I can't think of anything more fulfilling to work on and I don't think it's particularly altruistic, it would be if I didn't already have a bunch of money, yeah, the money is gonna pile up faster than I can spend it"

Some other fascinating and relevant stuff in that video too.
kvee
·قبل 3 سنوات·discuss
Here are a couple I could find in notes I took while listening to podcasts, though there are more -

“I get like all of the power of running OpenAI” “I don’t think it’s particularly altruistic. Like it would be if I didn’t already have a bunch of money. The money is gonna pile up faster than I can spend it anyway.”

Those I think are either from https://www.youtube.com/watch?v=3sWH2e5xpdo or https://www.youtube.com/watch?v=_hpuPi7YZX8
kvee
·قبل 3 سنوات·discuss
He has said in podcasts he is motivated not by the money but by the power he has at OpenAI
kvee
·قبل 3 سنوات·discuss
You may be right here.

However, there seems to be a decent amount of evidence that Sam has done exactly what you're talking about.

He manipulated and was "not consistently candid" with the board, he got all the OpenAI employees to support him in his power struggles, he made them afraid to stand up to him (https://x.com/tobyordoxford/status/1727631406178672993?s=20), he exhibited delusions (though I guess they were correct) of grandeur with pg with a glint in his eye making clear to pg that he wanted to take over yc, he did little things like made it seem that he was cool with Eliezer Yudkowsky with a photo op but didn't really chat with him, etc.

Again, I am not sure this perspective is necessarily right (and I may be convinced just because he's such an effective psychopath).

In any case, I think this is a pretty good explanation of this perspective: https://x.com/erikphoel/status/1731703696197599537?s=20
kvee
·قبل 3 سنوات·discuss
In this case I think I just mean more effective at seeming good to others.

I think they both believe they are good and doing good.

People tend to be more suspicious of Mark Zuckerberg's motives than Sam Altman's.

Sam Altman himself even said he can't be trusted but that was ok because of the company structure and then, when he needed to, overpowered that structure he claimed was necessary: https://x.com/tobyordoxford/status/1727624526450581571?s=20
kvee
·قبل 3 سنوات·discuss
pg talks about how Sam Altman is the most powered person he's ever met. Seems we have a super powerful psychopath running perhaps the most important company in human history.

I do think he legitimately believes he's doing the right thing though all throughout, which maybe makes it more scary.

Sorta like how Mark Zuckerberg seemed to truly believe in Facebook's mission and wound up having all sorts of negative externalities for the world. Mark Zuckerberg just isn't quite as effective as Sam Altman, and it's easier to be suspicious of his motives.

Not to say that psychopaths are necessarily bad. Peter in Ender's Shadow turned out great!

But it does seem dangerous for 1 person to hold so much power over the future of humanity.

Sam Altman's reasoning for him having all the power, I think, is that “short timelines and slow takeoff is likely the safest quadrant of the short/long timelines and slow/fast takeoff matrix.”

If you believe that and believe that Sam Altman having complete control of OpenAI is the best way to accomplish that, everything seems fine.

I'd personally have preferred trying to optimize for long timelines and a slow takeoff too, which I think might have been doable if we'd devoted more resources to neglected approaches to AI alignment–like enhancing human capabilities with BCI and other stuff like that.
kvee
·قبل 5 سنوات·discuss
I am curious to understand - why was it flagged?
kvee
·قبل 5 سنوات·discuss
ONSITE on Abbot Kinney, Venice Beach, LA Los Angeles (but grandfathered in remote across the US for now too). & ONSITE or REMOTE in Florianópolis, Brazil.

AE Studio is looking for more senior full stack devs to join our team of awesome developers and data scientists. We build products for startups and large companies like Samsung, and work on cool stuff in house.

We have a pretty fun team of developers, data scientists, designers and PMs. We build products for startups like Protocol Labs and large companies like Samsung and EA, and work on cool stuff in house. We’re particularly passionate about building products that increase human agency.

We sold our first serious skunkworks project to an acquiring company last year and that bodes fairly well for the model we're pioneering where you start out doing client work, grow personally and professionally, and then move into senior leadership for the company (we're growing a lot), or start your own skunkworks project that eventually spins out as its own business, with the resources of AE to support you and great team members to tap on and practice being cofounders with before committing.

Gotta have: - JavaScript, React experience - Either Node or Rails experience. Or both! - Clean Code, Product Focused Development - Real agile experience (work with things like Kanban, Scrum, Extreme Programming) - Growth mindset http://www.aaronsw.com/weblog/dweck)

Bonus Points for: - Experience managing clients and client relationships - Startup experience - Mobile development - React Native, Swift

Apply at https://ae.studio/join-us