HackerTrans
TopNewTrendsCommentsPastAskShowJobs

kvee

3,255 karmajoined 13 лет назад
Trying to solve AI alignment by accelerating neglected approaches like prosocial AI and BCI to make us smart enough to solve the problem

https://ae.studio/ai-alignment

Submissions

Modular Pretraining Enables Access Control

alignment.anthropic.com
3 points·by kvee·5 дней назад·0 comments

The Possessed Machines: Dostoevsky's Demons and the Coming AGI Catastrophe

possessedmachines.com
3 points·by kvee·6 месяцев назад·0 comments

Death Is an Engineering Challenge

danburonline.substack.com
3 points·by kvee·6 месяцев назад·0 comments

If AI Becomes Conscious, We Need to Know

wsj.com
6 points·by kvee·7 месяцев назад·11 comments

Compute in Space: a first principles interactive model

astrocompute.dev
8 points·by kvee·7 месяцев назад·0 comments

AI threatens white-collar work, more young Americans choose blue-collar careers

cbsnews.com
3 points·by kvee·10 месяцев назад·0 comments

RFI: Neuroscience and the Path to Safe AGI

blog.amaranth.foundation
1 points·by kvee·12 месяцев назад·0 comments

Ending 'woke AI' isn't enough: fight the 'monster' within it

nypost.com
4 points·by kvee·12 месяцев назад·3 comments

AI-powered lab runs itself–and discovers new materials 10x faster

sciencedaily.com
1 points·by kvee·12 месяцев назад·1 comments

AI finds potential antibiotics in snake and spider venom

phys.org
2 points·by kvee·12 месяцев назад·0 comments

Who Is AI For, Anyway?

substack.com
1 points·by kvee·в прошлом году·0 comments

Every AI Datacenter Vulnerable to China, Report Says

time.com
3 points·by kvee·в прошлом году·0 comments

UAE Cabinet approves first-of-its-kind AI regulatory ecosystem

middleeastainews.com
1 points·by kvee·в прошлом году·0 comments

A mathematical model of serotonin neuron activity based on RL

brainpost.co
1 points·by kvee·в прошлом году·0 comments

East Asian personality may stem from Ice Age Siberia 20000 yrs ago

davidsun.substack.com
48 points·by kvee·в прошлом году·45 comments

The Widespread Adoption of Large Language Model-Assisted Writing Across Society

arxiv.org
2 points·by kvee·в прошлом году·0 comments

Humans overtrust machines in life-or-death decisions

studyfinds.org
6 points·by kvee·в прошлом году·0 comments

OpenAI Investigating Claim of 20M Stolen User Credentials

decrypt.co
1 points·by kvee·в прошлом году·1 comments

The AI Arms Race

city-journal.org
1 points·by kvee·в прошлом году·0 comments

Wake Up Call Letter to Accelerate Research in the Field of Consciousness Science

amcs-community.org
3 points·by kvee·в прошлом году·3 comments

comments

kvee
·12 месяцев назад·discuss
No, we should make it actually aligned and unbiased
kvee
·в прошлом году·discuss
Fun loss of control story to pair with this: https://x.com/joshua_clymer/status/1887905375082656117
kvee
·в прошлом году·discuss
https://archive.ph/NDzW4
kvee
·2 года назад·discuss
On the other hand, it may be that "Alignment likely generalizes further than capabilities." - https://www.beren.io/2024-05-15-Alignment-Likely-Generalizes...
kvee
·2 года назад·discuss
https://archive.ph/z5MMg
kvee
·2 года назад·discuss
https://archive.ph/sOkH2
kvee
·2 года назад·discuss
Future of Humanity Final Report from Anders Sandberg here:

https://static1.squarespace.com/static/660e95991cf0293c2463b...

and Google Doc version: https://docs.google.com/document/d/1jgl2KqtiJ6lLkpoZ1I_VeniP...
kvee
·2 года назад·discuss
https://github.com/robertvacareanu/llm4regression
kvee
·2 года назад·discuss
It does seem actually to be "feature working as intended" if you read the initial Gemini paper.

Some relevant concerning stuff pulled from it here: https://twitter.com/psychosort/status/1760849091171352956

https://twitter.com/psychosort/status/1761044625307963445

Paper itself here: https://storage.googleapis.com/deepmind-media/gemini/gemini_...
kvee
·3 года назад·discuss
I think I can see how you interpret it that way.

I certainly didn't interpret as him disagreeing with his statement "I mean I have like lots of selfish reasons for doing this"

It's the "as you've said" part of "as you've said I get like all the power of running OpenAI" that would make me inclined to think what you wrote here.

But I do think there's a greater chance that he is saying that he does like the power.

There's also another quote either in this video or the other one I shared I think where he's asked why he's doing this, or what motivates him, or something like that, and he responds with something like "I'd be lying if I didn't say I really like the power"
kvee
·3 года назад·discuss
Just went to the first video and got the following from 1:36, here's a link which starts at that point: https://youtu.be/3sWH2e5xpdo?si=bmum-8B02FLoVkWj&t=96

"I mean I have like lots of selfish reasons for doing this and as you've said I get like all the power of running OpenAI, but I can't think of anything more fulfilling to work on and I don't think it's particularly altruistic, it would be if I didn't already have a bunch of money, yeah, the money is gonna pile up faster than I can spend it"

Some other fascinating and relevant stuff in that video too.
kvee
·3 года назад·discuss
Here are a couple I could find in notes I took while listening to podcasts, though there are more -

“I get like all of the power of running OpenAI” “I don’t think it’s particularly altruistic. Like it would be if I didn’t already have a bunch of money. The money is gonna pile up faster than I can spend it anyway.”

Those I think are either from https://www.youtube.com/watch?v=3sWH2e5xpdo or https://www.youtube.com/watch?v=_hpuPi7YZX8
kvee
·3 года назад·discuss
He has said in podcasts he is motivated not by the money but by the power he has at OpenAI
kvee
·3 года назад·discuss
You may be right here.

However, there seems to be a decent amount of evidence that Sam has done exactly what you're talking about.

He manipulated and was "not consistently candid" with the board, he got all the OpenAI employees to support him in his power struggles, he made them afraid to stand up to him (https://x.com/tobyordoxford/status/1727631406178672993?s=20), he exhibited delusions (though I guess they were correct) of grandeur with pg with a glint in his eye making clear to pg that he wanted to take over yc, he did little things like made it seem that he was cool with Eliezer Yudkowsky with a photo op but didn't really chat with him, etc.

Again, I am not sure this perspective is necessarily right (and I may be convinced just because he's such an effective psychopath).

In any case, I think this is a pretty good explanation of this perspective: https://x.com/erikphoel/status/1731703696197599537?s=20
kvee
·3 года назад·discuss
In this case I think I just mean more effective at seeming good to others.

I think they both believe they are good and doing good.

People tend to be more suspicious of Mark Zuckerberg's motives than Sam Altman's.

Sam Altman himself even said he can't be trusted but that was ok because of the company structure and then, when he needed to, overpowered that structure he claimed was necessary: https://x.com/tobyordoxford/status/1727624526450581571?s=20
kvee
·3 года назад·discuss
pg talks about how Sam Altman is the most powered person he's ever met. Seems we have a super powerful psychopath running perhaps the most important company in human history.

I do think he legitimately believes he's doing the right thing though all throughout, which maybe makes it more scary.

Sorta like how Mark Zuckerberg seemed to truly believe in Facebook's mission and wound up having all sorts of negative externalities for the world. Mark Zuckerberg just isn't quite as effective as Sam Altman, and it's easier to be suspicious of his motives.

Not to say that psychopaths are necessarily bad. Peter in Ender's Shadow turned out great!

But it does seem dangerous for 1 person to hold so much power over the future of humanity.

Sam Altman's reasoning for him having all the power, I think, is that “short timelines and slow takeoff is likely the safest quadrant of the short/long timelines and slow/fast takeoff matrix.”

If you believe that and believe that Sam Altman having complete control of OpenAI is the best way to accomplish that, everything seems fine.

I'd personally have preferred trying to optimize for long timelines and a slow takeoff too, which I think might have been doable if we'd devoted more resources to neglected approaches to AI alignment–like enhancing human capabilities with BCI and other stuff like that.
kvee
·3 года назад·discuss
If of interest to anyone here, my company has built an open source software library for transcranial focused ultrasound stimulation: https://github.com/agencyenterprise/neurotechdevkit

Its goal is to accelerate the development of agency-increasing neurotechnology and lower the barrier of entry for any developers to be able to solve open problems in neurotech without having to have their own hardware or human subjects. It's starting with ultrasound, which we find quite promising, and we hope to expand in the future to other areas as well.
kvee
·3 года назад·discuss
https://archive.is/3LaJF
kvee
·5 лет назад·discuss
I am curious to understand - why was it flagged?
kvee
·5 лет назад·discuss
ONSITE on Abbot Kinney, Venice Beach, LA Los Angeles (but grandfathered in remote across the US for now too). & ONSITE or REMOTE in Florianópolis, Brazil.

AE Studio is looking for more senior full stack devs to join our team of awesome developers and data scientists. We build products for startups and large companies like Samsung, and work on cool stuff in house.

We have a pretty fun team of developers, data scientists, designers and PMs. We build products for startups like Protocol Labs and large companies like Samsung and EA, and work on cool stuff in house. We’re particularly passionate about building products that increase human agency.

We sold our first serious skunkworks project to an acquiring company last year and that bodes fairly well for the model we're pioneering where you start out doing client work, grow personally and professionally, and then move into senior leadership for the company (we're growing a lot), or start your own skunkworks project that eventually spins out as its own business, with the resources of AE to support you and great team members to tap on and practice being cofounders with before committing.

Gotta have: - JavaScript, React experience - Either Node or Rails experience. Or both! - Clean Code, Product Focused Development - Real agile experience (work with things like Kanban, Scrum, Extreme Programming) - Growth mindset http://www.aaronsw.com/weblog/dweck)

Bonus Points for: - Experience managing clients and client relationships - Startup experience - Mobile development - React Native, Swift

Apply at https://ae.studio/join-us