HackerTrans
TopNewTrendsCommentsPastAskShowJobs

i_dont_know_

no profile record

Submissions

We need to talk about Claude's 'soul' document

nimishg.substack.com
6 points·by i_dont_know_·6 mesi fa·8 comments

comments

i_dont_know_
·6 mesi fa·discuss
Assuming a model is person-like, it gets even harder when we ask "who" the model is.

Is it this particular model from today? What if it's a minor release version change, is it a new entity, or is it only a new entity on major release versions? What about a finetune on it? Or a version with a particular tool pipeline? Are they all the same being?

I think the analogy breaks down pretty fast. Again, not to say we shouldn't think about it, but clearly the way to think of it is not "exactly a person"
i_dont_know_
·6 mesi fa·discuss
I wanted to talk about Anthropic's "soul" document they include in Claude's prompt, some of the issues it might be causing, and point out what we're seeing now as we're seeing it probably isn't artificial consciousness so much as prompt adherence.
i_dont_know_
·9 mesi fa·discuss
I'm actually quite surprized.

From another article today, I discovered the IRS has a github repo with (what seems to be) XML versions of tax questions... surely some combination of LLM and structured data querying could solve this? https://github.com/IRS-Public/direct-file/tree/main
i_dont_know_
·3 anni fa·discuss
That PT Barnum... it's interesting because it really is a good read, and the whole way through you do feel like he's giving you some kind of good advice (so, if you had purchased it back in the day you don't feel ripped off), but at the same time it's not really practically actionable. You won't actually get closer to being like PT Barnum (even if you were reading it in the 1800s) or understand the steps to becoming like him, or necessarily become any better at making money. But at the same time, you're satisfied enough with the read to feel like you hadn't wasted your time and money on it. That's his real trick :)
i_dont_know_
·4 anni fa·discuss
I think if the poll says 'yes' and he does truly abide by it, I think it will show some honesty around the whole 'public town square' and 'for the people' rhetoric he has espoused. I'd be quite impressed.

However, he has a history of noble intents on Twitter (eg the 'end world hunger' thing) followed by lack of follow-through, so I can imagine a scenario where the poll comes out 'yes' and he doesn't abide by the results by calling foul play somewhere (bot accounts, multiple user accounts etc.)