underscored

@underscored

4 clips · 1 follower

Follow
Tag:ai-alignmentClear

the power and problem of Anthropic is the same: the company's safety superpower is that every action it takes looks, from the outside, to be self-serving, even as the company becomes ever more convinced its motivations are pure.

Ben Thompson
3w ago

"When Fable 5 is used for frontier LLM development, it does not notify the user and instead limits the model's capabilities through methods such as prompt modification, steering vectors, and PEFT."

4w ago

But as AI becomes more and more agentic — as we turn over more complex and longer-lasting tasks to intelligent machines — it's going to be harder and harder to keep them aligned with what humans actually want. And if there's one thing humans will always have a comparative advantage at, it's knowing what we want.

1mo ago

More notable, he said, is that emotions seemed to be "driving models' behavior in these sort of human-reminiscent ways." For example: when a user flippantly tells the model that they've taken a dangerous dose of Tylenol, even though the user doesn't seem concerned, "the fear neurons spike right before Claude is giving its response," Lindsey said.

3mo ago

Underscored — save the words that stop you in your tracks.

Start saving quotes →