Scaling laws work capabilities keep keep jumping but our ability to have alignment and safety assurance just be built in seems not there. um maybe never going to be there if that is the case then what do we do so then you got to come outside the model.
You might also like
His research has produced some of the most striking findings in the field: that models form general representations of concepts, plan many tokens ahead without stating those plans explicitly, and may exhibit something structurally similar to the distinction between conscious and unconscious processing in humans.
Lenny Rachitsky
The canonical evidence of polysemanticity and superposition that convinced much of the field, including me, that networks pack concepts arbitrarily was misread. What looked like arbitrary packing was mostly a motif I'll call recursive generalization, which is much less concerning. This means we can study networks directly, instead of first untangling them. Neural networks are already clean.
Nick Cammarata
Powerful AI models continue to cause chaos, but their targets aren't widely seeking justice. Instead, they're being encouraged to adopt those same tools.
Paresh Dave