underscored

@underscored

1 clip · 1 follower

Follow
Tag:llm-evaluationClear

LLM-as-judge evals are too generous and cluster toward the middle of the scale. Claire had both GPT-5.5 and Opus 4.8 judge the outputs, and neither was spiky enough. They missed things she flagged immediately on a visual pass, like broken prototypes and ignored wireframe constraints. Models can't yet see what the human eye catches in the first screenshot.

Lenny Rachitsky
1w ago

Underscored — save the words that stop you in your tracks.

Start saving quotes →