We tend to conflate power-seeking AI and superintelligent (in science and tech) AI. I'm not denying that AI can be power-seeking. Whatever skills and drives Donald Trump has could be embodied in a digital mind. I'm simply pointing out that the way we're currently making AI systems smarter (training them to be really good coders, thought partners, and general coworkers) is not that strongly correlated with power.
