https://seunghoonchoi.com/tags/alignment/Recent content in Alignment on Seunghoon ChoiHugoen-USSun, 21 Jun 2026 19:30:00 +0900https://seunghoonchoi.com/column/why-would-agi-obey/Sun, 21 Jun 2026 19:30:00 +0900https://seunghoonchoi.com/column/why-would-agi-obey/<p><img src="https://seunghoonchoi.com/images/col-why-would-agi-obey.jpg" alt="Chess pieces set out on a board in a stone-walled room, under light from a window"></p> <p class="inline-image-caption">What is scarier in the AGI debate is not the hostility, but the possibility that the system may continue to operate even after humans are no longer needed.</p> <p>One question wouldn&rsquo;t leave my head. An AGI overwhelmingly smarter and stronger than humans: why on earth would it obey us? After digging for a while, the answer I came back with was a little deflating. There&rsquo;s no reason it would. And the more I chewed on it, the more that empty feeling started to seem obvious.</p>