You sure do like moving the goalposts, don't you? So you grok this all so well but can't offer a solution? Not really making a good case for why we should listen to you on this issue. Earlier, you said: From reading your argument, you seem to have totally internalized its underlying assumptions, but skip over the part where you support them. Why will it be military AI? How will ISIS or some other such group have access to it? Why will their version be able to defeat one developed in the US? Why would an AGI do what they tell it to (or us for that matter)? Also, you still haven't answered my earlier comment asking why you think you've said anything many of us haven't already thought about.when you truly grok that about AI and AGI, you'll be the same as me; horrified beyond belief.
There IS NO SOLUTION -- so we have to think differently, and maybe -- maybe -- we can come up with something meaningful.
It's really ANI for the military case, not AGI, but that does not mean it can kill us very effectively. It can and it will.