Does the fact that you can arbitrarily “jailbreak” AI with increasingly sophisticated abilities ring any alarm bells?

Imagine being able to “jailbreak” nuclear warheads. If this were the case, nobody would develop or deploy them.