A much easier way would be to refuse to ship to an address that's not already active in your address book. If you really need to ship to another address, it's not too much to ask that you go through the full account recovery process and enter the new address (which will prompt you to re-enter your credit card number).