I've done this. It doesn't work for some third party shippers who claim to ship immediately (cancel option removed) even if they don't.