Don't have a horse in this race but it sounds like having the Yubikey on the phone "cord" would also solve this problem.