Nope. Plenty of countries where you can be out and about in public without any id at all (e.g. the UK). Even in Germany (which is pretty strict relative to other countries I've been in) it's legal to leave your passport in your hotel, although you risk having the police escort you back there to show it to them.