Well it does have some priors baked into it by the (convolutional) architecture of the network. See the “deep image prior” project for a feel for just how strong this convolutional prior is.