XMP is technically overclocking, nothing inherently safe about it. I've had new dual channel kits fail memtest at XMP settings on Ryzen, it seemed to depend almost entirely on what the individual CPUs memory controller was capable of.

Maybe the situation is better on DDR5 platforms.