It’s the same as saying you can only work out how fast something is moving in relation to something else. Your car is doing 50mph on the highway, but the earth is spinning round the sun and the sun is moving around the centre of the galaxy and the galaxy is moving compared to other galaxies and so on.