The only way of leaving seats empty is to win them and refuse to take them up. E.g. Sinn Fein regularly gets MP's, but their MP's refuse to take an oath of loyalty to the queen out of principle, and so they can't take up their seats (though they can now use their House of Commons offices and get financial support for their office; previously that too required an oath of loyalty).