You'll never get back where you started since most cars are parked in front of an office / house / whatever 95% of the time using space for no reason whereas taxis are always moving.
Moving cars are the problem, since they are what causes congestion and accidents. Cars sitting in parking garages don't run over people or cause traffic jams.
What you gain in parking, you lose in congestion. Now most trips are 'deadheading' where the trip to pick up the passenger is as long as the trip the passenger wants to take. Doubles traffic, approximately?