"How does it make sense to have 2 different units of time in there?"
This way it's easier to calculate how much energy your appliances uses. For example, if your vacuum cleaner is 1000W (1kW), running it for an hour will use 1kWh of energy which cost you can clearly see on your electricity bill. Unless you also want to re-lable all appliances, electric engines etc. in joules.. Sure, joule makes much more sense in physical calculations.
This way it's easier to calculate how much energy your appliances uses. For example, if your vacuum cleaner is 1000W (1kW), running it for an hour will use 1kWh of energy which cost you can clearly see on your electricity bill. Unless you also want to re-lable all appliances, electric engines etc. in joules.. Sure, joule makes much more sense in physical calculations.