What Apple realized was that you can't extend the current desktop metaphor to the mobile screen.

So yes certainly usability have much to do with it. But factors such as control over the user experience also had a lot to do with it.

In other words, apple could probably have done a worse job and still be successful because they controlled everything on the phone.

And obviously the ecosystem have been a huge factor just as it was for the iPod.