The most interesting piece of this puzzle to me is initiatives like MirageOS, which let you run your application very close to the metal—you give up a lot of convenience when you dump the traditional OS, but you give up a lot of inefficiency, too.
Even if you make particularly efficient code, the giant tower of abstractions we all operate on top of make running your code dozens of times slower than it could possibly be running on bare metal.