Agreeing on a kernel ABI? ha ha not gonna happen :D
There are open source drivers. Only on nvidia they (nouveau) are seriously worse than the proprietary ones. For Intel GPUs, the open source driver is the only driver. For AMD, there are some proprietary drivers but they are becoming obsolete, the fully open amdgpu stack is getting better and better all the time.
Even better if there were open-source drivers, but you know, baby steps.