Is https://github.com/Samsung/ENNDelegate enough or is it TFLite/LiteRT only?

There's a MIG vGPU mode usable for this

Have you used it? How does it work? How do you drive it? We tried a lot of different things. Is it not paravirtualized, the way vGPUs are?

It works with SR-IOV instead of mdev afaik

Still needs some host SW to drive it but actually does static partitioning

IIRC it's usable through using the MIG-marked vGPU types

Notably, ConnectX-8 already has 200G PAM4 for 800G as a single port - and uses it for Infiniband.

Looks like it is so because it pre-dates 800G Ethernet ratification...

Not for prompt processing. Current Macs are really not great at long contexts

The specialty DRAM vendors (Nanya notably) will keep making DDR4 and earlier

Regular Hyper-V VMs can use it too but it's not well documented.

The keyword to search for: "GPU-P"

https://learn.microsoft.com/en-us/windows-server/virtualizat...

_Current_ phone platforms still use Gunyah.

See qebspil for filling the gap for the EL2 side

Didn't ship externally/OEMs didn't take it, but the CRDs had the option.

The prototype impl at the time broke some Windows functionality

Fedora boots ootb