Memory reclamation really useful if you are using Ollama or similar in WSL2 - after awhile, Ollama will unload the model and WSL2 will give the memory back to the OS
Yeah I really wish ollama didn't do that. I tried several ways to make it keep the model in memory like an environment variable but I've so far failed.
Yeah I tried all those things. Especially the middle one. Because that's how I use it mostly. I added the environment variable to the systemd service. But it still removes it after 5 minutes. Very weird.
WSL is still very broken on Windows on ARM for any cpu intensive workloads. With the push to popularize this platform, I really hope some attention finally gets paid to the various RCU stall bugs that have been reported and ignored.