Hello! I just discovered Umbrel… I must say I’m in love with it! I am looking to replace current ollama instance with Umbrel, but I’m having trouble installing NVIDIA Drivers to allow the ollama container to access the GPUs in the VM. I’ve spent some time on it, and come up dry. I have ollama and openwebui working on an ubuntu VM with nvidia container toolkit and cuda drivers; I’m assuming that’s possible with Umbrel as well? It seems like it would be desirable by others also, as the local LLM being cpu bound is painfully slow. Thanks in advance for any and all help!
Olha eu segui esse passo a passo aqui