Hi! I’m running deepseek-r1 in ollama via podman, but currently it all runs on cpu. From the podman docs I get that I should install the nvidia container toolkit to get this working on my gpu, however I’m not sure how to approach this. The docs talk about apt or dnf etc, byt as far as I know that doesnt apply to bazzite. Anyone have some experience with this?
Will this work if I install the container toolkit in a busybox, or should i then just install everything including docker/podman in busybox? Any insights are greatly appreciated!
You must log in or register to comment.