I have already followed @NetworkChucks Guide to host ALL your AI locally and now I want to try two more projects since I have dipped my toes in. @VirtulizationHotto has a guide for the Proxmox cluster flavor here # Host a Private AI Server at Home with Proxmox Ollama and OpenWebUI and I am going to watch that and follow it maybe. Then I am going to try to tackle the Azure Local one on my own. I only have the one virtual node, but you can run AKS on it so it should work. I have to see how well and what challenges I face with that. Another thing I need to figure out for that is the networking. They use flannel by default, but I may try Calico…I think I also need a reverse proxy instead of just my VPN to have access externally outside of Tailscale. But that is it for this weekend I think. I should hopefully have a writeup on it soon and I can share my experiences.
Learning all the things