Welcome • User Guide
ToS • Privacy • Canary
Donate • Bugs • License

©2025 Poal.co

130

Yeah... I am currently in the process of re-designing my homeLab to also have AI compute and to increase the amount of RAM per node while still trying to not make it dump insane amounts of heat or add a extra $300/mo to my power bill. Ill probably be posting a lot more to this sub in the near-ish future as I come up with things and maybe want to bounce ideas off others.

Archive: https://archive.today/s9H4l

From the post:

>After years of self-hosting on a VPS in a datacenter, I’ve decided to move my services at home. But instead of just porting services, I’m using this as an opportunity to migrate to a more flexible and robust set up. I will deploy services on a single mini pc. Since I need to be able to experiment and learn without disrupting my services, I will need to be able to spin up Virtual Machines (VMs). Let’s explore how I deployed Proxmox Virtual Environment on a safe host for my specific needs as a homelabber, and how I automated as much of it as possible. In a follow-up post we will explore how to spin-up and configure VMs in a reproducible way on that setup.

Yeah... I am currently in the process of re-designing my homeLab to also have AI compute and to increase the amount of RAM per node while still trying to not make it dump insane amounts of heat or add a extra $300/mo to my power bill. Ill probably be posting a lot more to this sub in the near-ish future as I come up with things and maybe want to bounce ideas off others. Archive: https://archive.today/s9H4l From the post: >>After years of self-hosting on a VPS in a datacenter, I’ve decided to move my services at home. But instead of just porting services, I’m using this as an opportunity to migrate to a more flexible and robust set up. I will deploy services on a single mini pc. Since I need to be able to experiment and learn without disrupting my services, I will need to be able to spin up Virtual Machines (VMs). Let’s explore how I deployed Proxmox Virtual Environment on a safe host for my specific needs as a homelabber, and how I automated as much of it as possible. In a follow-up post we will explore how to spin-up and configure VMs in a reproducible way on that setup.
You are currently inside a comment thread.
Click here to see all the comments (3).
[–] • 1 pt

Yeah, As much as I want 100% local only there is a huge cost of entry and the hardware will already be out of date and slower. Now, if you are willing to have the model run slower it might not be such a big deal but I have also read that it screws with the accuracy based on how much you can have loaded at a time...

It is a huge trade off. Though, with how things tend to go with hardware I am willing to be in about a year we might be able to get some used hardware for "cheap" compared to what it would cost even if it's a power hog.