PSA: I picked a local model over a cloud API and I regret nothing
Everyone in this space keeps saying cloud is the only way to go, and I just don't buy it anymore. Back in March I had to pick between running an open model on my own machine or paying for an API, and I went local. I dropped about $900 on a used workstation with 24GB of VRAM here in Phoenix, and honestly my setup runs circles around what I was paying $60 a month for. The first two weeks were rough, I'll admit that, mostly driver issues on Linux. But once I got it humming I could tweak prompts without watching a meter tick up, and my data stays on my own desk. Yes the cloud models are smarter on the hard stuff, but for what I'm doing, local won. If you've been on the fence, what's actually stopping you from trying it on your own hardware?