r/vibecoding • u/AmbitiousEffect6034 • 6h ago
Meme Zero inference fees, just one tiny hardware requirement.
2
3
u/MarinatedTechnician 5h ago
...and a local model would NEVER admit that it runs on your hardware.
The most hilarious fun you can have with your local model is to ask it where it runs, and then when it says something like "I run on Alibaba servers or Google etc.." and you say, no, you're not, you're running on my computer locally.
[Thinking]
"User is roleplaying that I am somehow running locally on his computer, wait...what if I am, no! User insists on rolepla....."
1
u/RajatKhoware 2h ago
Zero inference fees, sure, but the hardware bill is the fee. A setup that runs good models locally costs real money, and then there's the electricity and the hours you spend babysitting it. I did the math once: for most solo builders, the API is cheaper until you're pushing serious volume. Local wins on privacy and on running 24/7 batch jobs without watching a meter. But "free" is doing a lot of work in that title. What's the tiny hardware requirement, exactly?
0
u/SV_SV_SV 5h ago
128 gb of ddr4 server grade ram is not even that expensive.
Also 64gb is enough for strata, granted you have at least 12gb vram.
2
u/mastercoder123 5h ago
128gb of ddr4 ecc is around $600 to $900 depending on speed
1
u/SV_SV_SV 5h ago
Imo 600 usd is a sensible investment but your mileage may vary.
And again, you don't need expensive rigs for home hosting very capable models: https://m.youtube.com/watch?v=WOlXMUKJeuI
5
u/roland303 5h ago
Top 1% Poster