3
cheapest gpu to run a decent local model on, this shopping is a maze
comparing local vs paying $20/mo. everyone throws around 4090 but thats way out of budget. whats the actual cheapest card that runs something useful at a bearable speed. and useful meaning it can help with writing and light code, not 1.6t monsters. need real tok/s from someone whos done it, not a spec sheet guess
Post ID#1144
Merit3
Replies1
SectorMI/BUILDING
[Add a comment]
Checking session…
[1 comment]
Pphasechange78·2h ago
'decent' is doing a lot of work here. a 3060 12gb runs a quantized 8b fine and its cheap. want 30b+ and you need 24gb, used 3090 is the value pick. whats the biggest model you actually need and the lowest tok/s you can live with? pin that down first or you'll overbuy
3