What privacy benefit do you get running this locally vs renting a baremetal GPU ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		onlyrealcuzzo 10 months ago \| parent \| context \| favorite \| on: How to Run DeepSeek R1 671B Locally on a $2000 EPY... What privacy benefit do you get running this locally vs renting a baremetal GPU and running it there? Wouldn't that be much more cost-effective? Especially when you inevitably want to run a better / different model in the near future that would benefit from different hardware? You can get similar Tok/sec on a single RTX 4090 - which you can rent for <$1/hr.

randomjoe2 10 months ago [–]

But at a totally different quant, you're crazy if you think you can run the entire R1 model on a single 4090, come on man. Apples and oranges.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact