Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

If you are running lightweight models like deepseek 32B. But anything more and it’ll drop. Also, costs have risen a lot in the last month for RAM and AI adjacent hardware. It’s definitely not 2k for the rig needed for 50 tokens a second




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: