Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Model inference compute over model lifetime is ~10x of model training compute now for major providers. Expected to climb as demand for AI inference rises.


For sure and growth also costs money for buying DCs etc.


They are constantly training and getting rid of older models, they are losing money


Which part of "over model lifetime" did you not understand?


That's not a sufficient condition for profitability if both inference and scaling costs continue to increase over time.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: