Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Running agentic loops doesnt mean just being able to execute them. When your llm is so slow that you are faster writing the code yourself with free gemini that comes with google account, local llm is no longer worth it. Tok/sec is everything.

And 3090 is $1500 used, and 24gb gb of ram. 3x is $4500 for 72gb of ram.



> When your llm is so slow that you are faster writing the code yourself

I have never had that issue, and LLMs are used for more than just code generation.

> And 3090 is $1500 used

Second hand Macs are also cheaper.

Not sure what your point is, but you just seem to arguing because of your hatred of Macs.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: