Running agentic loops doesnt mean just being able to execute them. When your llm is so slow that you are faster writing the code yourself with free gemini that comes with google account, local llm is no longer worth it. Tok/sec is everything.
And 3090 is $1500 used, and 24gb gb of ram. 3x is $4500 for 72gb of ram.
And 3090 is $1500 used, and 24gb gb of ram. 3x is $4500 for 72gb of ram.