koakuma-chan 2 days ago

This is not a real world goal though because a real world user would just rent a GitHub Copilot or similar.

2
fxtentacle 2 days ago

Unless, of course, NDAs prevent you from using outside cloud compute. I'm benchmarking possible on-prem solutions because I know that I'll need an on-prem AI. But yeah, I'm not a normal user.

tmpz22 1 day ago

Prices keep going up, if you're getting value from LLMs it is valuable expertise to be able to self-host. Right now everything is VC subsidized and so cost-benefit-analysis is warped.