NemoNobody 2 days ago

Moore's law is still going as far I'm aware - there may have been clarification of sorts recently but that's kept up exponentially rather well despite everyone knowing that it can't do that.

1
lolinder 2 days ago

Moore's law would improve the speed of LLMs and improve their size, but in recent weeks [0] it's become apparent that we're hitting the limit of "just make them even bigger" being a viable strategy for improving the intelligence of LLMs.

I'm excited for these things to get even cheaper, and that will enable more use cases, but we're not going to see the world-changing prophesies of some of AI's evangelists in this thread come true by dint of cheaper current-gen models.

[0] https://news.ycombinator.com/item?id=42125888