> NVIDIA will have a persistent hardware advantage
I think it probably has more to do with CUDA. The reason Python is the undisputed champion in AI and ML isn't because Python is a better, more performant programming language so much as because ecosystem of software in the AI/ML space is extremely concentrated, dense, and rich in the Python ecosystem compared to Java, Go, or C#.
Likewise, it seems like NVDAs advantage isn't even necessarily the hardware but the suite of tools and software that are built up to take advantage of that hardware.
It's definitely not CUDA advantage. If you can get Pytorch/flash attention/triton well supported in any hardware, a huge chunk of client don't care if it means cost saving. Case in point Google's TPU had extensive usage outside Google when they were cheaper for the same performance. Now that isn't the case.