We do have to trust the chip maker until open hardware catches up [1].
Even if you had open hardware, how would you even know a chip you have sitting in front of you was fabricated correctly?
Check out incredible work by Bunnie to make this possible at home https://www.bunniestudios.com/blog/2024/iris-infra-red-in-si...