We have to trust the hardware manufacturer (Intel/AMD/NVIDIA) designed their chips to execute the instructions we inspect, so we're assuming trust in vendor silicon either way.
The real benefit of confidential computing is to extend that trust to the source code too (the inference server, OS, firmware).
Maybe one day we’ll have truly open hardware ;)
Isn't this not the case for FHE? (I understand that FHE is not practically viable as you guys mention in the OP.)
Yeah not the case for FHE. But yes, not practically viable. We would be happy to switch as soon as it is.
Hi Nate. Routinely your various networking-related FOSS tools. Surprising to see you now work in the AI infrastructure space let alone co-founding a startup funded by YC! Tinfoil looks über neat. All the best (:
> Maybe one day we'll have truly open hardware
At least the RoT/SE if nothing else: https://opentitan.org/
Love Open Titan! RISC-V all the way babe! The team is bunker: several of my labmates now work there