The only way to guarantee privacy in cloud computing is via homorphic encryption.
This approach relies too much on trust.
If you have data you are seriously sensitive about, its better for you to run models locally on air gapped instances.
If you think this is an overkill, just see what happened to coinbase of recent. [0]
[0]: https://www.cnbc.com/2025/05/15/coinbase-says-hackers-bribed...
Yeah, totally agree with you. We would love to use FHE as soon as it's practical. And if you have the money and infra expertise to deploy air gapped LLMs locally, you should absolutely do that. We're trying to do the best we can with today's technology, in a way that is cheap and accessible to most people.
> The only way to guarantee privacy in cloud computing is via homorphic encryption
No. The only way is to not use cloud computing at all and go on-premise.
Which is what companies around the world do today for security or privacy critical workloads.
> The only way is to not use cloud computing at all and go on-premise.
This point of view may be based on a lack of information about how global finance handles security and privacy critical workloads in high-end cloud.
Global banks and the CSPs that serve them have by and large solved this problem by the late 2010s - early 2020s.
While much of the work is not published, you can look for presentations at AWS reInvent from e.g. Goldman Sachs or others willing to share about it, talking about cryptographic methods, enclaves, formal reasoning over not just code but things like reachability, and so on, to see the edges of what's being done in this space.