Proposing this in 2025. While probably knowing about this problem since Chrome was released (2008).
Why not treat any local access as if it were an access to a microphone?
I would love for someone with more knowledge to opine on this, because, to me, it seems like it would actually be the most sane default state.