More specifically, make sure that you aren't forwarding your ssh keys; otherwise the game can impersonate you on any server the keys work on.
Ah, that's worse than a mere privacy issue! Good point.
I was thinking merely about anonymity.
Both can be largely eliminated by having per host or per organization Identities and using IdentitiesOnly.