That's why it's so important to reduce all of your personal data points online. Imagine what they can reconstruct based on their modeling and comparing you to similar users. I have 60 years of involuntary data collection ahead of me. This is not going to be fun.
Yes, full agree. I also think there is a future in personal memetic firewalls that will filter ideas before they hit our wetware and filter our tics and habits that uniquely identify us on the way out. Such a firewall would need to be much smarter than we are, but not necessarily as smart as the smartest ai trying to 'attack'. It would have perfect knowledge of its user, and as such possess information assymetry.