> Can humans want things?
Yes. Do I have to prompt you? Or do you exist on your own?
> Our reward structures sure seem aligned in a manner that encourages anthropomorphization.
You do understand what that word /means/?
> are symptoms of imperfect data
Which means humans cannot generate perfect data. So good luck with all that high priced "training" you're doing. Mathematically errors compound.
> Yes. Do I have to prompt you? Or do you exist on your own?
I've gone through a significant amount of prompting and training, much of which has been explicitly tailed at understanding and addressing my biases. We all do; we certainly don't exist in isolation!
> You do understand what that word /means/?
Yes, what's the confusion? Analogy is a very powerful tool.
> Which means humans cannot generate perfect data.
Totally agree, nothing can possibly access perfect data, but surely that makes training all the more important?