The cursor color inversion can't be done with CSS though.
Use a different colored image.
The background colour of the hovered element is known. When you specify the bgcolor, also override the cursor image.
I am pretty sure it is doable in CSS.