Surely not that mysterious - the adulterants added processed foods in order preserve it longer for the shelf, disguise the looks, mask the taste or simply bulk it out for max profit generally do not provide additional nutritional value
Simply not providing nutritional value would be neutral from health perspective. We are looking for something that provides negative effects, either direct (something toxic) or indirect (like causing us to eat more which causes obesity...).