What you refer to is commonly called a navigation mesh: https://en.wikipedia.org/wiki/Navigation_mesh
Conceptually yes, thanks! But it seems like my implementation is more basic than that. I'm only using the graph part so to speak, because of other constraints.