Well, AI might ask you to choose a color. Now, is it better to show a color picker UI or just ask for the name?
You might say naming the color is enough, but in reality, a color picker is the more natural way to interact.
As humans, we don’t communicate only through words. Other forms of interaction matter too.
Yes but the AI is not creating these components from zero is it (on demand part)?
It will probably have access to a list of components with their specifications, especially the type of data that the components allow to mutably (or not) represent.
Or respond to a query from a database by presenting a graph automatically.
But the hard part is to turn natural language into a sql query in my opinion. It's not really the choice of data representation which is heavily informed by the data itself (type and value) and doesn't require much inference.