This is a great index of algorithms for drawing trees:
https://treevis.net/
The paper for "Space-Reclaiming Icicle Plot (2020)" looks like it's going into the right direction. A space-reclaiming tree layout would be even better.