Wow, this is nice. I don't know, but is it possible for us to study code for this? I would love to see how all of this is built.
I can understand you might have commercial obligation, so hoping Netlify can make this public :)
I would check out react three fiber if you want to see how people are building things like this. It essentially brings a component model to three js development and creates good standards for sharable code since things are just react hooks.
Rapier was brand new when I was making things in R3F 2 years ago. Glad to see how mature it’s gotten!