Very cool! I made a similar thing[1], but I didn't put as much attention on the controls or the camera concept. I had hoped to gain some intuitive understanding of 4D space, but in the end I did not succeed.
How did you do collision detection and physics here?
1. https://beaumayns.github.io/box4d/