yes. this is very interesting compromise to just have button. but on other hand it will be hard to maintain too many buttons for specific cases.
can u tell what is your kinect version? do you rotate 360 degree with kinect or only front facing? when it is shaking most?
i tested recently and I had quite decent results so would like know how you use it better.