i can clearly see on video that problem happens when orange light goes away because you hide it with other controller or part of the body.
kinect 360 has very narrow range compared to On.e
i have my kinect on 2m height pointing down with maximum angle. then we have most chance to avoid situation that one or other controller is hidden by hand.