you should calibrate headset with kinect.
depending on headset you have you might ensure it will start with same position.
for example dk2 when I always start facing kinect I don’t need calibrate it each time. for rift you can reset orientation in known direction.
i am looking for ways to improve it.