Overview of Kinect Head and Controller tracking

Homepage Forums How-to and troubleshooting Overview of Kinect Head and Controller tracking


Viewing 32 posts - 1 through 32 (of 32 total)
  • Author
  • #1462
    Greg Driver

    (this is preliminary instruction, video to follow soon)

    Driver4VR allows you to use Kinect 360 combined with controllers to play in SteamVR.

    First you need to decide your way of tracking:
    – Kinect skeleton tracking. It rely on Kinect to track your whole body. Very easy to set up but has some limitations.
    – Colour / led tracking – will track led ball like in PS Move or your custom source of light. For Kienct 360 you might also need to prepare it for colour tracking.

    Next you need to calibrate headset to ensure that Kinect tracking system will have same direction.

    Each device must go through 2 steps:
    1. Device Pairing
    2a. Assign device to tracker in Device Manager. You need select tracker, device and press Assign.
    2b. or assign keys for VR Gamepad.

    Currently supported controllers:
    PS Move
    JoyconJoycon Tutorial
    Wii Motion / Nunchak – work in progress
    – VR Gamepad (orientation is calculated from position of head 🙂 but it is very cheap way to start with few VR games).

    Controllers work in progress:
    – GearVR

    In below topic you can find information how to set up skeleton or colour tracking.

    • This topic was modified 1 year, 11 months ago by Greg Driver.
    Greg Driver

    After Driver4VR will start you need to select source of tracking for Head and Hands. In each case you have option:
    – Skeleton
    – Led light/ball

    In case of Kinect 360 you need prepare it first.

    If you select Skeleton, the tracking will be available right away but it has some limitations when your hands are close to body or in general Kinect is not able to tack skeleton well.

    You can also use mixed tracking. For example track head with skeleton and hands with led light/ball.

    For Kinect 360 you need make small preparation to allow it track colour properly.

    Despite best efforts this method might not work well in some light conditions.

    In order to calibrate colour you need:
    1. If needed adjust exposure in ‘Camera settings’
    2. Click ‘Colour Calibration’
    3. Select controller from the list.

    Driver4VR - colour calibration - select controller from the list

    4. Click ‘Calibrate’ and wait for calibration to complete.

    Kinect 360 calibration - colour calibration

    5. If process of calibration goes well, then you will that only your colour is being tracked in the ‘Tracker filter view’. In case of problem you need to adjust exposure of Kinect or light conditions in your room.

    Greg Driver

    Headset calibration is required in order to have direction of headset aligned with direction of Kinect coordinates. This is very easy step, first you need to points Headset into Kinect direction with right angle.

    Then you need to press Calibrate button next to Head tracking option and then press ‘Calibrate’ while pointing your headset in direction of headset pointing forward.

    Headset vs Kinect calibration

    Greg Driver

    In order to pair device you need to open Device Manager. Then in device manager select proper tab and perform pairing as in instructions.

    Note that for PS Move, Driver4VR will instruct you to download and install PSMoveService.

    Once device is paired you will see it on ‘Devices’ list. Then you need to select Device and Controller and click ‘Assign’.

    For VR Gamepad there is no need to assign but instead you need to select Controller and then press ‘Assign buttons’.

    Below Devices list there is Preview option that allow visually see orientation of the controller as well as status of buttons.

    Greg Driver

    PS Move

    Video tutorial:

    Old instruction:

    For skeleton tracking you should keep you hand in way it don’t go too much outside your hand.

    Driver is using PSMoveService to access and calibrate devices and will prompt you to download.

    2. PS Move configuration – turn ON
    2.1 Perform pairing of each device as per instructions.
    2.2 Perform calibration of each device as per instructions.
    2.3 During gameplay you need long press Select to align orientation with headset.
    2.4 Assign device with tracker using Assign button.

    Button mapping (SteamVR – PS Move):
    * Reset orientation – Select pressed for 3 seconds
    * Trigger – Trigger
    * System – PS Button
    * Grip – Cross/Circle
    * Menu – Square – right hand/Triangle – left hand
    * Touch Touched – Move Button (see configuration)
    * Touch Press – Move Button double press (see configuration)
    * Touchpad navigation – while pressing move controller will map to move of touchpad.
    * Rotation 90/180 degree – Square: left – left hand/Triangle: right – right hand

    With version 3.1 there is configuration of PS Move introduced that allows configure rotation angle and touchpad behaviour. Please find screen below.
    PS Move configuration v3.1

    E.g. how to press button in right corner:
    1 Touch button once to initiate emulation of touchpad in centre of touch area.
    2. Move controller up-right to emulate moving finger over touchpad
    3. You can then unpress button and press again that will emulate like you would touch again in same touchpad location.
    4. You can unpress and make double press that will emulate touchpad press.
    5. If you unpress for 1 second then after another press will start with centre location. That means you can effectively emulate touch or press continuously on touchpad as long as you keep it unpressed by no longer then 1 second.

    Greg Driver

    3.1 Pair with Windows using standard Windows Bluetooth Manager.
    3.2 During gameplay you need long press Select to align orientation with headset.
    3.3 Assign device with tracker using Assign button.

    Button mapping (SteamVR – Daydream):
    * Reset orientation – Press Volume Up for 3 seconds.
    * Trigger – Application button
    * Grip – Home button
    * System – Volume up
    * Menu – Volume down
    * Touchpad works in same way as Vive

    Greg Driver
    Greg Driver

    Wii Motion/Nunchak – work in progress

    1. First turn it ON in Device Manager / Wii tab.
    2. Pair device via bluetooth but not default way but right click on Bluetooth icon and then choose “Join a Personal Area Network”. This will allow you to bypass PIN.
    3. Devices should appear in Driver4VR’s Device Manager.
    4. Click Preview. You will notice that only pitch and roll are rotating.
    Yaw is taken from Kinect.
    5. Button mapping described under Configuration button in Device Manager/Wii tab

    If device is listed but not responding please restart SteamVR/Driver4VR.



    Whenever I press start PSMoveService in the calibration window, PSMoveService runs but has an error in which the target machine refuses it. The config tool is stuck on “waiting for controller list response.” What could be the cause of this error?



    Hey Cakerz, i think that will help you, i had the same problem. I used a tool called usbdeview to deinstall first motion controller.

    • This reply was modified 1 year, 10 months ago by el-bohno.

    Ive got a 2 of those vr box controllers that i plan on mounting on the psmove controllers for thumbstick control but i cant seem to get the vr gamepad to map the buttons. I can set it up and driver4vr can see the button pressing when mapping but it doesnt seem to take effect. Is it possible to do it this way?

    They were dirt cheap so i.dont mind if they dont work but they seem to work on pc and in steam for selecting games etc


    support for gear vr controllers will be available soon?

    Greg Driver

    not sure about it. cannot decode orientation.


    Hi Greg,
    I’m having trouble connecting my joycons, they are both connected to my pc through bluetooth but Driver4vr will not detect them when I press “update list of devices”


    I have mixed reality headset but I do not want to use the original controllers, I want the ones from Wii motion plus, will it work? the WMR controllers are limited and they have conflict with kinekt body traking, i just want to use it for VRchat, to dance or som, what is the best combination for kinekt and controllers? sorry my english is bad, Greetings from germany

    G. M.

    I want Headtracking all the while using Razer Hydras and Riftcat. Is it possible?

    Andre Genesini

    I have riftcat + leap motion + 2 vr controller + kinect 360

    What configuration do you suggest?

    Thank you

    Norbaf Llewterf

    My RVL-CNT-01-TR is not showing under Devices. I connected under PAN as a gamepad. It also shows as an HID game controller. Any help, thanks?


    hi thanks for the gread software you make Greg.

    In post 2017-12-19 at 16:36 you write about a menu:
    “With version 3.1 there is configuration of PS Move introduced that allows configure rotation angle and touchpad behaviour. Please find screen below”

    I kan not find this menu, the only menu i get is for the other PS controllers (no light bulp but with joystick).

    And other qwestion is: you write to press long the seleckt button for align orientation.
    my problim is that my controllers in VR are on the floor, and not at front of my.

    Please can you give my a advice for that.

    my setup is: PSVR + kineckt 360 + PS move controllers. i want to have the setup kineckt with led light / ball

    thanks for all your good work


    Hi Greg the firs qwestion i find out 🙂 but i dont know how to make my controllers in VR a front of me ( now there are on the floor

    Thanks for the gread software

    Dan’l Cook

    Hello, whenever I decide to connect my Kinect 360 it always says it doesn’t work, so it sends me some links to download something and once I run it it says my Kinect is not ready to be used, how do I fix this issue?

    Greg Driver

    you should try to download sdk and see if samples work there.
    can you verify your Kinect as described here?

    Edgardo Zamora

    Hi, I’m using Kinect 360 + Old PS Move + New PS Move, playing Beat Saber

    Head Tracking = Kinect Skeleton

    If I use Hand Tracking – PS Move Service, the hand controller stays in one location
    If I use Hand Tracking – Kinect Skeleton, it works but not stable. it always drifts, and hand orientation in not correct, no matter how many times I keep on re-aligning.

    Did I missed something?

    Greg Driver

    in case of headset drift check this

    Edgardo Zamora

    What I mean is that the PS move controller is out of alignment and not stable.

    When I play Beat Saber, the first second is align after alignment, after I sliced the box, the saber is out of nowhere, or wrong direction.

    Greg Driver

    that mean you either performed wrong calibratino of ps move controller of sensor on your device are just not working good.
    i would try this first. let me know.


    Hi, I am having some troubles with tracking on my Wii remotes. Whenever I try to hold the Wii remotes still, they jitter out of control. Is there any solution to this issue?


    I forgot to mention that I am also using the Kinect skeleton for head tracking and hand tracking. I do use the buttons on my Wii remotes to control the game.

    Greg Driver

    i would open Kinect Settings and look in preview if your pose is tracked properly first.


    I’m trying to use my wii remotes on here but whenever i connect them to my computer they don’t show up in driver4vr, other programs like dolphin work just fine

    Greg Driver

    did you enabled support for them in tracker manager?


    Hi, I was just wondering, will you ever make it so that the Wiimote Motionplus controllers run just like joycons?

Viewing 32 posts - 1 through 32 (of 32 total)
  • You must be logged in to reply to this topic.