Overview of Kinect Head and Controller tracking

Homepage Forums How-to and troubleshooting Overview of Kinect Head and Controller tracking

This topic contains 28 replies, has 14 voices, and was last updated by  Greg Driver 1 month, 1 week ago.

Viewing 29 posts - 1 through 29 (of 29 total)
  • Author
    Posts
  • #1462

    Greg Driver
    Keymaster

    (this is preliminary instruction, video to follow soon)

    Driver4VR allows you to use Kinect 360 combined with controllers to play in SteamVR.

    First you need to decide your way of tracking:
    – Kinect skeleton tracking. It rely on Kinect to track your whole body. Very easy to set up but has some limitations.
    – Colour / led tracking – will track led ball like in PS Move or your custom source of light. For Kienct 360 you might also need to prepare it for colour tracking.

    Next you need to calibrate headset to ensure that Kinect tracking system will have same direction.

    Each device must go through 2 steps:
    1. Device Pairing
    2a. Assign device to tracker in Device Manager. You need select tracker, device and press Assign.
    2b. or assign keys for VR Gamepad.

    Currently supported controllers:
    PS Move
    Daydream
    JoyconJoycon Tutorial
    Wii Motion / Nunchak – work in progress
    – VR Gamepad (orientation is calculated from position of head 🙂 but it is very cheap way to start with few VR games).

    Controllers work in progress:
    – GearVR

    In below topic you can find information how to set up skeleton or colour tracking.

    • This topic was modified 1 year, 6 months ago by  Greg Driver.
    #1463

    Greg Driver
    Keymaster

    After Driver4VR will start you need to select source of tracking for Head and Hands. In each case you have option:
    – Skeleton
    – Led light/ball

    In case of Kinect 360 you need prepare it first.

    If you select Skeleton, the tracking will be available right away but it has some limitations when your hands are close to body or in general Kinect is not able to tack skeleton well.

    You can also use mixed tracking. For example track head with skeleton and hands with led light/ball.

    For Kinect 360 you need make small preparation to allow it track colour properly.

    Despite best efforts this method might not work well in some light conditions.

    In order to calibrate colour you need:
    1. If needed adjust exposure in ‘Camera settings’
    2. Click ‘Colour Calibration’
    3. Select controller from the list.

    Driver4VR - colour calibration - select controller from the list

    4. Click ‘Calibrate’ and wait for calibration to complete.

    Kinect 360 calibration - colour calibration

    5. If process of calibration goes well, then you will that only your colour is being tracked in the ‘Tracker filter view’. In case of problem you need to adjust exposure of Kinect or light conditions in your room.

    #1466

    Greg Driver
    Keymaster

    Headset calibration is required in order to have direction of headset aligned with direction of Kinect coordinates. This is very easy step, first you need to points Headset into Kinect direction with right angle.

    Then you need to press Calibrate button next to Head tracking option and then press ‘Calibrate’ while pointing your headset in direction of headset pointing forward.

    Headset vs Kinect calibration

    #1470

    Greg Driver
    Keymaster

    In order to pair device you need to open Device Manager. Then in device manager select proper tab and perform pairing as in instructions.

    Note that for PS Move, Driver4VR will instruct you to download and install PSMoveService.

    Once device is paired you will see it on ‘Devices’ list. Then you need to select Device and Controller and click ‘Assign’.

    For VR Gamepad there is no need to assign but instead you need to select Controller and then press ‘Assign buttons’.

    Below Devices list there is Preview option that allow visually see orientation of the controller as well as status of buttons.

    #1473

    Greg Driver
    Keymaster

    PS Move

    Video tutorial:

    Old instruction:

    For skeleton tracking you should keep you hand in way it don’t go too much outside your hand.

    Driver is using PSMoveService to access and calibrate devices and will prompt you to download.

    2. PS Move configuration – turn ON
    2.1 Perform pairing of each device as per instructions.
    2.2 Perform calibration of each device as per instructions.
    2.3 During gameplay you need long press Select to align orientation with headset.
    2.4 Assign device with tracker using Assign button.

    Button mapping (SteamVR – PS Move):
    * Reset orientation – Select pressed for 3 seconds
    * Trigger – Trigger
    * System – PS Button
    * Grip – Cross/Circle
    * Menu – Square – right hand/Triangle – left hand
    * Touch Touched – Move Button (see configuration)
    * Touch Press – Move Button double press (see configuration)
    * Touchpad navigation – while pressing move controller will map to move of touchpad.
    * Rotation 90/180 degree – Square: left – left hand/Triangle: right – right hand

    With version 3.1 there is configuration of PS Move introduced that allows configure rotation angle and touchpad behaviour. Please find screen below.
    PS Move configuration v3.1

    E.g. how to press button in right corner:
    1 Touch button once to initiate emulation of touchpad in centre of touch area.
    2. Move controller up-right to emulate moving finger over touchpad
    3. You can then unpress button and press again that will emulate like you would touch again in same touchpad location.
    4. You can unpress and make double press that will emulate touchpad press.
    5. If you unpress for 1 second then after another press will start with centre location. That means you can effectively emulate touch or press continuously on touchpad as long as you keep it unpressed by no longer then 1 second.

    #1474

    Greg Driver
    Keymaster

    Daydream
    3.1 Pair with Windows using standard Windows Bluetooth Manager.
    3.2 During gameplay you need long press Select to align orientation with headset.
    3.3 Assign device with tracker using Assign button.

    Button mapping (SteamVR – Daydream):
    * Reset orientation – Press Volume Up for 3 seconds.
    * Trigger – Application button
    * Grip – Home button
    * System – Volume up
    * Menu – Volume down
    * Touchpad works in same way as Vive

    #3037

    Greg Driver
    Keymaster
    #3039

    Greg Driver
    Keymaster

    Wii Motion/Nunchak – work in progress

    1. First turn it ON in Device Manager / Wii tab.
    2. Pair device via bluetooth but not default way but right click on Bluetooth icon and then choose “Join a Personal Area Network”. This will allow you to bypass PIN.
    3. Devices should appear in Driver4VR’s Device Manager.
    4. Click Preview. You will notice that only pitch and roll are rotating.
    Yaw is taken from Kinect.
    5. Button mapping described under Configuration button in Device Manager/Wii tab

    If device is listed but not responding please restart SteamVR/Driver4VR.

    #4021

    Cakerz
    Participant

    Hello,

    Whenever I press start PSMoveService in the calibration window, PSMoveService runs but has an error in which the target machine refuses it. The config tool is stuck on “waiting for controller list response.” What could be the cause of this error?

    Thanks.

    #4024

    el-bohno
    Participant

    Hey Cakerz, i think that will help you, i had the same problem. I used a tool called usbdeview to deinstall first motion controller.

    • This reply was modified 1 year, 5 months ago by  el-bohno.
    #4413

    cretkensigh
    Participant

    Ive got a 2 of those vr box controllers that i plan on mounting on the psmove controllers for thumbstick control but i cant seem to get the vr gamepad to map the buttons. I can set it up and driver4vr can see the button pressing when mapping but it doesnt seem to take effect. Is it possible to do it this way?

    They were dirt cheap so i.dont mind if they dont work but they seem to work on pc and in steam for selecting games etc

    #4593

    vebmine
    Participant

    Hi!
    support for gear vr controllers will be available soon?

    #4594

    Greg Driver
    Keymaster

    @vebmine
    not sure about it. cannot decode orientation.

    #4673

    WingedWhite
    Participant

    Hi Greg,
    I’m having trouble connecting my joycons, they are both connected to my pc through bluetooth but Driver4vr will not detect them when I press “update list of devices”

    #4732

    ZeroZed
    Participant

    I have mixed reality headset but I do not want to use the original controllers, I want the ones from Wii motion plus, will it work? the WMR controllers are limited and they have conflict with kinekt body traking, i just want to use it for VRchat, to dance or som, what is the best combination for kinekt and controllers? sorry my english is bad, Greetings from germany

    #4914

    G. M.
    Participant

    I want Headtracking all the while using Razer Hydras and Riftcat. Is it possible?

    #5006

    Andre Genesini
    Participant

    Hi
    I have riftcat + leap motion + 2 vr controller + kinect 360

    What configuration do you suggest?

    Thank you

    #5641

    Norbaf Llewterf
    Participant

    My RVL-CNT-01-TR is not showing under Devices. I connected under PAN as a gamepad. It also shows as an HID game controller. Any help, thanks?

    #5824

    nonaak
    Participant

    hi thanks for the gread software you make Greg.

    In post 2017-12-19 at 16:36 you write about a menu:
    “With version 3.1 there is configuration of PS Move introduced that allows configure rotation angle and touchpad behaviour. Please find screen below”

    I kan not find this menu, the only menu i get is for the other PS controllers (no light bulp but with joystick).

    And other qwestion is: you write to press long the seleckt button for align orientation.
    my problim is that my controllers in VR are on the floor, and not at front of my.

    Please can you give my a advice for that.

    my setup is: PSVR + kineckt 360 + PS move controllers. i want to have the setup kineckt with led light / ball

    thanks for all your good work

    #5825

    nonaak
    Participant

    Hi Greg the firs qwestion i find out 🙂 but i dont know how to make my controllers in VR a front of me ( now there are on the floor

    Thanks for the gread software

    #5993

    Dan’l Cook
    Participant

    Hello, whenever I decide to connect my Kinect 360 it always says it doesn’t work, so it sends me some links to download something and once I run it it says my Kinect is not ready to be used, how do I fix this issue?

    #6035

    Greg Driver
    Keymaster

    you should try to download sdk and see if samples work there.
    can you verify your Kinect as described here?

    #10987

    Edgardo Zamora
    Participant

    Hi, I’m using Kinect 360 + Old PS Move + New PS Move, playing Beat Saber

    Head Tracking = Kinect Skeleton

    If I use Hand Tracking – PS Move Service, the hand controller stays in one location
    If I use Hand Tracking – Kinect Skeleton, it works but not stable. it always drifts, and hand orientation in not correct, no matter how many times I keep on re-aligning.

    Did I missed something?

    #11018

    Greg Driver
    Keymaster

    in case of headset drift check this

    #11025

    Edgardo Zamora
    Participant

    What I mean is that the PS move controller is out of alignment and not stable.

    When I play Beat Saber, the first second is align after alignment, after I sliced the box, the saber is out of nowhere, or wrong direction.

    #11042

    Greg Driver
    Keymaster

    that mean you either performed wrong calibratino of ps move controller of sensor on your device are just not working good.
    i would try this first. let me know.

    #11553

    Fadez
    Participant

    Hi, I am having some troubles with tracking on my Wii remotes. Whenever I try to hold the Wii remotes still, they jitter out of control. Is there any solution to this issue?

    #11554

    Fadez
    Participant

    I forgot to mention that I am also using the Kinect skeleton for head tracking and hand tracking. I do use the buttons on my Wii remotes to control the game.

    #11632

    Greg Driver
    Keymaster

    i would open Kinect Settings and look in preview if your pose is tracked properly first.

Viewing 29 posts - 1 through 29 (of 29 total)

You must be logged in to reply to this topic.