Homepage Forums How-to and troubleshooting Overview of Kinect Head and Controller tracking

Tagged: 

Viewing 37 posts - 1 through 37 (of 37 total)
  • Author
    Posts
  • #1462
    Bla BlablaGreg Driver
    Keymaster

    (this is preliminary instruction, video to follow soon)

    Driver4VR allows you to use Kinect 360 combined with controllers to play in SteamVR.

    First you need to decide your way of tracking:
    – Kinect skeleton tracking. It rely on Kinect to track your whole body. Very easy to set up but has some limitations.
    – Colour / led tracking – will track led ball like in PS Move or your custom source of light. For Kienct 360 you might also need to prepare it for colour tracking.

    Next you need to calibrate headset to ensure that Kinect tracking system will have same direction.

    Each device must go through 2 steps:
    1. Device Pairing
    2a. Assign device to tracker in Device Manager. You need select tracker, device and press Assign.
    2b. or assign keys for VR Gamepad.

    Currently supported controllers:
    PS Move
    Daydream
    JoyconJoycon Tutorial
    Wii Motion / Nunchak – work in progress
    – VR Gamepad (orientation is calculated from position of head 🙂 but it is very cheap way to start with few VR games).

    Controllers work in progress:
    – GearVR

    In below topic you can find information how to set up skeleton or colour tracking.

    • This topic was modified 6 years, 2 months ago by Bla BlablaGreg Driver.
    #1463
    Bla BlablaGreg Driver
    Keymaster

    After Driver4VR will start you need to select source of tracking for Head and Hands. In each case you have option:
    – Skeleton
    – Led light/ball

    In case of Kinect 360 you need prepare it first.

    If you select Skeleton, the tracking will be available right away but it has some limitations when your hands are close to body or in general Kinect is not able to tack skeleton well.

    You can also use mixed tracking. For example track head with skeleton and hands with led light/ball.

    For Kinect 360 you need make small preparation to allow it track colour properly.

    Despite best efforts this method might not work well in some light conditions.

    In order to calibrate colour you need:
    1. If needed adjust exposure in ‘Camera settings’
    2. Click ‘Colour Calibration’
    3. Select controller from the list.

    Driver4VR - colour calibration - select controller from the list

    4. Click ‘Calibrate’ and wait for calibration to complete.

    Kinect 360 calibration - colour calibration

    5. If process of calibration goes well, then you will that only your colour is being tracked in the ‘Tracker filter view’. In case of problem you need to adjust exposure of Kinect or light conditions in your room.

    #1466
    Bla BlablaGreg Driver
    Keymaster

    Headset calibration is required in order to have direction of headset aligned with direction of Kinect coordinates. This is very easy step, first you need to points Headset into Kinect direction with right angle.

    Then you need to press Calibrate button next to Head tracking option and then press ‘Calibrate’ while pointing your headset in direction of headset pointing forward.

    Headset vs Kinect calibration

    #1470
    Bla BlablaGreg Driver
    Keymaster

    In order to pair device you need to open Device Manager. Then in device manager select proper tab and perform pairing as in instructions.

    Note that for PS Move, Driver4VR will instruct you to download and install PSMoveService.

    Once device is paired you will see it on ‘Devices’ list. Then you need to select Device and Controller and click ‘Assign’.

    For VR Gamepad there is no need to assign but instead you need to select Controller and then press ‘Assign buttons’.

    Below Devices list there is Preview option that allow visually see orientation of the controller as well as status of buttons.

    #1473
    Bla BlablaGreg Driver
    Keymaster

    PS Move

    Video tutorial:

    Old instruction:

    For skeleton tracking you should keep you hand in way it don’t go too much outside your hand.

    Driver is using PSMoveService to access and calibrate devices and will prompt you to download.

    2. PS Move configuration – turn ON
    2.1 Perform pairing of each device as per instructions.
    2.2 Perform calibration of each device as per instructions.
    2.3 During gameplay you need long press Select to align orientation with headset.
    2.4 Assign device with tracker using Assign button.

    Button mapping (SteamVR – PS Move):
    * Reset orientation – Select pressed for 3 seconds
    * Trigger – Trigger
    * System – PS Button
    * Grip – Cross/Circle
    * Menu – Square – right hand/Triangle – left hand
    * Touch Touched – Move Button (see configuration)
    * Touch Press – Move Button double press (see configuration)
    * Touchpad navigation – while pressing move controller will map to move of touchpad.
    * Rotation 90/180 degree – Square: left – left hand/Triangle: right – right hand

    With version 3.1 there is configuration of PS Move introduced that allows configure rotation angle and touchpad behaviour. Please find screen below.
    PS Move configuration v3.1

    E.g. how to press button in right corner:
    1 Touch button once to initiate emulation of touchpad in centre of touch area.
    2. Move controller up-right to emulate moving finger over touchpad
    3. You can then unpress button and press again that will emulate like you would touch again in same touchpad location.
    4. You can unpress and make double press that will emulate touchpad press.
    5. If you unpress for 1 second then after another press will start with centre location. That means you can effectively emulate touch or press continuously on touchpad as long as you keep it unpressed by no longer then 1 second.

    #1474
    Bla BlablaGreg Driver
    Keymaster

    Daydream
    3.1 Pair with Windows using standard Windows Bluetooth Manager.
    3.2 During gameplay you need long press Select to align orientation with headset.
    3.3 Assign device with tracker using Assign button.

    Button mapping (SteamVR – Daydream):
    * Reset orientation – Press Volume Up for 3 seconds.
    * Trigger – Application button
    * Grip – Home button
    * System – Volume up
    * Menu – Volume down
    * Touchpad works in same way as Vive

    #3037
    Bla BlablaGreg Driver
    Keymaster
    #3039
    Bla BlablaGreg Driver
    Keymaster

    Wii Motion/Nunchak – work in progress

    1. First turn it ON in Device Manager / Wii tab.
    2. Pair device via bluetooth but not default way but right click on Bluetooth icon and then choose “Join a Personal Area Network”. This will allow you to bypass PIN.
    3. Devices should appear in Driver4VR’s Device Manager.
    4. Click Preview. You will notice that only pitch and roll are rotating.
    Yaw is taken from Kinect.
    5. Button mapping described under Configuration button in Device Manager/Wii tab

    If device is listed but not responding please restart SteamVR/Driver4VR.

    #4021
    CakerzCakerz
    Participant

    Hello,

    Whenever I press start PSMoveService in the calibration window, PSMoveService runs but has an error in which the target machine refuses it. The config tool is stuck on “waiting for controller list response.” What could be the cause of this error?

    Thanks.

    #4024
    el-bohnoel-bohno
    Participant

    Hey Cakerz, i think that will help you, i had the same problem. I used a tool called usbdeview to deinstall first motion controller.

    • This reply was modified 6 years, 1 month ago by el-bohnoel-bohno.
    #4413
    cretkensighcretkensigh
    Participant

    Ive got a 2 of those vr box controllers that i plan on mounting on the psmove controllers for thumbstick control but i cant seem to get the vr gamepad to map the buttons. I can set it up and driver4vr can see the button pressing when mapping but it doesnt seem to take effect. Is it possible to do it this way?

    They were dirt cheap so i.dont mind if they dont work but they seem to work on pc and in steam for selecting games etc

    #4593
    vebminevebmine
    Participant

    Hi!
    support for gear vr controllers will be available soon?

    #4594
    Bla BlablaGreg Driver
    Keymaster

    @vebmine
    not sure about it. cannot decode orientation.

    #4673
    WingedWhiteWingedWhite
    Participant

    Hi Greg,
    I’m having trouble connecting my joycons, they are both connected to my pc through bluetooth but Driver4vr will not detect them when I press “update list of devices”

    #4732
    ZeroZedZeroZed
    Participant

    I have mixed reality headset but I do not want to use the original controllers, I want the ones from Wii motion plus, will it work? the WMR controllers are limited and they have conflict with kinekt body traking, i just want to use it for VRchat, to dance or som, what is the best combination for kinekt and controllers? sorry my english is bad, Greetings from germany

    #4914
    G. M.G. M.
    Participant

    I want Headtracking all the while using Razer Hydras and Riftcat. Is it possible?

    #5006
    Andre GenesiniAndre Genesini
    Participant

    Hi
    I have riftcat + leap motion + 2 vr controller + kinect 360

    What configuration do you suggest?

    Thank you

    #5641
    Norbaf LlewterfNorbaf Llewterf
    Participant

    My RVL-CNT-01-TR is not showing under Devices. I connected under PAN as a gamepad. It also shows as an HID game controller. Any help, thanks?

    #5824
    Aldrik Kosternonaak
    Participant

    hi thanks for the gread software you make Greg.

    In post 2017-12-19 at 16:36 you write about a menu:
    “With version 3.1 there is configuration of PS Move introduced that allows configure rotation angle and touchpad behaviour. Please find screen below”

    I kan not find this menu, the only menu i get is for the other PS controllers (no light bulp but with joystick).

    And other qwestion is: you write to press long the seleckt button for align orientation.
    my problim is that my controllers in VR are on the floor, and not at front of my.

    Please can you give my a advice for that.

    my setup is: PSVR + kineckt 360 + PS move controllers. i want to have the setup kineckt with led light / ball

    thanks for all your good work

    #5825
    Aldrik Kosternonaak
    Participant

    Hi Greg the firs qwestion i find out 🙂 but i dont know how to make my controllers in VR a front of me ( now there are on the floor

    Thanks for the gread software

    #5993
    Dan'l CookDan’l Cook
    Participant

    Hello, whenever I decide to connect my Kinect 360 it always says it doesn’t work, so it sends me some links to download something and once I run it it says my Kinect is not ready to be used, how do I fix this issue?

    #6035
    Bla BlablaGreg Driver
    Keymaster

    you should try to download sdk and see if samples work there.
    can you verify your Kinect as described here?

    #10987
    Edgardo ZamoraEdgardo Zamora
    Participant

    Hi, I’m using Kinect 360 + Old PS Move + New PS Move, playing Beat Saber

    Head Tracking = Kinect Skeleton

    If I use Hand Tracking – PS Move Service, the hand controller stays in one location
    If I use Hand Tracking – Kinect Skeleton, it works but not stable. it always drifts, and hand orientation in not correct, no matter how many times I keep on re-aligning.

    Did I missed something?

    #11018
    Bla BlablaGreg Driver
    Keymaster

    in case of headset drift check this

    #11025
    Edgardo ZamoraEdgardo Zamora
    Participant

    What I mean is that the PS move controller is out of alignment and not stable.

    When I play Beat Saber, the first second is align after alignment, after I sliced the box, the saber is out of nowhere, or wrong direction.

    #11042
    Bla BlablaGreg Driver
    Keymaster

    that mean you either performed wrong calibratino of ps move controller of sensor on your device are just not working good.
    i would try this first. let me know.

    #11553
    FadezFadez
    Participant

    Hi, I am having some troubles with tracking on my Wii remotes. Whenever I try to hold the Wii remotes still, they jitter out of control. Is there any solution to this issue?

    #11554
    FadezFadez
    Participant

    I forgot to mention that I am also using the Kinect skeleton for head tracking and hand tracking. I do use the buttons on my Wii remotes to control the game.

    #11632
    Bla BlablaGreg Driver
    Keymaster

    i would open Kinect Settings and look in preview if your pose is tracked properly first.

    #11820
    Alex Spisakgetsalte
    Participant

    I’m trying to use my wii remotes on here but whenever i connect them to my computer they don’t show up in driver4vr, other programs like dolphin work just fine

    #11856
    Bla BlablaGreg Driver
    Keymaster

    did you enabled support for them in tracker manager?

    #11920
    rubiks5600rubiks5600
    Participant

    Hi, I was just wondering, will you ever make it so that the Wiimote Motionplus controllers run just like joycons?

    #14099
    David Prud'hommehockeybear88
    Participant

    so my joycons have been recognized by driver4vr, but there are no devices that I can assign them to. pushing update list does not work either. however, I can see them on my headset, they just don’t do anything.

    Attachments:
    You must be logged in to view attached files.
    #14143
    Bla BlablaGreg Driver
    Keymaster

    you can dm me on discord and will try to address that.

    #15722
    rafaeldavidrafaeldavid
    Participant

    My kinect don’t work…

    I click in Start Driver4VR button, but receive a message:

    Kinect One not found.
    Kinect 360 failed to connect: ‘Device Not Supported’

    Attachments:
    You must be logged in to view attached files.
    #15791
    Paulo MachadoAlienHrGig
    Participant

    cheers Greg, i have been trying to configure PSVR (with trinus), PS Move controllers and kinect to play Half life Alyx, Batman Arham VR and Super HOT among others. I tried following all guides but i always end up with the same problems. The headset view his jittering, i guess kinect is not tracking head properly or smoothly. Second one is i never seem to start inside the play area and cant figure out why. The third, my arms never seem to have enough reach or to be accurately tracked in vr space (best example is not being able to reach items in super hot).
    Any idea what might be wrong?
    i’m setting skeleton in head, hand and body. also tried PSMoveService with Kinect for hands but seems worse with direction of controllers drifting faster than just hand tracking

    #42322

    I have all of the same issues AlienHrgig mentioned. Even if the PS move controllers start in the right position after I flale my arms for a couple of seconds they are all out of line. This means I can play about 2 seconds of beat saber before they are all out of line. Beat Saber also sometimes starts behind me.

    I just don’t know what the issue is. When I look at the live Kinect skeleton view, it’s tracking my arms and body just fine. when I use the PS move it tracks the colored circles just fine on the live view. Not very well in VR. I don’t know why it just can’t put the controllers 1 on each dot and follow them.

Viewing 37 posts - 1 through 37 (of 37 total)
  • You must be logged in to reply to this topic.