Question about the VR Gamepad support.

Homepage Forums Positional tracking – head and head trackers Version 3 Beta testing Question about the VR Gamepad support.

Viewing 49 posts - 1 through 49 (of 49 total)
  • Author
    Posts
  • #1213
    zivzv
    Participant

    I built my own Gamepad, using Arduino, my question is about the tracking.

    The driver will track my hands movement? if not? What should I add?

    Should I add tracking balls to the Gamepad?
    Or do I need any other equipment (ps eye, etc)?

    My equipment:
    vr headset – VIULUX V1 the pc Identifies it as oculus dk2 using OculusConfigUtil 0.8
    Kinect360
    leap motion
    and my Gamepad

    #1214
    Greg Driver
    Keymaster

    hi,
    very interesting. can you post photo ?
    if you expect only button/touchpad data from gamepad and your gamepad supports xinput then you can do this using “VR Gamepad to VR Controller key mapping.” if you have also orientation then I might need directly read that from device. I am not sure if there is any standard for this.

    Also I don’t support in same time kinect and leap motion right now.

    greg

    #1219
    zivzv
    Participant

    Like you see nothing fancy or special, one for each hand, including: 9 buttons,6dof and an analog JoyStick

    the gamepad has xinput, and the the key mapping, works perfectly, that’s why I bought the drivers πŸ˜‰
    It’s just a base for a gun gamepad that I want to build, a gun with recoil,it’s all still theoretical.

    My problem is this:

    If the leap motion doesn’t see the hand, the hand “does not exist” so the hand is stuck in the last place it saw it.
    And I was unable to make the kinect to identify the location of my hands, so just the buttons worked.

    Basically, I just want that my gamepad will work the same as the PsMove/Daydream in the way that the kinect tracks
    their movments.

    So if I add to the controllers tracking balls the kinect will track the location of my hands?
    Or do I need something in addition? like the ps eye?

    I prefer to work with the kinect, so i don’t need them to work at the same time
    The 6DOF works like the second analog JoyStick in a gamepad , so it’s there just for fun

    Attachments:
    You must be logged in to view attached files.
    #1224
    Greg Driver
    Keymaster

    it is really cool πŸ™‚
    if you select kinect skeleton in hand tracking then you should see your hands alone. can you please double check if your hands are tracked ?

    #1225
    Jna
    Participant

    Hi Zivzv,

    Very nice! would you be kind to share the diagrams? A couple of weeks ago I found a similar project here in order to build my personal controller.

    #1228
    zivzv
    Participant

    Greg Driver
    In the 2.99.0, when I choose Kinect – skeleton , the Driver4VR get stuck.
    when I choose Kinect – Led light/ball – it work lag’s, so I did not try with led light.

    In 2.1.0 version I was able to calibrat, so I’m sure that the hardware fine.

    #1230
    Greg Driver
    Keymaster

    hi.
    i will check and update when make new beta release.
    greg

    #1231
    zivzv
    Participant

    Jna
    Of course! πŸ™‚

    I know it’s similar,because when I started I try to work with his project
    The problem started when I realized that I have to have the oculus camera… so i pass

    I also try to remap the leap motion vr controller driver code by cbuchner1
    Here the problem was that if the leap motion doesn’t see the hand, the hand β€œdoes not exist” so the hand is stuck in the last place it saw it.

    So… now I’m here πŸ˜€

    I’ll tell you what, I’m still waiting for the parts to my left hand gamepad.
    When I build it, hopefully next week I will document the process and also I’ll share the Arduino code

    #1232
    zivzv
    Participant

    Greg Driver

    Thank you! You are awesome πŸ™‚

    #1233
    Greg Driver
    Keymaster

    @zivzv
    i am wondering what would be total cost of the controller ?
    what is complete setup you play it ?

    #1235
    zivzv
    Participant

    @Greg Driver
    Arduino Leonardo – 5.53$ X2
    MPU-6050 – 1.18$ X2
    Arduino Joystick – 1$ X2
    VR Control – 2.22$ X2
    Jumper Cable 120pcs – 3.37$

    Led and Tennis Ball for the tracking balls –
    Tennis Ball 100 pcs – 6.28 $
    led 100 pcs – 1.41$

    For gloves lets say 10 dollars?

    So total of 45 USD.

    Complete setup? as my pc?

    #1243
    Jna
    Participant

    @Greg

    I’ve reported the same issue (stuck when choosing Kinect – Skeleton) here though I’m experiencing the same problem in the 2.1.0.

    @Zivzv Awesome!

    #1251
    Greg Driver
    Keymaster

    hi,
    i uploaded new beta. it has same version number so ignore it.
    if you have problem please let me know the steps and also sent driver4vr logs.

    How to send diagnostic logs

    thanks.

    • This reply was modified 2 years, 1 month ago by Greg Driver.
    #1256
    Jna
    Participant

    Hi Greg,

    I tested with the latest beta version.

    Kinect Head tracking OK.
    Kinect Hand Tracking NOK.
    Leap Motion NOK
    Body Tracking: I thought it wasn’t working but its really very slow.

    System Info: Windows 10; PIMAX 4K BE; Core i7 3.5Ghz ; 12 GB DDR3 / 1060 6GB GTX

    I’m uploading the logs from the Kinect Hand Tracking since I can always rollback to the 2.10 to use Leap motion.

    Steps:

    . Choose Kinect Hand Tracking
    . Active the Driver
    . Driver windows hangs / does not respond

    • This reply was modified 2 years, 1 month ago by Jna.
    Attachments:
    You must be logged in to view attached files.
    #1261
    Greg Driver
    Keymaster

    is it using cpu ?

    #1262
    Jna
    Participant

    Body Tracking Yes.

    #1263
    Greg Driver
    Keymaster

    i uploaded new version. do you mind giving it a try ?

    #1264
    zivzv
    Participant

    Hi Greg,

    For me in the previous version

    The Driver4VR did not responded if I chose skeleton Or led ball
    And everything worked very slowly
    In this version everything is really fast but the Kinect not responding, showing a black image at Colour Calibration
    And in Kinect skeleton Calibration with.. it do not recognize anything

    #1273
    Greg Driver
    Keymaster

    hi.
    i added logs to investigate. can you check and send me driver4vr log ?
    i was testing on few machines including non-dev and all seems fine there.
    thanks for your help.

    also can you test only head tracking first and then add hand tracking.

    greg

    • This reply was modified 2 years, 1 month ago by Greg Driver.
    #1280
    zivzv
    Participant

    Hi Greg,

    Just to make sure, the current version is install(after a clean installation) the one who does not recognize the Kinect.

    Only the vr headset and the Kinect 360 are connected to my PC

    Under tracking
    head – off
    hand controllers – skelton

    Log files are attached
    the driver4vr.log was not exists probably because the “clean” installation

    If you need me to choose other options Or check out other versions
    Just say it and I’ll send you the logs

    • This reply was modified 2 years, 1 month ago by zivzv.
    Attachments:
    You must be logged in to view attached files.
    #1284
    zivzv
    Participant

    Jna

    I started working on the documentation of how to build the gamepad
    I’m just missing jumper cables, hopefully they will arrive soon

    #1286
    Greg Driver
    Keymaster

    hi. found 2 major bugs (and fixed).
    check beta now.
    logs in ‘logs’ subfolder instead of main app folder.

    greg

    #1287
    Jna
    Participant

    Hi Greg,

    Just tested the new beta release and both Kinect Head Tracking and Kinect Body Tracking are now working!

    Regarding Leap Motion / Kinect Hand Track the log files are attached. Please let me know if you need more info.

    Awesome work Greg!

    EDIT: Noticed that choosing Kinect Hand Track creates an empty driver4vr.log.

    EDIT2: When I choose Kinect Head Track + Kinect Hand Track the hand trackers showed up!

    @Zivzv Very nice I’m really looking forward.

    • This reply was modified 2 years, 1 month ago by Jna.
    • This reply was modified 2 years, 1 month ago by Jna.
    Attachments:
    You must be logged in to view attached files.
    #1301
    zivzv
    Participant

    Hi Greg,

    There are significant improvements to the drivers, the driver run fast and always respond.

    But I have 2 problems

    1 – In colour calibrate, the Kinect displays only a black image

    2 – Although everything is responding, I still can not make a good skelton calibrate,
    But there’s a chance I’m not doing it right.
    Where should I be aiming for in each of the five points?
    For now, I just looked at the Kinect, then turned left and right
    And look down and up …

    Attachments:
    You must be logged in to view attached files.
    #1307
    Greg Driver
    Keymaster

    what do you try to calibrate ?
    if you have head/controllers out of kinect there is nothing to calibrate.
    it is only required if there is external trackng system for head that you want to aligh with.

    for folour tracking you need to select a controller to calibrate colour. beore you need also seleect led ball as source for either head or hand.
    but this is not even beta so use at your own risk πŸ™‚

    #1309
    zivzv
    Participant

    Hi Greg,

    I have a vr headset – VIULUX V1 the pc Identifies it as oculus dk2 using OculusConfigUtil 0.8
    Also the Driver4VR Identifies as a oculus dk2.

    So for now how can i calibrate my hands movement?

    I tried to calibrate by colour using Led bulbs,but the Kinect displays only a black image.

    Attachments:
    You must be logged in to view attached files.
    #1311
    Greg Driver
    Keymaster

    you don’t need calibrate if you use head and hand tracking from kinect.
    if you did any calibration then please open again and click ‘clear’.

    is there anythign wrong with how your hands are located against head ? why do you try to calibrate ?

    colour calibration works this way. you need first select hand controllers as kinect – led. then you open color calibration and select one of controllers from the list. then press calibrate and move led ball to the yellow rectangle. after while it should detect colour and play applause. if it does not detect colour will play ‘boo’.

    greg

    #1320
    Jna
    Participant

    Hi Greg,

    It would be great if you could inactivate some of buttons / values for non applicable combinations. On that matter can you please confirm that in order to use Kinect Hand tracking we need to select either Kinect Skeleton / Light Bolt for Head Track?

    Regarding hand track if you could take a look on why Leap Motion isn’t working that I would have to reinstall 2.10 in order to play πŸ™‚

    #1321
    zivzv
    Participant

    Hi Greg,

    I try to calibrate, because according to the SteamVR my hands are behind my back.
    I resat the calibrate and they’re still behind my back.

    I try to colour calibration, I attached a picture of the black screen that I got from the colour calibration,there is a red LED placed in front of the Kinect.

    Attachments:
    You must be logged in to view attached files.
    #1326
    Xcalibur
    Participant

    Hi Greg,

    It’s much smooth and faster now. Very nice! πŸ™‚ However, the orientation for my ps moves are wrong. If I point forward, the model points up… Rotations seems fine though.

    #1327
    Greg Driver
    Keymaster

    i am uploading new version. the problem is when rotation of head is not aligned with direction of coordinates. but in this case I had also overall head direction not alighed with physical direction.
    in case of dk2 i was solving this by resetting view in direction of kinect.

    solution for now is go to settings of head tracknig and change ‘angle correction’ until controllers are positioned properly. with dk2 I can recognize this that my physical movement is alighed with virtual and controllers are directly in front of you. to ensure it is completely aligned I move hands up and down and I change correction a bit until they also move virtually up and down stright.

    if you will notice that reset of controller’s orientation is not alignedd with head direction please take corrective anngle and let me know.

    i hope that will help πŸ™‚
    greg

    #1329
    Greg Driver
    Keymaster

    many fixes later…

    new beta available. next to head trackng there is calibrate button.
    you should take headset and point directly to kinect and press calibrate button.

    after that controllers should be aligned with headset. you can manually change angle to get best result if needed.

    i will post info how to calibrate colour like for ps move if all goes well.

    #1342
    zivzv
    Participant

    Hi Greg,

    Now the “controllers” are in the right direction
    But still not in front of my body, I try to calibrate
    If it automatic they on my right, if manually to my left.

    I attached a picture to explain what I mean

    Attachments:
    You must be logged in to view attached files.
    #1348
    Greg Driver
    Keymaster

    are you saying that between automatic and manual calibration there is no point when they are prperly aligned ? what headset do you have (sorry if you already said).

    #1351
    zivzv
    Participant

    Unfortunately, no
    vr headset – VIULUX V1 the pc Identifies it as oculus dk2 using OculusConfigUtil 0.8

    #1352
    Greg Driver
    Keymaster

    i assume you have head and hand tracking.
    so what happens when you change calibration value?
    how they go from left to right?

    #1355
    zivzv
    Participant

    The tracking head by the headset and hands by Kinect
    When I calibration automatic, I stand in front of the Kinect and raise my hands up and down then my hands are on my right side
    Manual I simply inserted numbers like 50,150,200 to see if there are any changes but my hands always on my left

    #1356
    Xcalibur
    Participant

    Oh… I think it’s a usb bandwidth issue. I switch port and it doesn’t disconnect anymore. However, it is still missing commands: if i pressed down the move button for teleport, sometime, it releases by itself.

    @zivzv adjust the angle correction. One positive or negative number. Not the one with three fields.

    #1363
    zivzv
    Participant

    In the red circle it’s where I change the data manually, 180 it’s what I got automatically

    Attachments:
    You must be logged in to view attached files.
    #1375
    Greg Driver
    Keymaster

    this is up/down control. if you dont mind doing test to put headset on with one hand in front of you and press up arrow this will change smoothly calibration and hopefully you will get proper angle this way.

    thanks.

    #1405
    zivzv
    Participant

    Hi Greg,

    I used the arrow trick and it worked, there is another small problem
    The right hand moves the left controller and the left hand moves the right controller
    Up and down works fine
    When I move my hand to the left the controller turns right and when I move to the right the controller turns to the left
    When I move the controller toward my body they move away and when I’m moving them forward the controller approaching closer to me

    #1406
    Greg Driver
    Keymaster

    hi.
    new beta available which I put on ton of effort. can you check ? πŸ™‚

    #1414
    zivzv
    Participant

    Hi Greg,

    The good news,the calibration is much simpler
    But
    The hands are still reversed, my left hand moves the right controller and my right hand moves the left controller
    When I move my hand to the left the controller turns right and when I move my hand to the right the controller turns left
    When I move the controller toward my body they move away and when I’m moving them forward the controller approaching closer to me.

    and the Kinect still show a black image at the Colour Calibration with a red LED in front of the Kinect

    #1774
    zivzv
    Participant
    #1821
    Jna
    Participant

    @zivzv I have no words…simply amazing!!! Thanks

    #1839
    zivzv
    Participant

    @jna
    My pleasure

    I add final product pictures and video.
    If you have any questions feel free.

    Maybe I’ll add my other projects, cheap “VR glasses” – not support by steam but work with TriDef 3D, and USB Arcade Gun

    #13450
    huett930
    Participant

    (Awaiting moderation)

    #13467
    Greg Driver
    Keymaster

    hello. for that I would have to allow somehow detect your device by driver4vr. i could expose some api similar to freetrack but we would have to think about this.

    #13472
    huett930
    Participant

    (Awaiting moderation)

Viewing 49 posts - 1 through 49 (of 49 total)
  • You must be logged in to reply to this topic.