Driver4VR – Body Tracking with Camera Markers – Alpha Relase

Homepage Forums Announcements Driver4VR – Body Tracking with Camera Markers – Alpha Relase

Viewing 37 posts - 1 through 37 (of 37 total)
  • Author
    Posts
  • #12125
    Greg Driver
    Keymaster

    Overview

    Here is a fist version for Alpha tests of body tracking with Camera Markers as first shown in this video.

    To be used with existing headset: Oculus, Index, MWR, HTC, etc.
    Will work with PS Eye and Webcam however with webcam it might lose tracking easily when you move tracker.
    It will also lose tracking when making fast motion with PS Eye.
    Ensure you don’t have strong light in the background, good light from the side of camera and markers are clearly visible.

    Things I will be definitively work on before official release:
    – jitter of rotation when marker is directly facing camera.
    – reduction of jitter when marker visibility changes (it is not huge anyway)
    – options to reduce cpu usage
    – webcam will easily lose tracking when in motion. will try to improve it.
    – camera auto calibration of exposure/gain
    – possibly support more flexibility about marker mounting.
    – add more automation to manual calibration

    This is very good thing that you can experiment even with webcam and one marker before purchasing PS Eye.

    The tracker can be made up out of multiple markers.
    There is key marker and number of secondary markers.
    In order to calibrate key and secondary must be direct neighbours.
    As effect you can’t have marker at front and the back. Option for future.

    Making a tracker

    I am working on pre-fabricated markers that you could purchase if not want to spend time on making yours but that is still to come πŸ˜‰

    Please also note that you can start with just one marker (Key marker) so just print it and glue on something solid like cardboard and you are ready to go.

    There are two trackers supported for each foot (hip is virtual) and they need to be made out of markers as below:
    Tracker 0 has Key marker: 0 and Secondary markers 1,2,3,4
    Tracker 1 has Key marker: 6 and Secondary markers 7,8,9,10

    Here is how I made my controller. I prefer put this inside shoe as it is much more natural and not feel it is floating.
    Here is my version πŸ™‚

    Driver4VR Carboard Marker Slipper

    I have been working with box of size 13cm. Smaller might work less precise.

    The steps below are complete but I suggest to experiment with Driver4VR a bit before spending time on making a solid tracker πŸ™‚

    The steps to make markers are as below:
    1. Download file with markers
    2. Use Scale option in Printer Advanced Settings to print them in size that will match size of your box. You might need to try with just one marker to get best scale to fit your box.
    3. Cut them out of paper around the outside black rectangle.
    Driver4VR Camera Marker Cut from Paper
    4. Glue Key marker on front and secondary markers on the sides of the box. You can attach marker to the bottom of the box as well for better coverage.
    5. Try to glue it carefully around the edges so it will last for much longer.

    Setup and configuration

    Download Driver4VR

    For PS Eye drivers, download and install drivers.

    Until marker calibration is done, tracker will see only key marker as the tracker.

    I placed PS Eye at the height on 40cm pointing to the corner of my play space. It gives very good coverage.
    Ensure that camera is connected very well as PS Eye is very lightweight and can be easy moved even by slight push of the cable.

    1. Select Camera Markers as Body Tracking option
    2. Before starting Driver4VR please open Camera Markers Settings window and set
    – camera either Webcam or PS Eye.
    – Marker size, now one size for all markers
    – PS Eye gain to make trackers well visible. You can change it when driver is running.
    3. Start Driver4VR

    Now when you show key tracker, you should see it somewhere. You can actually start testing this solution now with one marker as explained in Making a tracker section

    4. Open Camera Markers Settings. Ensure you see camera preview.
    5. When you show your tracker with two markers it will try to calibrate them. You can reset calibration with a button.
    Driver4VR Camera Markers Calibration of Markers
    6. Do same for each pair of Key – Secondary marker for Tracker 0 and Tracker 1
    7. Last step is calibration. Perform manual calibration as on this video. I will add some more automation for release.

    Driver4VR will remember those calibration so next time just start Driver4VR.

    The best if you join Discord server and join testing on #camera-markers channel.
    Or let me know how it work as reply to this thread.
    Don’t forget to subscribe YouTube channel πŸ˜‰

    Don’t forget to show me how you made your trackers!

    Greg

    #13956
    omar guzman
    Participant

    Wow just great

    #13440
    saito197
    Participant

    Hey Greg, quick question: is it possible to use markers with switch joycons to simulate positional hand tracking?

    #13471
    PPinger
    Participant

    Nice Job, WOW!!! Can i use this for Hand Tracking too??

    #13480
    KiraSenpai
    Participant

    Hi

    is there a way to use led stripes instead of these markers?

    #13951
    GokuWorks
    Participant

    Can i use this to track Vr headset so i only need the PSMoveCam?

    #13982
    Greg Driver
    Keymaster

    problem with leds is that i can’t effectively distinguish between left ,right and headset leds. there would have to be some assumptions about position so not sure how it will work.

    yes. there will be also option for hand tracking. only not sure how well it will track head cause even small jitter might make bad experience.

    #14046
    Bruno Serafim
    Participant

    Considering that this is better than kinect in the future, which one would weigh less on my pc? I would also like to know if it is possible to use 2 kinects at the same time or would you recommend using 2 pseyes?

    #14050
    Greg Driver
    Keymaster

    i don’t remember exactly now but I think the numbers are close.
    i am working now on support for 2 kinects and there will be also support for 2 ps eye cameras. it might also double cpu usage for each.

    #14062
    Neko.
    Participant

    Would this be possible to make a hip tracking belt with some qr codes on to register if u are laying on your side?

    #14084
    BudgetVr
    Participant

    Download link not working

    #14138
    Greg Driver
    Keymaster

    i fixed link. please reload page.
    yes. hip tracking will be possible as well.

    #14473
    Medineko
    Participant

    Hey Greg, the link to the alpha versions seems to not be working again, can you fix it please? Im looking forward to try my ps eye camera!
    I tried the normal version which apparently had camera marks but my camera would not be recognized for some reason, so I tried searching for this “alpha” version and couldn’t find it.

    thanks!

    • This reply was modified 6 months, 2 weeks ago by Medineko.
    #14878
    kondr1
    Participant

    How to use it for psvr head tracking?

    #14881
    Caju_Knight
    Participant

    “Oops! That page can’t be found.”
    The link to the alpha version not working.

    #14886
    Weegeeday
    Participant

    kirasenpai,
    for leds, you could use virtual trackers on psmove service, then those appar on driver4vr, and you can assign them to any tracker, you can also use the led tracking for the kinect.

    #14919
    Jason Ross
    Participant

    I’m not sure if you’re already on the case or unaware at the moment but the alpha link is still not working. Just thought I’d let you know since I’m really eager to try this out. Thank you.

    #14982
    prosodyspeaks
    Participant

    link still dead i think? πŸ™ i was justy about to print…

    but it looks awesome and i’m already using D4VR successfully, thanks for all your work!

    #15009
    prosodyspeaks
    Participant

    as i understand you no longer need the alpha – it’s included in the general release! just select camera markers in tracker list…

    #15015
    Jason Ross
    Participant

    Yes, you are correct. I forgot to update my reply. It’s available on the actual software now. Thank you for that.

    #15086
    mrunkown420
    Participant

    Hi Greg, is it possible use it as hand tracking?

    #15119
    Boronare
    Participant

    I printed one and it was 12.5cm each. but the size param only accepts integer value. can you fix it to float?

    #15144
    dd dad
    Participant

    hi

    #15159
    Greg Driver
    Keymaster

    i will make that float and also for head tracking and hand trakcing.
    i am not sure if that will be good enough for head tracking honestly.
    you can live when controller position is glitching but with head position glitching…
    but we will see.

    #15283
    Boronare
    Participant

    1. Is there any plan about supporting multiple webcams?
    It might be much easier compare to supporting multiple kinects issue.
    …System resource usage matters, but it’s trivial.

    2. I could not find vertical angle calibration. Is there a feature? or having any plan about it?

    #15369
    Tomtom130405
    Participant

    would be cool if you could d head tracking with this

    #15411
    guilligamer
    Participant

    I can not download it πŸ™

    Attachments:
    You must be logged in to view attached files.
    #15454
    Lieutenant2014
    Participant

    Hey, the download link is broken.

    #15633
    Boronare
    Participant

    by using this app before run driver4vr, I could decrease exposure time so cam could recognize rapidly moving marker.
    by increase brightness and maximize contrast and gamma, I could compensate low exposure.
    lots of noise there, of course, but no matter for recognizing trackers.

    to Greg : Is it a hard job to make marker size float?
    It’s even better than kinect now I think. but some defect exists.
    they are what I said last time.
    1.Marker size param is integer.
    2.Camera tilt not available.
    I want them to be fixed asap…

    And some complements needed :
    1.Supporting more markers. hip tracker very necessary(not for me : using cv1 3rd touch as tracker…), and somebody wants head/hand tracking like nolo. so maybe up to 6?
    2.Calibration interface
    3.exposure/etc setting for webcam native. low priority? : can use app I attached instead.
    4.Supporting multiple cams : better than supporting opposite facing secondary marker..?
    5.supporting 5th marker : for low computing power system…?

    ed) oh.. exe file upload is forbidden… it’s VideoCap.exe by Alcor Micro Corp.

    • This reply was modified 2 months, 2 weeks ago by Boronare.
    Attachments:
    You must be logged in to view attached files.
    #15636
    Greg Driver
    Keymaster

    not at all. will do after summer break πŸ™‚

    #15650
    seo jin
    Participant

    The link is broken… plz fix it

    #15651
    Boronare
    Participant

    guys… just download from here the new version still supports testing feature.

    #15656
    Hubbit200
    Participant

    To Greg:
    Any chance it could support 2 PS Eye’s so that we can get full 360Β° tracking without occlusion problems? Or would it be a ton of work?
    Thanks!

    #15824
    dafesoy
    Participant

    To Greg:
    You’re awesome bruh!!!

    #15921
    Conrad Blankenship
    Participant

    YES I hope there is a way, ive ben trying to use hand tracking for 2 years now and cant find one with joycons bc i dont get any income so this would be great

    #15925
    Greg Driver
    Keymaster

    i want first make some form of packaged markers i can easily sell cause most people don’t want to bother in doing markers by themselves.

    #15930
    Mischa Vonk
    Participant

    is it possibble to do it with a ps4 camera?

Viewing 37 posts - 1 through 37 (of 37 total)
  • You must be logged in to reply to this topic.