so you head is tracking properly but hand not. right?
with skeleton they have very limited ability to track.
what helps is to keep ps move in hand in way that ball is where your finger ends. this is not perfect but much improves tracking of skeleton.
then you can set up colour tracking.
let me know if that helped.