Animaze

Animaze

Jean Roxas 21 Aug, 2023 @ 5:26pm
Behavior issue when LeapMotion (Ultraleap) loses tracking
When hand tracking is lost, the behavior is as follows.

https://youtube.com/clip/Ugkx9H6oGTUynBTzvKkR7QH1F0TRqvlxq7eA

It is very unnatural that the moment the tracking is interrupted, the wrist bends downward and the arm moves forward and then moves downward.
(I'm also curious about the narrowness of the base of the arm when the hand is raised straight up...)
Can't you make it look like it's slowly lowering its arm from its final position in a slightly more natural way when it loses tracking (he lowers his arm in real life)?

It should have been possible at the time of the first FaceRig.
Please consider.
< >
Showing 1-5 of 5 comments
Sazzaj  [developer] 22 Aug, 2023 @ 3:31am 
We'll look into it, we're aiming to add a hold last position (with a timer) and also tweak the return movement, based on your and others feedback we've received in the last couple of weeks. Of course, these options would be configurable.

No ETA for this, we're trying add it to our schedule as soon as possible.
Jean Roxas 22 Aug, 2023 @ 6:37am 
I have high hopes for all of you. =)
Jean Roxas 17 Aug, 2024 @ 3:37am 
What is the current status regarding this issue?
I use Leapmotion to move my hands, but when my hands go out of range of the sensor, my arm moves forward and then lowers, which is an unnatural behavior that I'm having a lot of trouble with.
I think the problem will be solved if I can get rid of just this "hand moving forward" behavior and make it a hand lowering motion.
devops  [developer] 17 Aug, 2024 @ 7:00am 
Originally posted by Jean Roxas:
What is the current status regarding this issue?
I use Leapmotion to move my hands, but when my hands go out of range of the sensor, my arm moves forward and then lowers, which is an unnatural behavior that I'm having a lot of trouble with.
I think the problem will be solved if I can get rid of just this "hand moving forward" behavior and make it a hand-lowering motion.

Hello!

Happy to assist.
Unfortunately, Sazzaj is no longer with the Animaze team, so this issue might have fallen through the cracks. I cannot give you quick specific details. Will discuss this with the coder on our current three-person team on Monday to see if there is progress on this.
Agreed that it does not look perfectly smooth, and does not seem 100% necessary.

Until then the best way to mitigate this is to tune your motion capture sensor setup so that tracking lost hand events ideally occur far less frequently.

The issue is probably that when the hand tracking is lost, the arms interpolate to a certain technical default pose first, and that technical default pose had the arms bent 90 degrees at the elbow; only after they go to the arms stretched down along the body pose.


Ways to have the hand tracking be lost less often:
- Use monitor-mounted or chest-mounted Ultraleap position (instead of desk positioned)
- If you use webcam-based hand-tracking ( via a VMC sender), and you set up your body-focused webcam with a larger FOV it will be much harder to get your hands to exit that. The external VMC sender might have their own failsafe on what they send out to the arms when tracking is lost.
- Test if newer ultra leap sensors have wider angles /larger capture spaces (Animaze supports the new Hyperion drivers that support the next-gen Leap sensors too).


In the past to use webcam-based hand tracking you had to use VMC and a VMC sender app. That is about to change.
The internal Animaze version for webcam-based hand tracking that uses Google Media Pipe (that does not require an additional VMC sender app) will be launched probably next week, and you can test that too, and see if you prefer it to Ultraleap tracking.
Last edited by devops; 17 Aug, 2024 @ 10:32pm
Jean Roxas 18 Aug, 2024 @ 3:59am 
Understood.
Thanks to you, I now have a better understanding of the situation.
I'll continue to try to find my own solution.
I'll continue to support the development team.
Thank you.
< >
Showing 1-5 of 5 comments
Per page: 1530 50