FaceRig

FaceRig

View Stats:
Damek Critou 21 Jun, 2016 @ 6:23pm
Tracking translation to animation not working
Before the 6/15/16 update, my FaceRig was working fine.

After the update, I'm not sure what combination of processes has resulted in a total breakdown.

I am always using NextVersion branch.

Firstly, and as a side note, my FaceRig no longer auto initializes the default camera and audio trackers. This is little more than an annoyance, as turning them on manually still works. I do have RealSense and LeapMotion installed, but not active. Just a little issue that is easily worked around by turning them on in advanced tracking, but still pretty annoying.



The main problem is that once all the tracking is initialized and working, even after a reset or two, the character on the screen will not have the motions from the camera translated into animation.

I must emphasize that resetting tracking does not fix this issue. I have even verified files twice in case it was a linking error between the model and the animation skeleton. It didn't change anything. Even the lipsync isn't performed. The character simply will not move based on the movements performed in the camera. It is not totally inanimate however.

I use Danny - Custom, and the ear wiggles, slight side to side head movements, and blinking still perform automatically, but the avatar will not move from any of my own movements. The avatar also has gained an odd trait of having its tongue shoved up through the top of the muzzle to stick out through the fur. See images below.

I have detailed in these images that tracking is working, the face cam is working, and the avatar is rendered, but simply will not accept commands. I cannot even move it with keybinds (alt + middlemouse and the like). I tried avatar posing as well without the tracking on, and no setting there changes the model position at all. (triggering the "rigid" options in the advanced tracking also changed nothing)


I use a custom texture for eyes and head, hope that isn't a huge issue. (I'm a blue fox. I tried my best with minimal art skills D: )

Image One. [i.imgur.com]

Image Two. [i.imgur.com]

Here is the past of my VP.log, it's a bit large, sorry. [pastebin.com]

And finally, the DxDiag. [pastebin.com]


Thank you for your time,
Damek
< >
Showing 1-4 of 4 comments
Damek Critou 21 Jun, 2016 @ 6:25pm 
Just want to point out that with my DxDiag, that my CPU overlock is adaptive. Meaning my actual ♥♥♥♥ ratio is only as fast as the system demands. So in idle, it shows 800MHz, when I actually run around 4.8 GHz. Just in case that comes up.
76561198257355317 22 Jun, 2016 @ 1:51am 
Thanks for reporting this, we will check this out. Regarding the avatars not moving, i would suggest to check that your webcam drivers are up to date, check that no other program is using your webcam feed or that the actual webcam is being properly initialized (re-select it from Advanced UI- Advanced Tracking config- trackers and under ULSee tab -input device -select your webcam.
Last edited by Mighty_Potato; 22 Jun, 2016 @ 1:56am
Sazzaj  [developer] 22 Jun, 2016 @ 5:15am 
Hi,

I'll summarize the issues you've described so that we can track them better and maybe find some workarounds for you while we are investigating them:
1. the webcam for the Face Tracker is not saved, you have to manually re-select it.
2. avatar not responsive even if the tracker successfully tracks your face. Have you used any of the Record/Play performance functions before this happens?
3. Avatar tongue sticking out. This is an old issue that has been solved, you have been customizing the avatar, which makes a model cache, ignoring anything "vanilla" we push to Steam. The issue can be solved really easy, go and delete the following folders: <steamInstallDir>\steamapps\common\FaceRig\Mod\PC_datacache and PC_dx11_datacache. Next time you load your avatar will take a while, but subsequent loads will be shorter.
4. avatar does not move using the ctrl/alt + mouse actions

My suggestion is to go to c:\users\<yourWindowsUser>\Documents\Holotech\FaceRig\UserCfg\ and delete trackers.usc. Open FaceRig, see if the issue persists, then close (this should save a new trackers.usc), and send us the updated trackers.usc and VP.log.
Damek Critou 22 Jun, 2016 @ 1:07pm 
All right, so when I woke up today and started Steam, it forced a validation on FaceRig for whatever reason. After validation, there was a 50mb patch that seems to have fixed most of the issues above. I unfortunately can't seem to recreate the problem(s) in order to provide feedback on the suggested fixes, but can still upload new logs if you would like.

Regardless, I am going to address the questions posed above in the effort to assist tracking down what may be a rare bug, I don't know, but I figure it doesn't hurt to look at what went wrong.

1.) It is more than just the webcam, the entire tracker wasn't being saved or loaded automatically (ULSee and Audio trackers). The fix was to add them manually, yes, but seemed like it may be related to the other issues.

2.) Correct, but nothing was done before hand, the lack of movement would be present immediately after manually adding the trackers and establishing face tracking. Resetting tracking, attempting to pose the avatar, nothing would create movement on the model.

Some new info here - I discovered before bed that when going into the "Expression" tab under "Advanced Tracking Configuration" menu, none of the expressions would be loaded (that is, nothing at all would be shown in the menu and therefore could not be customized). Resetting valeus to default would show the appropriate fields (body pitch, head pitch, head roll, etc) but changing the values of the sliders had no change on the model.

3.) This was fixed with whatever patch I have downloaded.

4.) After the forced forced validation and patch, most of the movement keybinds were working. Avatar rotation, zooming in and out, specifically. I could still not move the avatar's physical location about the XY plane. I decided to check the keybind to make sure it was still alt middle mouse button. Turns out, the keybind had been deleted completely and I had to rebind it. Restarting FaceRig kept the keybind valid, so I'm not sure what happened here. I had never touched the keybind before this.

So whatever I downloaded has fixed pretty much all of this, but I did validate twice before posting this thread and nothing changed, so I have no idea what happened.

Sorry for the waste of your time :X
< >
Showing 1-4 of 4 comments
Per page: 1530 50