FaceRig

FaceRig

View Stats:
Finality 14 May, 2015 @ 6:58pm
Broken stuff in 0.997.060b (lipsync, etc.)
Hello!
First post :3
First off, I noticed a similar thread from last year, which seemingly had the same issues, but was like I said, from last year... Different version...So.. XD

So far having fun with the software (loaded yesterday's nextversion, was working well enough), and I did notice the update today which I applied and noticed it broke lip syncing. D:
I've rebooted, completely shut off my antivirus (which was already going haywire over false flagging the executable, but I created exclusions that fixed it), deleted all the local files and reinstalled...
I even reinstalled the previousversion on steam and it works A-OK on the previousversion. Disconnected and reconnected by sound hardware, made sure it was properly selected in the hardware options in Facerig, all the usual troubleshooting things.

I have noticed that if I tell the launcher to enable lip syncing, it will open with it highlighted like it's activated, but I'll see no activity in the left hand indicator (the mic---webcam one), and get no response on the model.
Turning off the lip syncing (if I had toggled it on in the launcher) will make it impossible to get to reactivate (clicking the toggle button just flashes and creates a message on the left "lipsync on" but the button will not stay highlighted, nor does lip syncing work)
Now I know the program is getting mic audio because I can see it in the Noise Gate Threshold, it also never complains about getting no mic audio (unless I hardware mute my mic, then it DOES complain about getting no audio and tells me to calibrate the noise gate).
Confirmed the lipsync on keypress is off.
So I am not sure...

Another strange thing, I can use the Graphics tab to set settings and they apply OK, but when I go back into it again it always shows 640x360 and Uberlow shadowmaps, not the real current settings.

Yet another question- Is there a toggle for the markers on the webcam PIP? They always start out there but vanish sometimes and I have no idea if I am hotkeying them away or if it's a bug. Don't see anything for it in keybindings unless I am blind... lol

I am sure it's just non-functional in this build, but the confidence meter is always 100%. Sure seems sure of its self even when I cover half my face. lol This build using the retargeted models with muzzles seems to have issues with the mouth and eyes despite meticulous IRL lighting tweaks and alot of fiddling in the advanced tracking config. The model also likes to go crosseyed when I blink. Guess I must have a weird face.


Version: 0.997.060b (build 526)
Processor: I7-4770S
Ram: 16gb
HD: 32ssd-cache/2tbHDD
OS: 8.1 Pro
Graphics: Geforce GT-750M
Audio: Blue Yeti USB mic /w onboard disabled.
< >
Showing 1-5 of 5 comments
Holotech Studios  [developer] 14 May, 2015 @ 9:49pm 
Hello DSDragonSpiritus :)

Thank you for taking the time to provide us with feedback, much appreciated:)

Yes there is an issue with the sound based lip syncing and we are looking into it. We will most likely have an update pushed live in a few hours.

The graphics tab within the program ( not the one from the launcher) always shows the minimal settings, the interface does not display the correct settings you are currently using ( and if you press okay, it actually switches over to those low settings) .
This is an known issue that is not specific to this latest update... ( personally it also drives me crazy), it dates back unfortunately quite a few weeks , and fixing it depends on FUNLabs, the folks that we license the engine from and so far fixing it has slipped through the cracks as it was lower priority than other issues.
We will ping them about a fix again, but in the mean-time just use the graphics settings from he launcher.


The D key is the one that toggles on and off the tracked point overlay ( it is mentioned in the patch notes announcement under " known issue") https://steamhost.cn/steamcommunity_com/games/274920/announcements/detail/214263767481154983


The tracker confidence actually is treated differently for the new tracker , and we have yet to adjust the tracker confidence meter. ( we will most likely just remove it, as the new tracker does not expose a confidence level as a bar, but it does expose the tracked points, so you can asses the level of confidence in a more natural way, by just looking at the input feed).

Regarding eyes going cross eyes when you blink and other issues: we will look into it and start working on a fix, if you can send us a face-cam video showcasing with the issue ( best to do it via e-mail for maximum privacy) :D





Last edited by Holotech Studios; 14 May, 2015 @ 10:05pm
Sazzaj  [developer] 15 May, 2015 @ 1:32am 
Greetings,

We've just uploaded an update that fixes the lipsync issue and removes the tracker confidence visual cue as it has lost its significance in the current tracking context.

We are looking into fixing the other issues, but there are no robust quick fixes right now, though I can estimate that our next update (usually every one or two weeks) will have them solved.

Have fun and thank you for your feedback.
Finality 15 May, 2015 @ 3:24am 
Hello, I have uploaded a video, which was recorded previous to your last post just an hour ago I am afraid... But it may still have some use to you.

https://drive.google.com/file/d/0B-uWkY2L51giUmF4MjM2NnVIRzg/view?usp=sharing
Finality 15 May, 2015 @ 3:32am 
Btw, the jaw-clipping-through-lips still happens. XD
The lip syncing is registering but seemingly has little to no model impact. I've disabled model tracking, leaving only lipsyncing on, and it seems little more than a tiny lip-jittering is present. It's almost bad enough that you can't tell anything's happening with only lip-syncing on alone.
D:
Holotech Studios  [developer] 15 May, 2015 @ 4:02am 
Thank you for the follow-up DSDragonSpiritus

What you are describing in your last post happens when you use lipsync on the new&special "retargeting" avatars. The retargeting avatars ( underlined by an overlaying R on the model thumbnail) get most their lip motion exclusively from the image based tracker, and very little from audio. The retargeting method is still a work in progress, and you may get odd stuff like jaw clipping through lips.... in the end we may allow it to get more info from the audio than it currently does, but what we hope to achieve with retargeting right now is to get all needed information from the image only :).

The Animation Atomics based avatars , which are the " old style" avatars (with an "A" overlay on their thumbnail) behave like you are used to, and during speech they get all most all their lip shapes from the audio based tracker.

Last edited by Holotech Studios; 15 May, 2015 @ 4:02am
< >
Showing 1-5 of 5 comments
Per page: 1530 50