Greetings!

This guide is FOR LINUX! Windows users should be able to get full body tracking with Warudo alone. It's effectiveness on a Steam Deck is untested and I don't own one. Could work if it has a webcam, but it might be too intensive in performance.

This guide was made as a contribution to KyloNeko's full guide to Vtubing on Linux. This guide will assume that your environment is ready and help you enable full body tracking. If you need more help, like setting up a Linux system and OBS from scratch, you can read his full guide here:

https://codeberg.org/KyloNeko/Linux-Guide-to-Vtubing

Also, while this guide is provided in text form here, I advise you to watch the video version here:

https://www.youtube.com/watch?v=O7EkbzLpl-8

Keep in mind, that section 2a of the video should be skipped since that part deals with VSeeFace as an alternative to Warudo.

Three pieces need to be connected to have a functional full body tracking setup:

• A tracking software
  
• An avatar puppeteering program
  
• OBS.

Programs like VseeFace and Warudo are avatar puppeteering programs and can normally do the tracking themselves, but in order to use them on Linux they must run under wine/proton and they don’t play well with webcams. Thus the need of an external program to do the tracking.

The tracking program program sends the information through the network (technically, but usually it is sent and received on the same computer) and this allows the tracking information to reach the application running under wine/proton. For this we have to enable the VMC protocol on both the tracker (sender) and the avatar program (receiver).

We will use XR Animator as a tracker and send it's data to Warudo.

XR Animator is very simple to setup. Just follow the steps:

1. Download the latest release for linux-64 of XR Animator at: https://github.com/ButzYung/SystemAnimatorOnline/releases/tag/XR-Animator_v0.25.0

2. Place the downloaded archive in a convenient folder and extract it.

3. Navigate to the electron app folder inside, give execution permissions to the electron file if required. (chmod u+x ./electron)

4. Run the electron program.

5. Click start.

Configure the program using the bottom menu:

1. Double click the camera icon. Enable selfie camera = Yes.

2. Choose your camera from the list.

3. Double click the Motion capture button.

4. Select “Full body (MediaPipe vision)”.

5. Double click the VMC button.

6. Set VMC Protocol and Send Camera Data to ON. Set the App mode to your
application (VseeFace/Warudo, etc) if listed.

7. Disable the Avatar.

8. Click done.

Warudo’s installation is trivial, with it being a Steam application, so I will assume it is already installed. However I will state the reminder that version 8.x of GE-Proton should be used, since 9.x version seem to not work at this time.

Also that character models must be stored in: “steamapps/common/Warudo/Warudo_Data/StreamingAssets/Characters”

Setup process:
1. Open Warudo.

2. Open the onboarding assistant.

3. Click “Get Started” on “Basic Setup.”

4. Choose your model and click “OK”.

5. Choose to get a recommendation and click “OK”

6. Set everything to “NO” and click OK.

7. Set both face tracking and pose tracking to VMC.

8. Click on customize face tracking.

9. Choose whatever options you like, but the important thing is at the bottom. Set lip sync to always, choose your mic, and enable hybrid mode. Click OK.

10. Click OK. And then again if you get a warning about poses.

11. Say yes to Import expressions and click OK. Then OK again.

12. Select “I want to pick and environment” and then None. Then go to camera settings and enable Chroma Key.

With XR Animator and Warudo running... all you have to do is add a Window capture or Game capture component to your scene. Add a chroma key filter if required.

Game capture requires special setup, so if you want to go for that one, refer to KyloNeko's full guide on Linux vtubing, linked in the READ FIRST section.