Unsupported
Unknown
bash -c "cd ~/dev/OpenSeeFace; source env/bin/activate; python facetracker.py -c 0 -W 1280 -H 720 --discard-after 0 --scan-every 0 --no-3d-adapt 1 --max-feature-updates 900 & sleep 5; %command%; jobs -p | xargs kill"
En Wine no funciona la cámara virtual tristemente
Siguiendo esta guía oficial, y haciendo algunos cambios porque está algo desactualizada conseguí que funcionara el programa.
Primero hice estos pasos:
sudo pacman -Sy python-pip python-virtualenv git
git clone https://github.com/emilianavt/OpenSeeFace
cd OpenSeeFace
virtualenv -p python env
source env/bin/activate
E instalamos las dependencias de Python:
pip install onnxruntime opencv-python pillow opencv-python pillow onnxruntime numpy==1.26.2
Cabe destacar que en la guía dice que hay que usar numpy 1.26.1, pero no estaba disponible para mi en los repositorios de PyPI, además que la 1.26.2 funciona sin problemas para mí. También, si no usas arch tendrás que cambiar el primer comando por el equivalente en tu distro, ten encuenta que a lo mejor no encontraras alguno de las dependencias en los repositorios oficiales y tendrás que buscar por tu cuenta donde conseguirlo.
Luego de esto, iremos a los archivos locales de VTube Studio a través de las propiedades de Steam, entramos en Vtube Studio_Data luego a StreamingAssets y ahí creamos (o editamos si ya existe) un archivo ip.txt que diga:
ip=0.0.0.0
port=11573
Después de esto, volvemos a propiedades de VTube Studio en Steam y ponemos el comando que está arriba en parámetros de lanzamiento.
Ten encuenta que yo puse ~/dev/OpenSeeFace porque yo hice todos los comandos del principio en ~/dev, pero deberás cambiarlo por la localización en la que lo hayas hecho, que usualmente será simplemente ~/, y luego ponerle el OpenSeeFace porque eso es lo que hemos descargado.
También notar que el -c 0 se refiere al número de cámara que vamos a usar, así que puede cambiar si tienes más de una o estás usando la cámara virtual de OBS.
Could not get Virtual Webcam or Spout2 working though it's most likely possible. Open in desktop mode to stream to OBS.
Wine does not passthrough webcams
The required webcame setup is quite a bit of work for the average person to figure out, but if you don't mind tinkering, it's only one time
Wine does not pass in the webcam, so a workaround is required to use webcam-based tracking
Требуется трекинг лица OpenSeeFace для работы вебки и некоторая возня в терминале, в остальном всё отлично! Никаких вылетов.
bash -c "cd $HOME/Repos/OpenSeeFace/; source env/bin/activate; python facetracker.py -c 0 -W 1920 -H 1080 --discard-after 0 --scan-every 0 --no-3d-adapt 1 --max-feature-updates 900 -s 1 & obs-gamecapture %command%; jobs -p | xargs kill"
Отлично работает с OBS. Хочется отметить что трекинг лица довольно ресурсоёмкий процесс для ПК. Посетите моё обновляемое Русскоязычное руководство настройки VTube Studio для Arch Linux: https://steamcommunity.com/sharedfiles/filedetails/?id=2938087225
It runs perfectly on both Intel and AMD graphics without any issues except web camera - it does not work out of the box
DRI_PRIME=1 PROTON_USE_WINED3D=1 %command%
I had a CreateSharedX11Texture: QueryInterface error or something like that. VTube Studio absolutely did not work. It was solved by setting PROTON_USE_WINED3D=1 %command in Launch options (open game page -> settings icon -> at the bottom of first page)
If there is no web camera set up through OpenSeeFace then app often freezes when clicking on related buttons
I had an issue with web camera but as far as I know it's related to WINE/Proton rather than the app. The solution is to download and run OpenSeeFace before the app is launched. Here is how: git clone https://github.com/emilianavt/OpenSeeFace && cd OpenSeeFace && virtualenv -p python3 env && source env/bin/activate && install pip install ort-nightly opencv-python pillow (assuming you have python 3.10, pip and python-virtualenv installed; note that ort-nightly package is instead of onnxruntime because latter does not support python 3.10). After that run sudo modprobe v4l2loopback and python facetracker.py -W 1280 -H 720 --discard-after 0 --scan-every 0 (you may need to change width and height of webcam). Finally open VTube Studio and select VTubeStudioCam as web camera. Also about Proton: I just use GE as default and thus I am not sure if there are any errors with default or experimental versions
A lot less accurate tracking than on Windows natively
You can use the OpenSeeFace tracker in the terminal, but it is a lot less accurate than using it natively on windows. If you are a vtuber, or test vtuber models (like myself, a rigger), run it on Windows or on a Windows VM with hardware acceleration, because the tracker is awful. I wear glasses, and it just doesn't pick up my blinking. On Windows, it does.
no ingame-webcam (workaround below)
crashes when starting due to bug without an unused camera (workaround below)
I did a complete guide to every workaround. (Tested only on Arch)
Proton-6.1-GE-2
Webcam does not work in-app, needs OpenSeeFace to be run separately in a terminal
Will freeze if it cannot see an unused webcam
VTS NEEDS to see an unused webcam, so you'll need to start OpenSeeFace with the webcam you want, plug in another webcam (doesn't matter what kind as long as VTS sees it as a webcam), and then start VTS. in the webcam settings, pick either "choose webcam" or (if you've already set VTubeStudioCam as the webcam) "Camera On" and see if it works. If it fails, VTS will freeze and you'll need to close and re-open it, repeating until it works.
character is blinking and it is not possible to recognize the laptop's webcam
It is not possible to recognize the laptop's webcam
