Face Tracking with Baballonia

The PICO 4 Pro and PICO 4 Enterprise headsets feature on-headset eye tracking and face tracking. The tracking from this is transmitted through PICO Connect and can be used with VRCFaceTracking.

When these headsets are rooted, you may instead send the raw camera feeds over the network to Baballonia to run the tracking on your computer.

This works well for eye tracking but less consistently for lower face tracking, due to the unconventional position of the camera on these headsets.

You should not combine this method with thoricelli’s VRCFT module.

Steps

1. Root your headset following the relevant guide. Make sure you enable Zygisk.
2. Enable Eye Tracking and Face Tracking in Settings > LAB.
3. Calibrate eye tracking now - while eyed is enabled, calibration does not work.
4. Download eyed and eyestream from the downloads page, place them into the Download folder on the headset, and install them from Magisk.
5. Reboot your headset.
6. Open Baballonia, find your headset’s IP address, and set the camera feeds as:
   • http://<headset_ip>:4442/left
   • http://<headset_ip>:4442/right
   • http://<headset_ip>:4442/mouth