Patched Unity with Mediapipe

I have been experimenting with media pipe and Unity referencing zapper workflow and I was able to do a simple construction of a cube moving with respect to the movement of the head. So I tried patching the same version to one of the games created using zapper SDK for Unity and in comparison to the zapper SDK, there was a drop in fps. below is a comparison table for reference

  • Zappar SDK [ Chrome, mobile device Android 11: 30fps ]

  • My code [ Chrome, mobile device Android 11: 10-15fps ]

So I wanted to understand is there a possibility I can boost the fps to 30fps. My agenda is to create a hand tracking-based model supportive of Unity games.
P.S. looking into web workers and their implementations

1 Like