I’ve worked on a similar project that tried to do the same thing for Quest. As you’ve discovered it is not the best quality even at max supported res.
My solution was to spend time (quite a bit) optimizing the scenes so we could ditch the 360 video entirely.