After posting this question I came across a slightly different post on these forums that had the answer I was looking for! Here it is for those who might need it: Tilt and Gravity controls on Android sensitivity - World Creation - Epic Developer Community Forums
Still not sure if this is a bug, but if it is then I hope it can be fixed.