So far, JDK 11 (11.0.16.1 specifically) has been working. Build was successful, AGDE didn’t complain and recognized the Quest 2.
In between switching JAVA_HOME, it is important to delete the project’s Intermediate folder and right click the .uproject to Generate Visual Studio Files.
I tried just deleting Intermediate/Android/ and it didn’t work, so there must be more in the Intermediate folder that relies on Java_Home.
I imagine doing a full rebuild from editor would probably work similarly.