Same question was asked a week ago here (Why does UE5 compile every module every time?), where a workaround was offered: adding bUsePrecompiled = true to the plugin’s build.cs file.
Not really a definitive answer though. Hopefully Epic clears up what’s going on soon.