You should be fine with Interchange plugin enabled and just disabling it for the FBX format.
you can disable it with that CVAR Interchange.FeatureFlags.Import.FBX=False
If you do not want to type if everytime you open your project, you can change the DefaultEngine.ini file in your project and add this in it.
[ConsoleVariables]
Interchange.FeatureFlags.Import.FBX=False