Why is using a Soft Reference from an actor in Blueprints still loading everything in memory in the Editor (according to the Size Map). Am I missing something?

Just create a FruitBase abstract class that inherits from Actor class and set it as parent to the Banana, Apple, Pear, etc class.