How to create a component with icon for actors?

It is possible to add new components to a component’s owner.

Not nearly so convenient as adding them at design time directly to actors, but entirely possible.
I used a cube static mesh (var box) here, where you would have your icon:
(This is the Begin Play for the component that adds the other needed components to its owner)