How to randomly move these bumps on this facade ? HELP

Hello all,

How should I do to randomly move these bumps on this facade ?

I made the displacement from the modeling window with the displace tool and I added a displacement texture.

Thank you very much if you can help me

VAL