Im gonna add this as closed, managed to find out what was causing it!
Basically, over ride mass was enabled and so it was too heavy for him to knock them down. I unchecked it and played around with the values until I got something I was comfortable with 