That was it! The dimension value was set to 0 in many cases since the origin and the extent would sum up to a zero vector. Just changing the dimension vector to be the extent of each box makes more sense!
FVector dimension = boundingBox.extent;
Here is how it looks now. Thanks, man 
