That fire particle system has a sphere for each emitter so they spawn at random points within those spheres. You need to either reduce the size of the sphere modules or delete them.
You may want to tweak Initial Size and Size by Life values as well. Initial Size is what it says, the size of a particle when it is born so you may want to decrease that as well to get a more torch-scale look, and Size by Life is a multiplier for initial size value, which you can control over an emitters lifetime.