Tom,
the contributing images in the left example seem to have aliased borders. Zoom into those images and see if you have a direct transition between black and image pixels (which is needed by GMM), or if there is a gradual transition. If there is a gradual transition, increasing the GMM "shrink" parameter should help.
Georg