It's a funny thing, my large bore rifles seem to be more particular about having a thick patch, where my small calibers,(32&36), shoot just fine with a thin patch. However, there is one big difference, and that is the rifling. Those large bore round bottom rifling, like the thick patches and the small bores have more lands and shallow rifling. It seems like you just have to find the one that works.
One other thing, I have checked the accuracy of both a tight patch compared to one just a bit looser and I have hunted with the accuracy patch loaded to start the hunt and have a looser patch for a follow up shot. It's easy to tell the patches apart. My accuracy patch is solid white and the looser patch is stripped blue. I know this sounds like a lot of extra trouble, but I'm a little particular in a hunting situation vs. just target shooting. The thing that made me do this was, I had shot a turkey, and of course the first thing to do is reload. In the excitement of the moment, I broke the ram rod off half way down the barrel. Fortunately I got the turkey, and did not need a follow up shot. I usually carry a range rod in the truck, just because of this one incident.
This might be a little off topic, but for the OP, I would match the ball and patch, for each gun and not try to cover them with the same combination