IMO, a thousandth of an inch, give or take won't make much difference.
As I'm sure you know, a general rule of thumb is to size a soft lead ball .010 under the guns bore size and then patch it while loading.
Using your .40 caliber rifle, that would make the recommended size somewhere around .390. .389 is only .001 smaller. That's about 1/3 of the thickness of one human hair.
The reason I mentioned thinner patches is some folks have found that if the ball is cast out of a hard lead it will be harder to load with patches that work well with soft lead.
By using slightly thinner patches when used with a hard lead ball it's easier to load and often not much accuracy is lost.