Actual wind drift depends on ball size, velocity and the exact direction of the wind. As a very rough rule of thumb for rifles of .45 to .58 caliber say one inch of drift for each mile per hour of 90 degree cross wind at 100 yards. Since a five MPH wind is just a barely noticeable breeze, that is something to think about on those 100 yard shots.
When I'm range shooting I am trying for the tightest groups of which the rifle and load are capable. So, for my purposes, shooting in a high wind is a waste of time and ammo. I don't consider it useful practice for hunting either, since I'd not try a long shot at game on a windy day. I'd get closer or just let it go. There are enough posiblities for a ball to go wrong under good conditions, I'd not compound that by adding in a gusty wind. The wind drift at 100 yards is about four times as great as at 50 yards, so 50 would be my limit on a very windy day of hunting.