Just some actual hands on experience to mix in with some of the theory being bantered about:
1) I've personally run chronograph tests on multiple calibers in 10 grain increments from 30 to 120grns and there are significant enough velocity gains at every step to make it worth the while if someone simply wants more velocity.
If somebody wants to use a mid range target load of 70grns, that's certainly everyone's choice, but don't do it on the basis that powder charges above that give very little velocity gain as that is simply not true.
2) I've personally used published max load charges in 28" and 32" inch barrels, PRBs and conicals...all powder has been very efficiently consumed, accuracy has not gone south, and there has been no exponentially objectionable fouling.
3) Recoil and flinching are things that people let happen to people...they are easily controlled, mind over matter, etc. I just returned from a range trip this morning to rezero a Flintlock at 50yards with a new hunting load and to practice with it...fired a total of 50 shots out of a rifled .62cal, 100grns Goex 2F, oxyoke wad, .020" pillow ticking, .600"/325grn lead balls...an outstanding powerful hunting load.