Use the proper puller and
1, you will not screw all the way through the ball.
2, the brass collar will insure you screw in to the center of the ball, no collar and you screw in to the side of the ball and possibly damage the rifling and you are pulling on the side of the ball trying to rotate it while pulling.
One more thing, devising a way to secure the ramrod ("T" handle, cordage attached to ramrod etc.) and then pulling on the rifle makes it very easy to do.
All that aside, I still recommend trickling a little powder in and shooting them out.