Naval Jelly is basically phosphoric acid, and is a good rust remover without being overly corrosive.
From Wikipedia, "It is usually available as a greenish liquid, suitable for dipping (acid bath), but is more generally used as a component in a gel, commonly called naval jelly. As a thick gel, it may be applied to sloping, vertical, or even overhead surfaces. Care must be taken to avoid acid burns of the skin and especially the eyes, but the residue is easily diluted with water. When sufficiently diluted it can even be nutritious to plant life, containing the essential nutrients phosphorus and iron. It is sometimes sold under other names, such as "rust remover" or "rust killer". It should not be directly introduced into surface water such as creeks or into drains, however. After treatment, the reddish-brown iron oxide will be converted to a black iron phosphate compound coating that may be scrubbed off. Multiple applications of phosphoric acid may be required to remove all rust. The resultant black compound can provide further corrosion resistance (such protection is somewhat provided by the superficially similar Parkerizing and blued electrochemical conversion coating processes.) After application and removal of rust using phosphoric acid compounds, the metal should be oiled (if to be used bare, as in a tool) or appropriately painted, most durably by using a multiple coat process of primer, intermediate, and finish coats."
