Kerosene, gasoline and diesel are fine, because I have used them extensively for years without any problem (I recommend only kerosene, much better than diesel or gasoline).
The symptoms you describe are a bit odd. Does the spring have enough tension? Is the cage bent in some way?
Try the soaking + toothbrushing + lube approach, most probably you'll solve the problem or get a better inside. No fear of chemical damage, whatsoever, even if you leave it on the bike and brush the frame, too.
Hope this helps!