yes, that greasy substance is the grease. for lubrication. it's a derivative of petroleum products, as are almost all industrial lubricants. all industrial lubricants are going to leave a greasy residue, cos that's how they work.
if you don't want it on your paper/fabrics, use the little straw that's sold with cans, and spot-clean it afterwards with dish soap.