I went to a bead store after work on Tuesday to get a buckle blank- I told them that I have silicone but they suggested I try E6000, a small tube for a few bucks. The girl had used it to glue rocks onto metal lol!
Now my problem with ribbon so far has been the moisture from glue stiffening my velvet ribbons. A dry adhesive is what I need to find, too bad glue guns barely work. :P