It personally wouldn't bother me, as a fellow crafter I understand the process and the reason for it.
Having said that, some buyers are SUPER picky and unrealistic. You might want to include a photo where the glue residue is visible, so the buyer has the opportunity to see it before hand, and so that if a picky customer complains after the fact, you can point out that it WAS visible in the listing.
Again, I don't think most people will care, but you probably want to cover your bases just in case.