There are two steps to the process. First, you need to issue a refund either through Paypal or via Etsy if they used direct checkout. Then you can cancel the order. You have to do both though, otherwise the customer doesn't get their money back. You'll know it all worked because you'll get an email from Etsy or Paypal with the amount of money being taken out of your account.