Hi Rachel,
I had similar problems with calculated shipping and contacted Etsy admin to help sort through it. I had to put the maximum amount of items in my envelopes which increased the dimensions to figure it out. I realize for boxes this method may not work, so you may want to contact Etsy help and see what they suggest. Best of luck!